X
PrevPrev Go to previous topic
NextNext Go to next topic
Last Post 17 Jun 2008 01:22 PM by  anon
convolution function
 1 Replies
Sort:
You are not authorized to post a reply.
Author Messages

anon



New Member


Posts:
New Member


--
17 Jun 2008 01:22 PM
    I am trying to implement IDL's CONVOL function in C++ exactly as IDL does. I understand what the Help is saying, but I suspect something is missing or incorrect on the help page because my implementation is producing very different results from using the CONVOL function. By the way, I'm not using any of the optional keywords. Has anyone else run into this problem?

    Deleted User



    New Member


    Posts:
    New Member


    --
    17 Jun 2008 01:22 PM
    You were storing your results in a byte array, while your inputs were of type long. So your results were overflowing the datatype, and wrapping the valid range of values. Ie: -2 became 254, -23 became 233 Make sense? Bob
    You are not authorized to post a reply.

    Forums Products IDL