KB131578 - FIX: Math Problem with INT() Function

Article ID: 131578

Article Last Modified on 9/30/2003

Microsoft Visual FoxPro 3.0 Standard Edition
Microsoft Visual FoxPro 3.0b Standard Edition

This article was previously published under Q131578

SYMPTOMS

The INT(nExpression) Function evaluates a numeric expression and returns incorrect values.

RESOLUTION

To work around this problem, change the SET DECIMAL setting to a larger more appropriate value such as 10 (the default is 2).

STATUS

Microsoft has confirmed this to be a problem in the Microsoft products listed at the beginning of this article. This problem has been fixed in Visual FoxPro 5.0 for Windows.

MORE INFORMATION

Steps to Reproduce Problem

Run the following code in Visual FoxPro:

   pnum1 = 1000000
   pnum2 = 999999

   SET DECI TO 2       && this is default

   ? int(pnum2/pnum1)  && result is 1 it should be 0

   SET DECI TO 10

   ? int(pnum2/pnum1)  && result is 0, which is correct

Keywords: kbbug kbfix kbvfp500fix KB131578