Visual Basic INT Function Returns Incorrect Value |
Q115395
In a Visual Basic Programming System, Applications Edition procedure, the Int function returns the incorrect value when the number you use in the function is a Double data type value. For example, the Integer value of 201 should equal 201, but the Int function may return the value 200.
This behavior occurs because the Int function incorrectly truncates the
number value when the number is a Double data type (double-precision
floating-point).
Note that this behavior does not occur with Integer type or Single type
number values.
To work around this problem, use either of the following examples:
Microsoft provides examples of Visual Basic procedures for illustration
only, without warranty either expressed or implied, including but not
limited to the implied warranties of merchantability and/or fitness for a
particular purpose. This Visual Basic procedure is provided "as is" and
Microsoft does not guarantee that it can be used in all situations.
Microsoft does not support modifications of this procedure to suit customer
requirements for a particular purpose. Note that a line that is preceded by
an apostrophe introduces a comment in the code--comments are provided to
explain what the code is doing at a particular point in the procedure. Note
also that an underscore character (_) indicates that code continues from
one line to the next. You can type lines that contain this character as one
logical line or you can divide the lines of code and include the line
continuation character. For more information about Visual Basic for
Applications programming style, see the "Programming Style in This Manual"
section in the "Document Conventions" section of the Visual Basic "User's
Guide."
Sub IntTest()
Dim x as Double
x = 100 * 2.01
' Display x in a message box
' Note that MsgBox displays value of x as string expression
' displays value of 201 at this point
MsgBox x
' Display the Integer value of x in a message box
' (should equal 201)
MsgBox CInt(x)
End Sub
Sub IntTest()
Dim x as Double
x = 100 * 2.01
' Display x in a message box
' Note that MsgBox displays value of x as string expression
' displays value of 201 at this point
MsgBox x
' Display the Integer value of x in a message box
' (should equal 201)
MsgBox Int(Str(x))
End Sub Microsoft has confirmed this to be a problem in the Microsoft products listed at the beginning of this article. We are researching this problem and will post new information here in the Microsoft Knowledge Base as it becomes available.
Additional query words:
Keywords :
Issue type :
Technology :
|
Last Reviewed: January 15, 2001 © 2001 Microsoft Corporation. All rights reserved. Terms of Use. |