realbasic-nug
[Top] [All Lists]

Re: double to string????

To: REALbasic NUG <realbasic-nug@lists.realsoftware.com>
Subject: Re: double to string????
From: Kirk Gray <develop@kirkgray.com>
Date: Mon, 30 Jun 2008 13:43:28 -0600
Authentication-results: mx.google.com; spf=neutral (google.com: 74.124.194.228 is neither permitted nor denied by best guess record for domain of realbasic-nug-bounces@lists.realsoftware.com) smtp.mail=realbasic-nug-bounces@lists.realsoftware.com
Delivered-to: listarchive@realsoftware.com
In-reply-to: <C48EFFC5.4EB3B%markus_winter@online.de>
References: <C48EFFC5.4EB3B%markus_winter@online.de>
Reply-to: REALbasic NUG <realbasic-nug@lists.realsoftware.com>
Sender: realbasic-nug-bounces@lists.realsoftware.com
On Jun 30, 2008, at 1:25 PM, Markus Winter wrote:

16 or 17 decimal places of accuracy.

My point exactly - it is not just the decimal points which go missing, it is
the numbers before the decimal point too!

Using your:
v = 12345678901234567890.1234567890

and Joe's:
EF1.text = Format(v, "-#.#")

I get:
12345678901234567168.

Which is to be expected.

Notice the first 17 digits are accurate to the assignment statement.

After that, you get garbage.

It's working exactly as advertised.


————————————————
Kirk Gray
REALbasic Professional 2008r2
MacBook Core 2 Duo, OS X 10.5.3
Power Mac dual G4, OS X 10.4.11


_______________________________________________
Unsubscribe or switch delivery mode:
<http://www.realsoftware.com/support/listmanager/>

Search the archives:
<http://support.realsoftware.com/listarchives/lists.html>


<Prev in Thread] Current Thread [Next in Thread>