Re: Different behavior of Str(Double)? / Re: Floating point overflow

[Norman Palardy <npalardy@great-white-software.com>]

On 30-Sep-08, at 10:10 AM, Joe Strout wrote:

> On Sep 30, 2008, at 9:07 AM, Norman Palardy wrote:
>
> > 2) format the number with the precision you want
> >       tmp = format(number,",#.0000000") // exactly 7 digits after  
> > the decimal
> That gives you 7 decimal places, not 7 significant digits.  Getting  
> a result with a desired number of significant digits is harder.   
> (Off the top of my head, I suppose I might convert it to a string in  
> exponential notation, then shift the decimal point manually...)
True

Still it's not impossible to get format to do what you want / need

For the things I needed it for I required 7 decimal places

_______________________________________________
Unsubscribe or switch delivery mode:
<http://www.realsoftware.com/support/listmanager/>

Search the archives:
<http://support.realsoftware.com/listarchives/lists.html>