format %e problem

Q&A's, tips, howto's
Locked
dexter
Posts: 74
Joined: Fri Nov 11, 2011 12:55 am

format %e problem

Post by dexter »

Hi guys

in newlisp docs

Code: Select all

(format "%e" 123456789)        → "1.234568e+08"
But when I reverse this

Code: Select all

> (int 1.234568e+08)
123456800
Got the different results
Why is this happend?

---
newLISP v.10.4.4 on OSX IPv4/6. 64bits

johu
Posts: 143
Joined: Mon Feb 08, 2010 8:47 am

Re: format %e problem

Post by johu »

Code: Select all

> (format "%e" 123456789)
"1.234568e+008"
> (format "%.6e" 123456789)
"1.234568e+008"
> (int 1.234568e+008)
123456800
> (format "%.7e" 123456789)
"1.2345679e+008"
> (int 1.2345679e+008)
123456790
> (format "%.8e" 123456789)
"1.23456789e+008"
> (int 1.23456789e+008)
123456789
Please read format.

HPW
Posts: 1390
Joined: Thu Sep 26, 2002 9:15 am
Location: Germany
Contact:

Re: format %e problem

Post by HPW »

Code: Select all

(format "%e" 123456789)
Without precision parameter it uses a default precision, so t gets rounded.
(Not mentioned in the doc)
Hans-Peter

dexter
Posts: 74
Joined: Fri Nov 11, 2011 12:55 am

Re: format %e problem

Post by dexter »

oh God

thanks guys

Locked