int- > float precision?

Discuss stuff not about Indigo.
Post Reply
3 posts • Page 1 of 1
User avatar
Kram1032
Posts: 6649
Joined: Tue Jan 23, 2007 3:55 am
Location: Austria near Vienna

int- > float precision?

Post by Kram1032 » Sun Feb 08, 2009 12:11 am

http://ompf.org/forum/viewtopic.php?f=4&t=1209
sounds pretty interesting to me....

alex22
Posts: 171
Joined: Thu Apr 12, 2007 12:07 pm
Location: Germany

Post by alex22 » Sun Feb 08, 2009 12:59 am

Another example: If you take an int64 variable and count up from 0 by 1 every microsecond, it will take 213,5 Million years before it reaches max.If you do the same thing with int32, it takes just a bit over an hour.
If you should use int256 (which is not supported by hardware), you would reach precision on time scale that is already unreal. Counting up by 1 every time the shortest time-span our physical theories can describe today, the Planck-time, the variable would be full after a time that is 10^22 times the age of the universe. Now thats enough time to describe about anything. :twisted:

User avatar
Kram1032
Posts: 6649
Joined: Tue Jan 23, 2007 3:55 am
Location: Austria near Vienna

Post by Kram1032 » Sun Feb 08, 2009 1:37 am

:shock: Nice example :D

Well, a high-precision integer is probably easier to hack together and make it efficient enough, than a highprecision float... or?

Post Reply
3 posts • Page 1 of 1

Who is online

Users browsing this forum: No registered users and 120 guests