Why am I getting this value?

Asked Aug 05 '14 at 16:06

Active Aug 05 '14 at 16:06

Viewed 61 times

I've got the following:

var deltaTvd = stationTwo.VerticalDepth - stationOne.VerticalDepth;

Now, stationTwo.VerticalDepth is 10646.51 and stationOne.VerticalDepth is 10580.52. When I subtract these, I get 65.99. However, Visual Studio shows the answer as 65.989999999999782. The VerticalDepth property is a double. I'm wondering why I get the extra decimal places instead of just the 65.99?

asked Aug 05 '14 at 16:06

PiousVenom

6,888
11
47
86

7

Welcome to floating point arithmetic. At least one of those three numbers can't be stored with perfect precision in a double. – cdhowie Aug 05 '14 at 16:09
3

Dupe of about 10,000 StackOverflow questions. Take your pick. – Mike Christensen Aug 05 '14 at 16:09
1

Consider casting your values to decimal to avoid these mathematical shenanigans. – MadHenchbot Aug 05 '14 at 16:09
2

http://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.html – jbutler483 Aug 05 '14 at 16:09
http://stackoverflow.com/questions/618535/what-is-the-difference-between-decimal-float-and-double-in-net – TYY Aug 05 '14 at 16:12

Why am I getting this value?

0 Answers0