Search found 1 match
- 16 Sep 2014
- Forum: MultiCharts
- Topic: Is there any way to ensure calculation precision? [SOLVED]
- Replies: 1
- Views: 1028
Is there any way to ensure calculation precision? [SOLVED]
Here I would like to introduce a piece of simple code to show precision loss when involving large number calculation: //----- code begins ----- Vars: X(8121.2), Y(8339.3); value1 = Power((X - Y), 4); value2 = power(X, 4) - 4 * power(X, 3) * Y + 6 * power(X, 2) * Power(Y, 2) - 4 * X * Power(Y, 3) + P...