12 Mar
2015
12 Mar
'15
10:13 a.m.
Hi,
This looks like a general programming problem to me. It is always dangerous to ask for equality on real numbers. Because of a rounding problem in the calculation (because of the way computers work), the sum is not exactly equal to the number on the right hand-side.
The usual algorithm to compare real numbers for equality, up to say 3 decimal numbers, is the following, comparing integers instead (replace 1000 with e.g. 100 for 2 decimal places):
fn:round($n1 * 1000) = fn:round($n2 * 1000)
Regards,
--
Florent Georges
http://fgeorges.org/
http://h2oconsulting.be/
On 12 March 2015 at 15:01, ankit kumar anky4bugs@gmail.com wrote:
> Hi,
>
> I am trying to evaluate this expression, it is supposed to give TRUE but,
> it is giving false.
>
> sum((<a>5923.17</a>,<a>5956.29</a>,<a>5989.28</a>)) = <a>17868.74</a>
>
> But, for this expression it is giving as expected.
>
> sum((<a>5922.78</a>,<a>-5955.78</a>,<a>5988.74</a>)) = <a>5955.74</a>
>
>
>
> Thanks
>
> Ankit