I am running into issue with numbers greater than 16 digits. You can see the rou

giridharn over 9 years ago

I am running into issue with numbers greater than 16 digits. You can see the rounding is weird

fixed("12345678901234560",2,true) --> 12345678901234560.00
fixed("12345678901234561",2,true) --> 12345678901234560.00
fixed("12345678901234562",2,true) --> 12345678901234562.00
fixed("12345678901234563",2,true) --> 12345678901234564.00
fixed("12345678901234564",2,true) --> 12345678901234564.00
fixed("12345678901234565",2,true) --> 12345678901234564.00
fixed("12345678901234566",2,true) --> 12345678901234566.00
fixed("12345678901234567",2,true) --> 12345678901234568.00
fixed("12345678901234568",2,true) --> 12345678901234568.00
fixed("12345678901234569",2,true) --> 12345678901234568.00

Even more weird is the rounding of 18 digits number below-
fixed("123456789012345670",2,true) --> 123456789012345664.00

Looks like few others ran into this earlier with no solution forum.appian.com/.../

Any ideas to handl...

Discussion posts and replies are publicly visible

0 giridharn over 9 years ago

...e this is appreciated
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Stefan Helzle
A Score Level 3
over 9 years ago

Appian saves decimal numbers as double precision floating-point. Check en.wikipedia.org/.../Double-precision_floating-point_format. So this is expected behaviour.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 giridharn over 9 years ago

OK understood. But is there a way to get around this issue? I am thinking a custom expression to handle the decimal places and storing as text
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Stefan Helzle
A Score Level 3
over 9 years ago

If you only need to store these numbers this is OK. But any calculation is not possible.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel