Issue 88972 - XY (scatter) with large numbers goes wrong
Summary: XY (scatter) with large numbers goes wrong
Alias: None
Product: General
Classification: Code
Component: chart (show other issues)
Version: 3.3.0 or older (OOo)
Hardware: All All
: P3 Trivial (vote)
Target Milestone: ---
Assignee: kla
QA Contact: issues@graphics
Keywords: oooqa, regression
Depends on:
Blocks: 72764
  Show dependency tree
Reported: 2008-05-03 17:28 UTC by
Modified: 2013-02-24 21:19 UTC (History)
4 users (show)

See Also:
Issue Type: DEFECT
Latest Confirmation in: ---
Developer Difficulty: ---

example with wrong scaling (11.56 KB, application/vnd.oasis.opendocument.spreadsheet)
2008-05-06 09:10 UTC, IngridvdM
no flags Details
patch_080515 (1.19 KB, text/plain)
2008-05-22 03:33 UTC, weiz
no flags Details

Note You need to log in before you can comment on or make changes to this issue.
Description 2008-05-03 17:28:27 UTC
I was curious when I came across this document whether Calc had the same flaws
as Excel:

stdev is perfect in calc, but it goes wrong with the scatter plot:

steps to reproduce:
1. create a new document with these numbers

10000000001	1000000000
10000000002	1000000000
10000000003	1000000000.9
10000000004	1000000001.1
10000000005	1000000001.01
10000000006	1000000000.99
10000000007	1000000001.1
10000000008	1000000001
10000000009	1000000000
10000000010	1000000000

2. create a new chart object with xy scatter 
3. output is a plot with negative numbers?


A good plot (see document, p. 7)
Comment 1 Regina Henschel 2008-05-03 17:55:57 UTC
Confirm, the automatic sets wrong values to y-axis.
Comment 2 kla 2008-05-05 10:19:45 UTC
confirmed, reassign to IHA 
Comment 3 IngridvdM 2008-05-06 09:10:56 UTC
Created attachment 53405 [details]
example with wrong scaling
Comment 4 weiz 2008-05-22 03:32:02 UTC
->iha: the patch is finished, please let me know your suggestions. Thanks!
Comment 5 weiz 2008-05-22 03:33:02 UTC
Created attachment 53832 [details]
Comment 6 IngridvdM 2008-06-05 10:11:45 UTC
@weiz, thanks for finding the root cause! Your patch does fix this problem.
There is still a possibility to enhance the fix. Instead of switching only from
sal_Int32 to sal_In64 we can use type double and function floor. Thus the fix
will help for even more extreme values. I changed the code accordingly in CWS
Comment 7 IngridvdM 2008-06-05 10:15:10 UTC
Fixed in CWS chart27.
Comment 8 IngridvdM 2008-06-25 12:24:32 UTC
@Thomas, please verify in CWS chart27.
For all old files including the attached one it is necessary to double click the
chart once or update it otherwise (e.g. by pressing F9) to see the corrected
Comment 9 kla 2008-06-27 10:04:27 UTC
Seen ok in CWS chart27 -> verified
Comment 10 kla 2008-07-22 13:52:24 UTC
Seen ok in current master -> closed