Issue 88972

Summary: XY (scatter) with large numbers goes wrong
Product: General Reporter: openoffice.org
Component: chartAssignee: kla <thomas.klarhoefer>
Status: CLOSED FIXED QA Contact: issues@graphics <issues>
Severity: Trivial    
Priority: P3 CC: IngridvdM, issues, rb.henschel, weizhao
Version: 3.3.0 or older (OOo)Keywords: oooqa, regression
Target Milestone: ---   
Hardware: All   
OS: All   
Issue Type: DEFECT Latest Confirmation in: ---
Developer Difficulty: ---
Issue Depends on:    
Issue Blocks: 72764    
Attachments:
Description Flags
example with wrong scaling
none
patch_080515 none

Description openoffice.org 2008-05-03 17:28:27 UTC
I was curious when I came across this document whether Calc had the same flaws
as Excel: http://www.mis.coventry.ac.uk/~nhunt/pottel.pdf

stdev is perfect in calc, but it goes wrong with the scatter plot:


steps to reproduce:
1. create a new document with these numbers

10000000001	1000000000
10000000002	1000000000
10000000003	1000000000.9
10000000004	1000000001.1
10000000005	1000000001.01
10000000006	1000000000.99
10000000007	1000000001.1
10000000008	1000000001
10000000009	1000000000
10000000010	1000000000

2. create a new chart object with xy scatter 
3. output is a plot with negative numbers?

Expected:

A good plot (see document, p. 7)
Comment 1 Regina Henschel 2008-05-03 17:55:57 UTC
Confirm, the automatic sets wrong values to y-axis.
Comment 2 kla 2008-05-05 10:19:45 UTC
confirmed, reassign to IHA 
Comment 3 IngridvdM 2008-05-06 09:10:56 UTC
Created attachment 53405 [details]
example with wrong scaling
Comment 4 weiz 2008-05-22 03:32:02 UTC
->iha: the patch is finished, please let me know your suggestions. Thanks!
Comment 5 weiz 2008-05-22 03:33:02 UTC
Created attachment 53832 [details]
patch_080515
Comment 6 IngridvdM 2008-06-05 10:11:45 UTC
@weiz, thanks for finding the root cause! Your patch does fix this problem.
There is still a possibility to enhance the fix. Instead of switching only from
sal_Int32 to sal_In64 we can use type double and function floor. Thus the fix
will help for even more extreme values. I changed the code accordingly in CWS
chart27.
Comment 7 IngridvdM 2008-06-05 10:15:10 UTC
Fixed in CWS chart27.
Comment 8 IngridvdM 2008-06-25 12:24:32 UTC
@Thomas, please verify in CWS chart27.
For all old files including the attached one it is necessary to double click the
chart once or update it otherwise (e.g. by pressing F9) to see the corrected
rendering.
Comment 9 kla 2008-06-27 10:04:27 UTC
Seen ok in CWS chart27 -> verified
Comment 10 kla 2008-07-22 13:52:24 UTC
Seen ok in current master -> closed