Issue 88119 - Incorrect decimal numbers when filling series
Summary: Incorrect decimal numbers when filling series
Status: CONFIRMED
Alias: None
Product: Calc
Classification: Application
Component: editing (show other issues)
Version: OOo 2.4.0
Hardware: All All
: P4 Trivial (vote)
Target Milestone: ---
Assignee: AOO issues mailing list
QA Contact:
URL:
Keywords: oooqa
: 102727 112487 (view as issue list)
Depends on:
Blocks:
 
Reported: 2008-04-10 08:46 UTC by onym_kaplan
Modified: 2017-05-20 11:11 UTC (History)
3 users (show)

See Also:
Issue Type: DEFECT
Latest Confirmation in: ---
Developer Difficulty: ---


Attachments
Autofill generates "different" numebrs than the keyboard input. (103.13 KB, image/jpeg)
2008-04-23 21:29 UTC, discoleo
no flags Details
Saving the spreadsheet corrects these numbers. (9.91 KB, application/vnd.oasis.opendocument.spreadsheet)
2008-04-23 21:33 UTC, discoleo
no flags Details

Note You need to log in before you can comment on or make changes to this issue.
Description onym_kaplan 2008-04-10 08:46:45 UTC
When filling a series from -5 to 5 in steps of 0,5 some decimal values are
incorrect.

A snapshot from the series:
-1,60000000000000000000
-1,40000000000000000000
-1,20000000000000000000
-0,99999999999999600000
-0,79999999999999600000
-0,59999999999999600000
-0,39999999999999600000

It all works fine until it passes -1,2 then -1 becomes -0,99999999999999600000.
Discovered it when making a series for the funktion 1/x, when x=0 didn't give
#DIV/0!.

To recreate:
1. open new spreadsheet
2. mark two adjacent cells in a collumn
3. Edit->Fill->Series from -5 to 5 increment 0,2.
   OR
   type -5 in a cell. type -4,8 in the cell below. mark cells. click and hold 
low right corner of marked box. drag downwards till autofilling displays 5.
4. increase the number of decimalplaces to a value >17.
Comment 1 Regina Henschel 2008-04-10 15:42:04 UTC
Another nice example for issue 69749.

*** This issue has been marked as a duplicate of 69749 ***
Comment 2 Regina Henschel 2008-04-10 15:42:44 UTC
closing duplicate
Comment 3 ooo 2008-04-11 11:32:01 UTC
I think we could actually tackle this independent of issue 69749 by not filling
with repeated addition, but adding multiples of the difference to the start
value instead.
Comment 4 ooo 2008-04-11 11:33:26 UTC
Grabbing issue.
Comment 5 discoleo 2008-04-22 22:49:50 UTC
A consequence of this issue is described in issue:
http://www.openoffice.org/issues/show_bug.cgi?id=88429
[see 2nd spreadsheet attached to above issue]

The handling of autofill is too important to leave it spreadsheet-dependent.
Therefore, I filed a request on the OASIS-mailing list, see:
http://lists.oasis-open.org/archives/office-comment/200804/msg00000.html
Comment 6 discoleo 2008-04-23 21:25:53 UTC
This becomes even more strange:

1.) when using the automatic filling (e.g. when dragging the cell),
    one gets identical numbers as when typing using the keyboard
   [and the numbers are identical to within 18 digits - as displayed]

   - BUT these numbers behave differently when used in mathematical
     operations (see jpg-picture)

2.) when the spreadsheet is saved, these "different" numbers get
    saved as the correct values;

   - reopening the spreadsheet corrects the values,
     see attached spreadsheet
    [that's why I used a jpg-image to illustrate the first case]
Comment 7 discoleo 2008-04-23 21:29:33 UTC
Created attachment 53152 [details]
Autofill generates "different" numebrs than the keyboard input.
Comment 8 discoleo 2008-04-23 21:33:04 UTC
Created attachment 53153 [details]
Saving the spreadsheet corrects these numbers.
Comment 9 Regina Henschel 2009-06-13 00:57:49 UTC
*** Issue 102727 has been marked as a duplicate of this issue. ***
Comment 10 ooo 2010-06-18 14:17:16 UTC
*** Issue 112487 has been marked as a duplicate of this issue. ***
Comment 11 Marcus 2017-05-20 11:11:15 UTC
Reset assigne to the default "issues@openoffice.apache.org".