Issue 128487 - Dimension line - numerical artefact
Summary: Dimension line - numerical artefact
Alias: None
Product: General
Classification: Code
Component: ui (show other issues)
Version: 4.1.11
Hardware: PC Windows 7
: P5 (lowest) Trivial (vote)
Target Milestone: ---
Assignee: AOO issues mailing list
QA Contact:
Depends on:
Reported: 2021-10-15 15:50 UTC by Czesław Wolański
Modified: 2021-10-15 15:50 UTC (History)
0 users

See Also:
Issue Type: DEFECT
Latest Confirmation in: ---
Developer Difficulty: ---

Example of numerical artefact (10.60 KB, application/
2021-10-15 15:50 UTC, Czesław Wolański
no flags Details

Note You need to log in before you can comment on or make changes to this issue.
Description Czesław Wolański 2021-10-15 15:50:00 UTC
Created attachment 87058 [details]
Example of numerical artefact

Steps to reproduce:

1. In Draw/Impress insert a dimension line.
2. In the context menu of the dimension line, choose "Dimensions...".
3. In the Dimensioning dialog increase stepwise the value of "Decimal places"
   and observe the Preview field (the default value by two decimal places is
   5.73 " and the upper limit of decimal places is 99).

Decimal    Preview field
places     [inch]

2          5.73
3          5.73
4          5.7299
5          5.72992
6          5.729921
7          5.7299213
8          5.72992126
9          -2.147483648

Notice that: 2^31 = 2,147,483,648
Continuing the "exercise"...

10         -.2147483648
11         0.-2147483648
12         0.0-2147483648

and so on...

However the effect not limited to the Preview field in the Dimensioning dialog.

4. Close the Dimensioning dialog.
5. Set the width of the dimension line to 5 inches (I used that value
   in the attached .odg file) and increase the number of decimal places
   via the Dimensioning dialog.

   Observe the effect starting with 9 decimal places.

Expected result: no numerical artefacts

Question: what it the rationale behind such a large allowable number
of decimal places i.e. 99?