Apache OpenOffice (AOO) Bugzilla – Issue 111390
OOo Calc 3.0.1 and higher --> Notes bug
Last modified: 2019-06-03 21:10:55 UTC
Hello support, We used OpenOffice.org as our native office application. We have build a lot of templates and customized OOo sheets within our company for over 5 years now. We where until the OOo release 3.0.1 very happy with the product. But after the releases 3.0.1 till 3.2 we have some serious issues with a very pour performance on the same sheets. If we use a previous version like OOo 3.0 it works perfect! I think there is something changed by a developer in a way that had a very bad influence on the performance of OpenOffice.org Calc above version 3.0.1. You can find a part of a huge sheet at one of the following links, so you can check the issue by yourself: http://sugar.realopenit.nl/downloads/Forecast4development.ods or http://www.mijnbestand.nl/Uitnodiging-OYRCAUMK6XB4&download=PHZ4ZVNAG3F3 To simulate the problem you can do it on 2 ways: 1) Change on sheet “Januari” the group (view) details by clicking on 2 and after that on 1 and than back to 2. This take a little while. While in version 3.0 there was no delay!! 2) If you hit the “Optimizesheetview” macro button in the tool-bar on sheet “Januari”. You can filter items on the sheet. This is now a very VERY slow process. This macro was fast in the older versions. The “Forecast4development” sheet is a part of a huge sheet we used every hour of the day and helps us to organize, plan en calculate our business. With the latest versions of OOo we have a serious problem. I did some research myself and found that the problems are the notes in the sheet. If you delete all and only the notes it is fast again. But the notes are a must have. The use of notes in the previous versions of OOo where never a problem? What and why is this changed? I had before logging this issue a mail conversation with Elizabeth Matthis (Elizabeth.Matthis@Sun.COM). She ask me to file a new issue in IssueTracker because this one is not the same as the ones in the issues she quoted in her original response. For a complete log of our conversation I have this conversation included below this message. I think that if support is able to scan this whole conversation and test my sheet. This will be a complete and clear description of our problem with OOo 3.1 and higher. I hope there is a way you can fix this problem? Kind Regards, Johan Steenks Consulting manager RealOpen IT B.V. - Informaticalaan 7 - 2628 ZD Delft - The Netherlands Tel (+31) 15-2568969 - Mobiel (+31) 6-42705672 e-mail jsteenks@realopenit.nl - http://www.realopenit.nl ----------------------------------------------------------------------------------------------------------------------------------------------- Below my previous conversation with Liz. This was here first reaction on my above call ----------------------------------------------------------------------------------------------------------------------------------------------- Op 4/8/2010 om 05:36 nm is in bericht <4BBDF804.5060406@Sun.COM> door Elizabeth Matthis <Elizabeth.Matthis@Sun.COM> geschreven: Hello Johan, Speed regarding *hidden* notes was improved in OOo 3.2 so I'm guessing you are having a problem with visible notes. I asked a Calc developer and he said that your document must have tons of notes in order for there to be such a delay. Unfortunately, we didn't get your attachment because attachments are blocked from mailing lists. I found two similar issues already in issue tracker. Please add any additional insights to help the QA team get to the bottom of the problem and attach your document to one of the issues: http://www.openoffice.org/issues/show_bug.cgi?id=102716 http://www.openoffice.org/issues/show_bug.cgi?id=109276 I hope the developers will figure out what is creating the delay and get it fixed so you and others can enjoy working with OOo Calc again. Best regards, Liz p.s. If you are new to Issue Tracker you might want to read this for future reference: http://qa.openoffice.org/issue_handling/pre_submission.html ----------------------------------------------------------------------------------------------------------------------------------------------- Below my reply on this mail from Liz. ----------------------------------------------------------------------------------------------------------------------------------------------- Hello Liz, Thank you for very much for your quick response. I think that my document is a must have for a developer! This document is a part of a huge sheet. But the problems we have are easy to simulate in a part of this sheet and therefore very easy to thoubleshoot by a developer a guess. You can find our sheet at one the following links: http://sugar.realopenit.nl/downloads/Forecast4development.ods or http://www.mijnbestand.nl/Uitnodiging-OYRCAUMK6XB4&download=PHZ4ZVNAG3F3 We are working with hidden notes and we absolutely don´t use tons of notes (We have mostly between the 30 and 50 notes on a month sheet). It is the combination of notes and the use of outlines I guess. Check the above file please. If you delete the notes by selecting all cells and use delete contents (only the notes). The sheet is fast again. Remember this was fast in the OOo Calc versions before 3.1! What you also can see is that OOo makes sometimes a mess of the note view. I think this had also something to do with the outlines. When I read the issues you found in the issue tracker. I see that both issues had a lot of notes. This is not our case or we can maybe on this case help development to find also the performance bug in the notes. Because I think in the design change between OOo Calc 3.0.1 and OOo Calc 3.1. There is big performance difference in Calc. For your information we are working with Sun OOo version 3.2. Best regards, Johan Steenks Consulting manager RealOpen IT B.V. ▪ Informaticalaan 7 ▪ 2628 ZD Delft ▪ The Netherlands Tel (+31) 15-2568969 ▪ Mobiel (+31) 6-42705672 e-mail jsteenks@realopenit.nl ▪ www.realopenit.nl ----------------------------------------------------------------------------------------------------------------------------------------------- Below Liz her reaction to file a new issue for this problem ----------------------------------------------------------------------------------------------------------------------------------------------- -------- Original Message -------- Subject: Re: [ux-request] OpenOffice.org Calc 3.1 and higher --> develop bug? (resent) Date: Mon, 19 Apr 2010 12:10:34 +0200 From: Elizabeth Matthis <Elizabeth.Matthis@Sun.COM> Reply-To: request@ux.openoffice.org To: request@ux.openoffice.org References: <4BCC3D6B020000440001A2EA@mail.realopenit.nl> Hi Johann, On 04/19/10 11:24, Johan Steenks wrote: > Hello support, > > > > I was very surprised that on my first sign for help that there was a > very quick response! > :-) > I think (and there are a lot off users having performance issues with > OOo). That my case where we can easy re-produce the problem will help to > solve one piece of the performance puzzle there is with OOo 3.1 and > above. > > > True! > But is there someone who can give me a status on this case? Because now > I have the feeling after a good and quick start that this case does not > have the attention anymore. > > Not true. I just only work part time and the ux-request mailing list is not "support". ;-) > > I did a small test with to similar workstations and the same sheet. On > the workstation with version 3.0, the save time (including running a > macro and building a planning) is 42 seconds. On a workstation running > OOo 3.2, doing exact the same steps, it will take 2 minutes and 13 > seconds!! You can say we have a delay of 3 times by working with OOo > 3.2. > > I realize that your problem is not the same as the ones in the issues I quoted in my original response, so please file a new issue in IssueTracker. http://qa.openoffice.org/issue_handling/pre_submission.html It is important that the problem you are experiencing is handled properly, and email does not have the necessary "weight" in the process. Please note the issue number here and then I'll help get the issue attention. Add all your insights from these messages into the issue and add the documents as attachments. You have been very thorough in your description, so your text is valuable in getting a solution. > > Please read the following comments from the previous e-mails, because I > think that a lot of OOo users who is having performance issues on OOo > 3.2 have may be a similar problem. Why the still don´t use tons of > notes. > > > > I hope that development will take a closer look between OOo 3.0 and OOo > 3.1 and the use of notes in particular. Please again check my example. > > > > Best regards, > > > > Johan Steenks > Consulting manager > > Best regards, Liz
Created attachment 69301 [details] Big performance issue with notes
Not P1! I deleted URL without additional information. Reproducible with "Ooo 3.1.1 WIN XP DE[OOO310m19 (Build 9420)]" and with "Ooo-Dev 3.2.1 multilingual version English UI WIN XP: [OOO320m16 (Build 9497)]"! Steps to reproduce: 1. open Forecast4development.ods 2. click alternating little buttons at intercept point Row headings / Column headings as reported expected: unfold / fold should work immediately (as it does with "2.4.1 Multilingual version German UI WIN XP: [680m17(Build9310)]" actually: 5 ... 10s delay for each reaction Related to Issue 109276 @jsteenks: Please comment short, only relevant facts, summarize results of other discussions! Why do you believe that your problem is different from Issue 109276? What OS did you use for your tests?
.
Root cause for the loss of performance is a new feature that allows note shapes to be formatted, resized, repositioned, and to contain rich-formatted text. This feature has been added past OOo 3.0 to increase interoperability with other well-known spreadsheet apps. I am aware of the performance problems and have already added a few improvements especially for invisible notes (lazy initialization of the formatted shapes). So, next I will have a look what can be done for visible notes that obviously need to be initialized right after loading.
taking the issue
But the thing is that we are using a few notes and on a Windows 7 desktop with OOo 3.0 it works perfect and there is no delay at all. But the same sheet on OOo 3.1 or OOo 3.2 on Windows 7 or SuSE 11.2 it is very slow. Particular if we use a very handy feature like the optimizemacro in our forecast.ods sheet. (Marco is included in the above attached sheet) We have tested it on Windows XP, Windows 7 and SuSE11.2 Linux. Same problems on each os. Hmmmmmm... I think we are talking about the hidden notes! So if you said the you have made some improvements especially for the invisible notes . Than I think there is a very small chance this problem will be fixed on a short period of time. Because the need for interoperability with other well-known spreadsheet applications is off-course a much have for the rest of the world ;-) Maybe it is an idea that development build a switch in the calc options for the use of simple notes (very, very fast notes. With the warning that this will have affect on the interoperability with other spreadsheets) or the normal notes and will work on any system but can slowdown your spreadsheet. This nice and fancy extra features will kill Microsoft office in the end. Because who wants to use a spreadsheet on a quad-core dual processor with 8 Gb with Ram! This will be the time were we all dream of WordPerfect 5.1 and CalcPerfect 5.1 its was good enough and did were it was designed for making a letter or help us with calculating. My personal quote: “Nowhere days we spent more time on other things then our primary need → write a letter or calculating some business.”
Is there any news?
Despite the speed improvements for hidden notes I observed t extreme performance degradation when having a sheet with lots of hidden notes This is during loading, saving and a generic change to apply e.g. default formatting (Ctrl-M). In the case when I select the sheet and change all the rowhight for all the rows at once the csrss.exe (Windows XP SP3) goes to 80% and OOo takes the rest. One thread of OOo consumes all this time. I sampled a few thread stack traces with process explorer from www.sysinternals.com a saw all the time the following stack trace: ntkrnlpa.exe+0x6e9eb ntkrnlpa.exe+0x2bf8c hal.dll+0x2ef2 hal.dll+0x2427 win32k.sys+0x434cb win32k.sys+0x524b7 win32k.sys+0x537f5 win32k.sys+0x79f0 win32k.sys+0x7a58 win32k.sys+0x153233 win32k.sys+0x14a074 ntkrnlpa.exe+0x6a64c ntdll.dll!KiFastSystemCallRet vclmi.dll!component_writeInfo+0xed73 vclmi.dll!SalLayout::GetBoundRect+0x47 vclmi.dll!OutputDevice::GetTextBoundRect+0xe3 drawinglayermi.dll!drawinglayer::primitive2d::TextLayouterDevice::getTextBoundRect+0x51 drawinglayermi.dll!drawinglayer::primitive2d::TextSimplePortionPrimitive2D::getB2DRange+0xb6 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DReference+0x54 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DSequence+0x46 drawinglayermi.dll!drawinglayer::primitive2d::BasePrimitive2D::getB2DRange+0x28 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DReference+0x54 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DSequence+0x46 drawinglayermi.dll!drawinglayer::primitive2d::BasePrimitive2D::getB2DRange+0x28 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DReference+0x54 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DSequence+0x46 drawinglayermi.dll!drawinglayer::primitive2d::BasePrimitive2D::getB2DRange+0x28 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DReference+0x54 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DSequence+0x46 drawinglayermi.dll!drawinglayer::primitive2d::BasePrimitive2D::getB2DRange+0x28 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DReference+0x54 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DSequence+0x46 drawinglayermi.dll!drawinglayer::primitive2d::BasePrimitive2D::getB2DRange+0x28 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DReference+0x54 drawinglayermi.dll!drawinglayer::primitive2d::getB2DRangeFromPrimitive2DSequence+0x46 svxcoremi.dll!SdrObject::RecalcBoundRect+0x8d svxcoremi.dll!SdrObject::GetCurrentBoundRect+0x1a scmi.dll!ScPostIt::CreateCaptionFromInitData+0x68 scmi.dll!ScPostIt::GetOrCreateCaption+0xe scmi.dll!ScTable::GetRowHeight+0x2107 scmi.dll!ScDocument::HasValueData+0x167 scmi.dll!ScTabView::RefreshZoom+0x5240 scmi.dll!ScExpandedFixedText::~ScExpandedFixedText+0x3dcde scmi.dll!ScExpandedFixedText::~ScExpandedFixedText+0x3c0da scmi.dll!ScExpandedFixedText::~ScExpandedFixedText+0x3d344 vclmi.dll!Window::EndTracking+0xdc vclmi.dll!Window::LinkStubImplAsyncFocusHdl+0xf12 vclmi.dll!Window::LinkStubImplAsyncFocusHdl+0x1211 vclmi.dll!Window::LinkStubImplAsyncFocusHdl+0x12e1 vclmi.dll!SalFrame::CallCallback+0x16 vclmi.dll!component_writeInfo+0x2c5f vclmi.dll!component_writeInfo+0x858c vclmi.dll!component_writeInfo+0x87ae USER32.dll!GetDC+0x6d USER32.dll!GetDC+0x14f USER32.dll!GetWindowLongW+0x127 USER32.dll!DispatchMessageW+0xf vclmi.dll!GraphiteLayout::textSrc+0x6180 vclmi.dll!GraphiteLayout::textSrc+0x6728 vclmi.dll!GraphiteLayout::textSrc+0x67c2 vclmi.dll!GraphiteLayout::textSrc+0x6867 vclmi.dll!Application::Abort+0x55 vclmi.dll!Application::Yield+0xd vclmi.dll!Application::Execute+0x1e vclmi.dll!DeInitVCL+0x7aa vclmi.dll!SVMain+0x1c sofficeapp.dll!soffice_main+0x81 soffice.bin+0x101b soffice.bin+0x103c kernel32.dll!RegisterWaitForInputIdle+0x49 comparable stacktraces are seen with other time consuming actions. It looks like that when hidden notes are involved a too complex call-back path is taken from USER32.DLL.
The above description is based on version Windows OOO330m13, build 9539.
Hello it is very nice to see that there is some progress on this call. Let me remind you that this problem exist also on Linux based OSs. Why not make een option in OpenOffice.org calc where you can select if you want to use the simple notes what makes your system very very vast!! or the advanced (MS compatible) notes wat makes the system / use very slow.
Checking in DEV300m98, loading spreadsheet document with many notes does not seem to be a serious problem. On a test machine with a debug OOo build, loading 10,000 hidden notes takes 16 secs, loading 10,000 visible notes takes 23 secs.
back to QA
Seen ok in cws dr78 -> verified
retested this bug today with AOO416m1(Build:9790) - Rev. 1844436 2018-10-23 12:57 under win7 pro (x64) SP1, still an issue, pls. see add. comments in #128121, could somebody pls. reopen and give it some priority? see also #109276