This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 171810 - Long delays with (negative) queries in default package
Summary: Long delays with (negative) queries in default package
Status: RESOLVED FIXED
Alias: None
Product: platform
Classification: Unclassified
Component: Module System (show other bugs)
Version: 6.x
Hardware: All All
: P2 blocker (vote)
Assignee: Jaroslav Tulach
URL: http://statistics.netbeans.org/except...
Keywords: PERFORMANCE
: 171048 172467 173679 177427 191100 (view as bug list)
Depends on:
Blocks: 198620
  Show dependency tree
 
Reported: 2009-09-09 12:25 UTC by Petr Jiricka
Modified: 2011-05-16 08:56 UTC (History)
10 users (show)

See Also:
Issue Type: DEFECT
Exception Reporter: 157859


Attachments
nps snapshot (10.53 KB, bin/nps)
2009-09-09 12:25 UTC, Petr Jiricka
Details
nps snapshot (10.53 KB, bin/nps)
2009-09-09 12:26 UTC, Petr Jiricka
Details
nps snapshot (13.59 KB, bin/nps)
2009-09-09 14:36 UTC, jmichelberger
Details
nps snapshot (8.53 KB, bin/nps)
2009-09-17 08:05 UTC, roger66
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Petr Jiricka 2009-09-09 12:25:28 UTC
Build: NetBeans IDE Dev (Build web-main-1505-on-090908)
VM: Java HotSpot(TM) 64-Bit Server VM, 11.3-b02-83, Java(TM) SE Runtime Environment, 1.6.0_13-b03-211
OS: Mac OS X, 10.5.8, x86_64

User Comments:
tmhealy: opening a project from a USB flash drive

wmf: Firing up program. I have noticed this on both my home notebook and my workstation. Seems program related. All other programs / services running properly.


Maximum slowness yet reported was 16813 ms, average is 5871
Comment 1 Petr Jiricka 2009-09-09 12:25:33 UTC
Created attachment 87357 [details]
nps snapshot
Comment 2 Exceptions Reporter 2009-09-09 12:25:38 UTC
This issue already has 7 duplicates 
see http://statistics.netbeans.org/exceptions/detail.do?id=157859
Comment 3 Petr Jiricka 2009-09-09 12:26:31 UTC
Build: NetBeans IDE Dev (Build web-main-1505-on-090908)
VM: Java HotSpot(TM) 64-Bit Server VM, 11.3-b02-83, Java(TM) SE Runtime Environment, 1.6.0_13-b03-211
OS: Mac OS X, 10.5.8, x86_64

User Comments: 

Maximum slowness yet reported was 16813 ms, average is 5871
Comment 4 Petr Jiricka 2009-09-09 12:26:35 UTC
Created attachment 87358 [details]
nps snapshot
Comment 5 Exceptions Reporter 2009-09-09 12:26:39 UTC
This issue already has 7 duplicates 
see http://statistics.netbeans.org/exceptions/detail.do?id=157859
Comment 6 t_h 2009-09-09 14:31:24 UTC
class loading
Comment 7 jmichelberger 2009-09-09 14:36:00 UTC
Build: NetBeans IDE Dev (Build nbms-and-javadoc-3898-on-090909)
VM: Java HotSpot(TM) Client VM, 14.2-b01, Java(TM) SE Runtime Environment, 1.6.0_16-b01
OS: Windows XP, 5.1, x86

User Comments: 

Maximum slowness yet reported was 20141 ms, average is 7655
Comment 8 jmichelberger 2009-09-09 14:36:03 UTC
Created attachment 87372 [details]
nps snapshot
Comment 9 Exceptions Reporter 2009-09-09 14:36:11 UTC
This issue already has 8 duplicates 
see http://statistics.netbeans.org/exceptions/detail.do?id=157859
Comment 10 Exceptions Reporter 2009-09-10 00:58:46 UTC
This issue already has 9 duplicates 
see http://statistics.netbeans.org/exceptions/detail.do?id=157859
Comment 11 Exceptions Reporter 2009-09-10 11:59:24 UTC
This issue already has 10 duplicates 
see http://statistics.netbeans.org/exceptions/detail.do?id=157859
Comment 12 Exceptions Reporter 2009-09-10 12:09:29 UTC
This issue already has 11 duplicates 
see http://statistics.netbeans.org/exceptions/detail.do?id=157859
Comment 13 Jaroslav Tulach 2009-09-11 09:38:47 UTC
The snapshot
http://statistics.netbeans.org/exceptions/exception.do?id=258048
shows 18s and at least 180 opened files. According to code at http://kickjava.com/src/org/jfree/base/BaseBoot.java.htm 
the classloader's are asked for /jcommon.properties. This leads me to believe our classloading system is not optimized 
for negative queries into root package.

Similar snapshot 
http://statistics.netbeans.org/exceptions/exception.do?id=258670
relates to Commons Logging's attempt to read "commons-logging.properties"

Again Commons Logging:
http://statistics.netbeans.org/exceptions/exception.do?id=257203

As Commons Logging is used in the NetBeans IDE as 3rd party library, this problem negatively affects performance of 
NetBeans IDE. Can we improve caching a bit, so negative queries require no ZIP opening and positive just directly open 
the correct JAR?

The other issues (originally eleven) seem to be related to something else than default package loading. I've separated 
them to their own issue http://statistics.netbeans.org/analytics/detail.do?id=158285
Comment 14 roger66 2009-09-17 08:05:16 UTC
Build: NetBeans IDE Dev (Build 200908022240)
VM: Java HotSpot(TM) Client VM, 16.0-b07, Java(TM) SE Runtime Environment, 1.7.0-ea-b70
OS: Windows XP, 5.1, x86

User Comments: 
Tried to open the issue tracker tree node in services tab
Maximum slowness yet reported was 35797 ms, average is 17550
Comment 15 roger66 2009-09-17 08:05:20 UTC
Created attachment 87811 [details]
nps snapshot
Comment 16 Exceptions Reporter 2009-09-17 08:05:26 UTC
This issue already has 5 duplicates 
see http://statistics.netbeans.org/exceptions/detail.do?id=157859
Comment 17 t_h 2009-09-17 12:34:31 UTC
*** Issue 172467 has been marked as a duplicate of this issue. ***
Comment 18 Jesse Glick 2009-09-21 18:37:55 UTC
The Commons Logging reports seem to come from either JasperSoft modules or the Mozilla browser, neither of which is in
the standard distro. The pause seems to be a normal cold disk cache effect. As for the JFreeChart report, again this is
not in the standard distro. Not a P2, I think, since the standard distro does not seem to be affected and it is unclear
what to do to reproduce.

I'm not really sure what to make of the profiler snapshot; it claims JarClassLoader.JarSource.getJarFile is called once
yet calls JarFile.<init> and JarClassLoader.JarSource.opened numerous times, when getJarFile contains no loop.

pnejedly probably knows more about the cache system, and especially the special-case treatment of META-INF/** resources
(issue #115017, issue #104340).
Comment 19 Jaroslav Tulach 2011-04-13 15:35:08 UTC
The default package problem needs to be resolved. There are/will be many duplicates.
Comment 20 Jaroslav Tulach 2011-04-13 15:37:57 UTC
*** Bug 171048 has been marked as a duplicate of this bug. ***
Comment 21 Jaroslav Tulach 2011-04-13 15:38:07 UTC
*** Bug 173679 has been marked as a duplicate of this bug. ***
Comment 22 Jaroslav Tulach 2011-04-13 16:12:13 UTC
*** Bug 191100 has been marked as a duplicate of this bug. ***
Comment 23 Jaroslav Tulach 2011-04-14 06:07:09 UTC
*** Bug 177427 has been marked as a duplicate of this bug. ***
Comment 24 Jaroslav Tulach 2011-05-10 10:07:06 UTC
ergonomics#4346c3549f66
Comment 25 Quality Engineering 2011-05-11 19:39:35 UTC
Integrated into 'main-golden', will be available in build *201105111436* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress)
Changeset: http://hg.netbeans.org/main/rev/4346c3549f66
User: Jaroslav Tulach <jtulach@netbeans.org>
Log: #171810: Special cache for content of default package to eliminate useless negative queries