This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 114241 - 0826: GF v2 cannot start anymore UnrecoverableKeyException
Summary: 0826: GF v2 cannot start anymore UnrecoverableKeyException
Status: RESOLVED INVALID
Alias: None
Product: serverplugins
Classification: Unclassified
Component: Sun Appserver 9 (show other bugs)
Version: 6.x
Hardware: Sun Solaris
: P2 blocker (vote)
Assignee: nouar38
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2007-08-30 13:07 UTC by nouar38
Modified: 2007-09-19 20:44 UTC (History)
2 users (show)

See Also:
Issue Type: DEFECT
Exception Reporter:


Attachments
domain1 directory copied as domain1_save and zipped on solaris (3.00 MB, application/octet-stream)
2007-08-30 13:37 UTC, nouar38
Details
JsfJpaCrud (run-deploy) in output (1.08 KB, text/plain)
2007-08-31 10:01 UTC, nouar38
Details
domain1 log with the two tries CalculatorApp/JsfJpaCrud (43.46 KB, text/plain)
2007-08-31 10:03 UTC, nouar38
Details
Ide-log file (messages.log) if needed (39.21 KB, text/plain)
2007-08-31 10:04 UTC, nouar38
Details
more details about the steps and outputs (5.60 KB, text/plain)
2007-09-13 09:58 UTC, nouar38
Details
server.log file with success (58g) (34.84 KB, text/plain)
2007-09-13 10:01 UTC, nouar38
Details

Note You need to log in before you can comment on or make changes to this bug.
Description nouar38 2007-08-30 13:07:13 UTC
NB 6.0 200708261200 &GF v2 b58c & jdk 1.6 u1: solaris sparc

The instance was running as the other domains (1 personal dev, 1 pesronal cluster, 1 remote, 1 local but not default),
** I've stopped all and removed the nodes from IDE.
** with my xterm had a look to the files generated under the --userdir = /jdk_16_0826

gamay-03# ls -al
total 50
drwxr-xr-x   5 root     root         512 Aug 30 10:05 .
drwxr-xr-x  99 root     root        2560 Aug 29 19:55 ..
-rw-r--r--   1 root     root       12590 Aug 27 15:17 build.properties
drwxr-xr-x  17 root     root         512 Aug 30 10:05 config
-rw-r--r--   1 root     root         185 Aug 27 15:19 glassfish.properties
-rw-r--r--   1 root     root         185 Aug 29 13:55 glassfish_1.properties
-rw-r--r--   1 root     root         187 Aug 29 14:25 glassfish_2.properties
-rw-r--r--   1 root     root         213 Aug 29 14:46 glassfish_3.properties
-rw-r--r--   1 root     root         187 Aug 29 19:59 glassfish_4.properties
drwxr-xr-x   2 root     root         512 Aug 27 15:17 modules
drwxr-xr-x   6 root     root         512 Aug 29 14:02 var

** looked inside each one with (# more )

** and after restarted the IDE again with the same userdir, was able to see the GF V2 node (for my domain1)
but could not start again.

** could not start neither with asadmin same kind of exception.


<<

Aug 30, 2007 11:06:14 AM com.sun.enterprise.admin.servermgmt.launch.ASLauncher buildCommand
INFO:
/usr/jdk/latest/bin/java
-Dcom.sun.aas.instanceRoot=/opt/glassfish-v2-b58c/domains/domain1
-Dcom.sun.aas.ClassPathPrefix=
-Dcom.sun.aas.ClassPathSuffix=
-Dcom.sun.aas.ServerClassPath=
-Dcom.sun.aas.classloader.appserverChainJars.ee=
-Dcom.sun.aas.classloader.appserverChainJars=admin-cli.jar,admin-cli-ee.jar,j2ee-svc.jar
-Dcom.sun.aas.classloader.excludesList=admin-cli.jar,appserv-upgrade.jar,sun-appserv-ant.jar
-Dcom.sun.aas.classloader.optionalOverrideableChain.ee=
-Dcom.sun.aas.classloader.optionalOverrideableChain=webservices-rt.jar,webservices-tools.jar
-Dcom.sun.aas.classloader.serverClassPath.ee=%HADB_HOME%/lib/hadbjdbc4.jar,/opt/glassfish-v2-b58c/lib/SUNWjdmk/5.1/lib/jdmkrt.jar,%HADB_HOME%/lib/dbstate.jar,%HADB_HOME%/lib/hadbm.jar,%HADB_HOME%/lib/hadbmgt.jar,%MFWK_HOME%/lib/mfwk_instrum_tk.jar
-Dcom.sun.aas.classloader.serverClassPath=/opt/glassfish-v2-b58c/lib/install/applications/jmsra/imqjmsra.jar,/opt/glassfish-v2-b58c/imq/lib/jaxm-api.jar,/opt/glassfish-v2-b58c/imq/lib/fscontext.jar,/opt/glassfish-v2-b58c/imq/lib/imqbroker.jar,/opt/glassfish-v2-b58c/imq/lib/imqjmx.jar,/opt/glassfish-v2-b58c/lib/ant/lib/ant.jar,/opt/glassfish-v2-b58c/lib/SUNWjdmk/5.1/lib/jdmkrt.jar
-Dcom.sun.aas.classloader.sharedChainJars.ee=appserv-se.jar,appserv-ee.jar,jesmf-plugin.jar,%HADB_HOME%/lib/dbstate.jar,%HADB_HOME%/lib/hadbjdbc4.jar,jgroups-all.jar,%MFWK_HOME%/lib/mfwk_instrum_tk.jar
-Dcom.sun.aas.classloader.sharedChainJars=javaee.jar,/usr/jdk/latest/lib/tools.jar,install/applications/jmsra/imqjmsra.jar,com-sun-commons-launcher.jar,com-sun-commons-logging.jar,/opt/glassfish-v2-b58c/imq/lib/jaxm-api.jar,/opt/glassfish-v2-b58c/imq/lib/fscontext.jar,/opt/glassfish-v2-b58c/imq/lib/imqbroker.jar,/opt/glassfish-v2-b58c/imq/lib/imqjmx.jar,/opt/glassfish-v2-b58c/imq/lib/imqxm.jar,webservices-rt.jar,webservices-tools.jar,mail.jar,appserv-jstl.jar,jmxremote_optional.jar,/opt/glassfish-v2-b58c/lib/SUNWjdmk/5.1/lib/jdmkrt.jar,activation.jar,appserv-rt.jar,appserv-admin.jar,appserv-cmp.jar,/opt/glassfish-v2-b58c/updatecenter/lib/updatecenter.jar,/opt/glassfish-v2-b58c/jbi/lib/jbi.jar,/opt/glassfish-v2-b58c/imq/lib/imqjmx.jar,/opt/glassfish-v2-b58c/lib/ant/lib/ant.jar,dbschema.jar
-Dcom.sun.aas.configName=server-config
-Dcom.sun.aas.configRoot=/opt/glassfish-v2-b58c/config
-Dcom.sun.aas.defaultLogFile=/opt/glassfish-v2-b58c/domains/domain1/logs/server.log
-Dcom.sun.aas.domainName=domain1
-Dcom.sun.aas.installRoot=/opt/glassfish-v2-b58c
-Dcom.sun.aas.instanceName=server
-Dcom.sun.aas.processLauncher=SE
-Dcom.sun.aas.promptForIdentity=true
-Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory
-Dcom.sun.enterprise.overrideablejavaxpackages=javax.help,javax.portlet
-Dcom.sun.enterprise.taglibs=appserv-jstl.jar,jsf-impl.jar
-Dcom.sun.enterprise.taglisteners=jsf-impl.jar
-Dcom.sun.updatecenter.home=/opt/glassfish-v2-b58c/updatecenter
-Ddomain.name=domain1
-Djava.endorsed.dirs=/opt/glassfish-v2-b58c/lib/endorsed
-Djava.ext.dirs=/usr/jdk/latest/lib/ext:/usr/jdk/latest/jre/lib/ext:/opt/glassfish-v2-b58c/domains/domain1/lib/ext:/opt/glassfish-v2-b58c/javadb/lib
-Djava.library.path=/opt/glassfish-v2-b58c/lib:/opt/glassfish-v2-b58c/lib:/opt/glassfish-v2-b58c/lib
-Djava.security.auth.login.config=/opt/glassfish-v2-b58c/domains/domain1/config/login.conf
-Djava.security.policy=/opt/glassfish-v2-b58c/domains/domain1/config/server.policy
-Djava.util.logging.manager=com.sun.enterprise.server.logging.ServerLogManager
-Djavax.management.builder.initial=com.sun.enterprise.admin.server.core.jmx.AppServerMBeanServerBuilder
-Djavax.net.ssl.keyStore=/opt/glassfish-v2-b58c/domains/domain1/config/keystore.jks
-Djavax.net.ssl.trustStore=/opt/glassfish-v2-b58c/domains/domain1/config/cacerts.jks
-Djdbc.drivers=org.apache.derby.jdbc.ClientDriver
-Djmx.invoke.getters=true
-Dsun.rmi.dgc.client.gcInterval=3600000
-Dsun.rmi.dgc.server.gcInterval=3600000
-client
-XX:+UnlockDiagnosticVMOptions
-XX:MaxPermSize=192m
-Xmx512m
-XX:NewRatio=2
-XX:+LogVMOutput
-XX:LogFile=/opt/glassfish-v2-b58c/domains/domain1/logs/jvm.log
-cp
/opt/glassfish-v2-b58c/lib/jhall.jar:/opt/glassfish-v2-b58c/lib/appserv-launch.jar
com.sun.enterprise.server.PELaunch
start
Starting Sun Java System Application Server 9.1 (build b58c-fcs) ...
MBeanServer started: com.sun.enterprise.interceptor.DynamicInterceptor
CORE5098: AS Socket Service Initialization has been completed.
CORE5076: Using [Java HotSpot(TM) Client VM, Version 1.6.0_01] from [Sun Microsystems Inc.]
SEC1002: Security Manager is OFF.
/opt/glassfish-v2-b58c/domains/domain1/config/.__com_sun_appserv_pid
ADM0001:SunoneInterceptor is now enabled
java.lang.reflect.InvocationTargetException
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
Caused by: java.lang.ExceptionInInitializerError
       at com.sun.enterprise.security.SecurityLifecycle.onInitialization(SecurityLifecycle.java:101)
       at com.sun.enterprise.server.ApplicationServer.onInitialization(ApplicationServer.java:262)
       at com.sun.enterprise.server.ondemand.OnDemandServer.onInitialization(OnDemandServer.java:101)
       at com.sun.enterprise.server.PEMain.run(PEMain.java:401)
       at com.sun.enterprise.server.PEMain.main(PEMain.java:338)
       ... 5 more
Caused by: java.lang.IllegalStateException: java.security.UnrecoverableKeyException: Cannot recover key
       at com.sun.enterprise.security.SSLUtils.<clinit>(SSLUtils.java:128)
       ... 10 more
Caused by: java.security.UnrecoverableKeyException: Cannot recover key
       at sun.security.provider.KeyProtector.recover(KeyProtector.java:311)
       at sun.security.provider.JavaKeyStore.engineGetKey(JavaKeyStore.java:121)
       at sun.security.provider.JavaKeyStore$JKS.engineGetKey(JavaKeyStore.java:38)
       at java.security.KeyStore.getKey(KeyStore.java:763)
       at com.sun.net.ssl.internal.ssl.SunX509KeyManagerImpl.<init>(SunX509KeyManagerImpl.java:113)
       at com.sun.net.ssl.internal.ssl.KeyManagerFactoryImpl$SunX509.engineInit(KeyManagerFactoryImpl.java:48)
       at javax.net.ssl.KeyManagerFactory.init(KeyManagerFactory.java:239)
       at com.sun.enterprise.security.SSLUtils.initKeyManagers(SSLUtils.java:320)
       at com.sun.enterprise.security.SSLUtils.<clinit>(SSLUtils.java:106)
       ... 10 more
>>
Comment 1 nouar38 2007-08-30 13:37:46 UTC
Created attachment 47808 [details]
domain1 directory copied as domain1_save and zipped on solaris
Comment 2 nouar38 2007-08-30 14:37:59 UTC
got my windows-xp domain1 start broken with the same kind of exception SSL, on this windows-box I have
NB 6.0 200708280000 & GF v2 b58c and JDK 1.6 u1.

On this host, I've defined two remote from the solaris-sparc box: 
<<
http://gamay-03.france.sun.com:8080 (domain1): user=admin and pwd=adminadmin
and
http://gamay-03.france.sun.com:9116 (perso cluster-domain): username=nouar and pwd=nouarnouar
>>

this time removed the two remote nodes and did not exited the IDE.



Comment 3 Lukas Jungmann 2007-08-30 17:45:04 UTC
Martin, isn't this somehow related to QoS?

Reporter, how did you get to this state? Didn't you deploy some project with web service which had set some Quality of
Service (=WSIT) features?
Comment 4 nouar38 2007-08-31 08:27:50 UTC
yes, I did a deployment of the IDE-Samples/WebServices/Calculator project on my local default domain, on my remote
instance, and on the three other kind of domains. I don't know if the Calculator web service project set some Quality of
Service (=WSIT) features.

I can try again, as re-installed my two hosts with NB 6.0 20070830000 level and re-installed the bundled gf v2 b58c.
Comment 5 nouar38 2007-08-31 08:32:48 UTC
chaning in summary 0726->0826 am using this mm/dd string to find easly on which daily the issue is discovered.
Comment 6 Martin Grebac 2007-08-31 08:56:40 UTC
It might be connected to QoS (WSIT), if the WS has been 'Secure Calculator' not the simple 'Calculator'. Plain
Calculator doesn't have anything to do with QoS.
Comment 7 nouar38 2007-08-31 09:19:50 UTC
I was able to reproduce again with CalculatorApp and not the secured one. Did it on my windows-xp fresshly installed
with 20070830000 and the gf v2 b58c bundled. The instance was running as expected and after deploying this project
("Undeploy & Deploy"), the GF v2 server is stopped/started by this action and got the SSL exception.
But, before I've tried to deploy JsfJpaCrud (it cannot be deployed but another pb).

I'll re-install again, and do the test with only the CalculatorApp.
thanks,
nouar.
Comment 8 nouar38 2007-08-31 09:57:43 UTC
re-install again and try over CalculatorApp project: 
CalculatorApp web service deployment is ok, undeploy from server,
"undeploy & deploy" project is ok, undeploy from server.
stop the server and start the server: OK

==>> pb does not come from Calculator App if deployed before JsfJpaCrud.

try over JsfJpaCrud:
* create the project
* build the project
* undeploy & deploy ==>> deployed but in JsfJpaCrud (run-deploy) have error for name binding (see attachement 
that i'm adding later)
* stop the server
* start the server ==>>> get the SSL exception

Comment 9 nouar38 2007-08-31 10:01:12 UTC
Created attachment 47864 [details]
JsfJpaCrud (run-deploy) in output
Comment 10 nouar38 2007-08-31 10:03:10 UTC
Created attachment 47865 [details]
domain1 log with the two tries CalculatorApp/JsfJpaCrud
Comment 11 nouar38 2007-08-31 10:04:58 UTC
Created attachment 47866 [details]
Ide-log file (messages.log) if needed
Comment 12 Vince Kraemer 2007-09-13 02:19:15 UTC
Please provide step by step instructions to replicate this issue starting with a clean install and a clean userdir.

I have tried to replicate this based on what I think you have done, but haven't been successful.

Please describe the step in terms of items and menus selected, etc.
Comment 13 Vince Kraemer 2007-09-13 05:39:11 UTC
reassign to me after you have updated the issue with the requested info
Comment 14 nouar38 2007-09-13 09:52:40 UTC
with a new host freshly installed Solaris 10 u3 / X86 (i386):
+ No setup for the DB samples over derby, no java ee 5 samples installed
+ jdk 1.6u2 & NB 09121200 & GF v2 58g and a new project JsfJpaCrud 
the deployment of the application is ok
no problem for name binding, and no more SSL issue after a restart.
See full details in attachment.

This application use jdbc data source: jdbc/samples and SamplePool (
dburl: jdbc:derby://localhost:1527/sample [app on APP ]

will try again with the setup of DBs/resources for java ee 5 samples

Comment 15 nouar38 2007-09-13 09:58:40 UTC
Created attachment 48725 [details]
more details about the steps and outputs
Comment 16 nouar38 2007-09-13 10:01:40 UTC
Created attachment 48726 [details]
server.log file with success (58g)
Comment 17 Vince Kraemer 2007-09-13 16:07:34 UTC
Thank you for providing the detailed description of the steps you have taken to try to reproduce this bug.

So... it looks like you have been unable to reproduce this bug.  When will you close this issue as worksforme?

You can always reopen it, once you have a better handle on how to reproduce it.
Comment 18 nouar38 2007-09-13 17:24:26 UTC
ok changing the status
Comment 19 Vince Kraemer 2007-09-19 16:30:41 UTC
this is getting reported by users. Reopening and investigating
Comment 20 Lukas Jungmann 2007-09-19 19:13:30 UTC
see also http://forum.java.sun.com/thread.jspa?threadID=5192250 - there listing of domain.xml.
Don't know if it helps, I've just found a ref to that on some mailing list...
Comment 21 Vince Kraemer 2007-09-19 20:44:48 UTC
I was able to reproduce this bug, but have opened  issue 116062(that has detailed steps describing how to reproduce it)

I will cross link these, but close this one as invalid