I am trying to run 4 Payara domains per Windows 2019 server (I also have a few running on 2016). I can only use Payara 5.1.9.1 or 5.1.9.4 right now as those are the two supported for the two versions of this particular application I am hosting. I just have one application deployed per domain.
The Payara domains are configured as Windows Services set to run as Network Service. I have the two production domains set to start immediately and the two test domains set to start using "Delayed Start" in the windows service start up options.
In this environment, the servers are scheduled to run windows updates automatically every Sunday and do a reboot if necessary around 3am. My problem is that when the servers reboot for Updates, perhaps only one or two domains on each server will come up. Prior to setting the two test domains to delayed start up, often-times none of the domains would come up. Or just 1/4 would come up.
Each server has two cores and 12 GB RAM. These are the recs I got from PD so I admit I am not sure if it's enough, I am just using what they said. The CPU pegs during starting the domains, but seems OK just when running the applications. Even if I am just starting one domain at a time, it will still spike / peg, but not as badly if I try to start 2 or more very close together.
The Windows Service error is this:
Child process [4120 - D:/.../payara/194/payara5/glassfish/lib/nadmin.bat start-domain --watchdog --domaindir D:\...\payara\domains (domain name) ] terminated with 1
The Payara domain server log entries go like this:
[2020-06-21T03:47:48.866-0700] [Payara 5.194] [SEVERE] [NCLS-CORE-00014] [javax.enterprise.system.core] [tid: _ThreadID=1 _ThreadName=main] [timeMillis: 1592736468866] [levelValue: 1000] [[
Shutdown required
MultiException stack 1 of 1
MultiException stack 1 of 2
java.lang.IllegalStateException: Payara Microprofile Config needs running server environment to work. Either it's not running, or you're experiencing a race condition
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.await(ConfigProviderResolverSync.java:55)
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.getConfig(ConfigProviderResolverSync.java:77)
at org.eclipse.microprofile.config.ConfigProvider.getConfig(ConfigProvider.java:93)
at fish.payara.microprofile.healthcheck.HealthCheckService.postConstruct(HealthCheckService.java:119)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.glassfish.hk2.utilities.reflection.ReflectionHelper.invoke(ReflectionHelper.java:1268)
at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:309)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:351)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:281)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:65)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1213)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
MultiException stack 2 of 2
java.lang.IllegalStateException: Unable to perform operation: post construct on fish.payara.microprofile.healthcheck.HealthCheckService
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:369)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:281)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:65)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1213)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
]]
[2020-06-21T03:47:48.866-0700] [Payara 5.194] [SEVERE] [] [javax.enterprise.system.core] [tid: _ThreadID=1 _ThreadName=main] [timeMillis: 1592736468866] [levelValue: 1000] [[
Failed to start, exiting]]
[2020-06-21T03:47:48.866-0700] [Payara 5.194] [INFO] [] [] [tid: _ThreadID=1 _ThreadName=main] [timeMillis: 1592736468866] [levelValue: 800] [[
FileMonitoring shutdown]]
[2020-06-21T03:47:48.898-0700] [Payara 5.194] [INFO] [] [] [tid: _ThreadID=195 _ThreadName=RunLevelControllerThread-1592736468882] [timeMillis: 1592736468898] [levelValue: 800] [[
JdbcRuntimeExtension, getAllSystemRAResourcesAndPools = [GlassFishConfigBean.org.glassfish.jdbc.config.JdbcResource, GlassFishConfigBean.org.glassfish.jdbc.config.JdbcResource, GlassFishConfigBean.org.glassfish.jdbc.config.JdbcResource, GlassFishConfigBean.org.glassfish.jdbc.config.JdbcConnectionPool, GlassFishConfigBean.org.glassfish.jdbc.config.JdbcConnectionPool, GlassFishConfigBean.org.glassfish.jdbc.config.JdbcConnectionPool, GlassFishConfigBean.org.glassfish.jdbc.config.JdbcConnectionPool, GlassFishConfigBean.org.glassfish.jdbc.config.JdbcResource]]]
[2020-06-21T03:47:48.913-0700] [Payara 5.194] [INFO] [] [javax.enterprise.resource.resourceadapter.com.sun.enterprise.connectors.service] [tid: _ThreadID=196 _ThreadName=Thread-21] [timeMillis: 1592736468913] [levelValue: 800] [[
RAR7094: __ds_jdbc_ra shutdown successful.]]
So it seems like even just trying to start two domains simultaneously is too much. I fully admit to being new to Payara so maybe I am asking why water is wet but... Why can't I just have them all start up when the server reboots? Is there a config option I need inside the domains to get them to play nicely? Is running four Payara domains on a single server a bad idea?
Why does each Payara domain take so long to come up? It can take up to 10 minutes for all four of these domains to come up and the applications to load, and sometimes it takes another minute or two after that for all the components that actually allow me to log in to the application, to load. On another similar server, using Payara 5.1.7.1 for a different application, it takes literally 15 minutes from rebooting the server to having all the domains come up and the applications to load (just 3 domains on that server).
Am I just dramatically under-powered for what I'm trying to do? Am I trying to do something that it's just not designed for? Am I just missing something obvious in the config?
edit >>>
without any applications deployed in the domains, and all 4 services set to automatic (no delay), when I restart the server, I still get one domain that doesn't come up. Here's the error from that. I'm going to do a few more reboots and see if it consistently does this.
[2020-06-21T17:35:20.612-0400] [Payara 5.194] [SEVERE] [NCLS-CORE-00016] [javax.enterprise.system.core] [tid: _ThreadID=24 _ThreadName=RunLevelControllerThread-1592775310830] [timeMillis: 1592775320612] [levelValue: 1000] [[
Startup service failed to start
MultiException stack 1 of 2
java.lang.IllegalStateException: Payara Microprofile Config needs running server environment to work. Either it's not running, or you're experiencing a race condition
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.await(ConfigProviderResolverSync.java:55)
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.getConfig(ConfigProviderResolverSync.java:77)
at org.eclipse.microprofile.config.ConfigProvider.getConfig(ConfigProvider.java:93)
at fish.payara.microprofile.healthcheck.HealthCheckService.postConstruct(HealthCheckService.java:119)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.glassfish.hk2.utilities.reflection.ReflectionHelper.invoke(ReflectionHelper.java:1268)
at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:309)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:351)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:281)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:65)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1213)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
MultiException stack 2 of 2
java.lang.IllegalStateException: Unable to perform operation: post construct on fish.payara.microprofile.healthcheck.HealthCheckService
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:369)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:281)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:65)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1213)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
]]
[2020-06-21T17:35:20.952-0400] [Payara 5.194] [INFO] [] [javax.enterprise.system.core.transaction.com.sun.jts.CosTransactions] [tid: _ThreadID=22 _ThreadName=RunLevelControllerThread-1592775310829] [timeMillis: 1592775320952] [levelValue: 800] [[
JTS5014: Recoverable JTS instance, serverId=[100]]]
[2020-06-21T17:35:21.633-0400] [Payara 5.194] [WARNING] [] [org.glassfish.grizzly.config.GenericGrizzlyListener] [tid: _ThreadID=22 _ThreadName=RunLevelControllerThread-1592775310829] [timeMillis: 1592775321633] [levelValue: 900] [[
Unable to construct HTTP/2 Addon
java.lang.NoClassDefFoundError: org/glassfish/grizzly/npn/AlpnServerNegotiator
at org.glassfish.grizzly.config.GenericGrizzlyListener.configureHttp2Support(GenericGrizzlyListener.java:806)
at org.glassfish.grizzly.config.GenericGrizzlyListener.configureHttpProtocol(GenericGrizzlyListener.java:782)
at com.sun.enterprise.v3.services.impl.GlassfishNetworkListener.configureHttpProtocol(GlassfishNetworkListener.java:212)
at org.glassfish.grizzly.config.GenericGrizzlyListener.configureSubProtocol(GenericGrizzlyListener.java:456)
at org.glassfish.grizzly.config.GenericGrizzlyListener.configureProtocol(GenericGrizzlyListener.java:445)
at org.glassfish.grizzly.config.GenericGrizzlyListener.configure(GenericGrizzlyListener.java:341)
at com.sun.enterprise.v3.services.impl.GrizzlyProxy.initialize(GrizzlyProxy.java:126)
at com.sun.enterprise.v3.services.impl.GrizzlyService.createNetworkProxy(GrizzlyService.java:664)
at com.sun.enterprise.v3.services.impl.GrizzlyService.postConstruct(GrizzlyService.java:586)
at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:303)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:351)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:281)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:65)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1213)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1144)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$UpOneLevel.run(CurrentTaskFuture.java:762)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.ClassNotFoundException: org.glassfish.grizzly.npn.AlpnServerNegotiator
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:471)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.apache.felix.framework.ExtensionManager$ExtensionManagerWiring.getClassByDelegation(ExtensionManager.java:1179)
at org.apache.felix.framework.BundleWiringImpl.searchImports(BundleWiringImpl.java:1618)
at org.apache.felix.framework.BundleWiringImpl.findClassOrResourceByDelegation(BundleWiringImpl.java:1548)
at org.apache.felix.framework.BundleWiringImpl.access$300(BundleWiringImpl.java:79)
at org.apache.felix.framework.BundleWiringImpl$BundleClassLoader.loadClass(BundleWiringImpl.java:1982)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
... 23 more
]]
[2020-06-21T17:35:22.408-0400] [Payara 5.194] [INFO] [NCLS-CORE-00101] [javax.enterprise.system.core] [tid: _ThreadID=22 _ThreadName=RunLevelControllerThread-1592775310829] [timeMillis: 1592775322408] [levelValue: 800] [[
Network Listener http-listener-1 started in: 732ms - bound to [/0.0.0.0:21080]]]
[2020-06-21T17:35:22.409-0400] [Payara 5.194] [INFO] [NCLS-CORE-00058] [javax.enterprise.system.core] [tid: _ThreadID=22 _ThreadName=RunLevelControllerThread-1592775310829] [timeMillis: 1592775322409] [levelValue: 800] [[
Network listener http-listener-2 on port 21081 disabled per domain.xml]]
[2020-06-21T17:35:22.426-0400] [Payara 5.194] [WARNING] [] [org.glassfish.grizzly.config.GenericGrizzlyListener] [tid: _ThreadID=22 _ThreadName=RunLevelControllerThread-1592775310829] [timeMillis: 1592775322426] [levelValue: 900] [[
HTTP/2 (enabled by default) is unsupported with port unification and will be disabled for network listener admin-listener.]]
[2020-06-21T17:35:23.631-0400] [Payara 5.194] [INFO] [NCLS-CORE-00101] [javax.enterprise.system.core] [tid: _ThreadID=22 _ThreadName=RunLevelControllerThread-1592775310829] [timeMillis: 1592775323631] [levelValue: 800] [[
Network Listener admin-listener started in: 1,194ms - bound to [/0.0.0.0:21048]]]
[2020-06-21T17:35:23.633-0400] [Payara 5.194] [INFO] [NCLS-CORE-00087] [javax.enterprise.system.core] [tid: _ThreadID=22 _ThreadName=RunLevelControllerThread-1592775310829] [timeMillis: 1592775323633] [levelValue: 800] [[
Grizzly 2.4.3 started in: 8,174ms - bound to [http-listener-1:21080, admin-listener:21048]]]
[2020-06-21T17:35:24.106-0400] [Payara 5.194] [SEVERE] [NCLS-CORE-00014] [javax.enterprise.system.core] [tid: _ThreadID=1 _ThreadName=main] [timeMillis: 1592775324106] [levelValue: 1000] [[
Shutdown required
MultiException stack 1 of 1
MultiException stack 1 of 2
java.lang.IllegalStateException: Payara Microprofile Config needs running server environment to work. Either it's not running, or you're experiencing a race condition
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.await(ConfigProviderResolverSync.java:55)
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.getConfig(ConfigProviderResolverSync.java:77)
at org.eclipse.microprofile.config.ConfigProvider.getConfig(ConfigProvider.java:93)
at fish.payara.microprofile.healthcheck.HealthCheckService.postConstruct(HealthCheckService.java:119)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.glassfish.hk2.utilities.reflection.ReflectionHelper.invoke(ReflectionHelper.java:1268)
at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:309)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:351)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:281)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:65)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1213)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
MultiException stack 2 of 2
java.lang.IllegalStateException: Unable to perform operation: post construct on fish.payara.microprofile.healthcheck.HealthCheckService
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:369)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:281)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:65)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1213)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
]]
[2020-06-21T17:35:24.110-0400] [Payara 5.194] [SEVERE] [] [javax.enterprise.system.core] [tid: _ThreadID=1 _ThreadName=main] [timeMillis: 1592775324110] [levelValue: 1000] [[
Failed to start, exiting]]
[2020-06-21T17:35:24.118-0400] [Payara 5.194] [INFO] [] [] [tid: _ThreadID=1 _ThreadName=main] [timeMillis: 1592775324118] [levelValue: 800] [[
FileMonitoring shutdown]]
[2020-06-21T17:35:24.564-0400] [Payara 5.194] [INFO] [] [org.hibernate.validator.internal.util.Version] [tid: _ThreadID=1 _ThreadName=main] [timeMillis: 1592775324564] [levelValue: 800] [[
HV000001: Hibernate Validator 6.0.16.Final]]
[2020-06-21T17:35:26.944-0400] [Payara 5.194] [WARNING] [] [fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverImpl] [tid: _ThreadID=29 _ThreadName=payara-executor-service-task] [timeMillis: 1592775326944] [levelValue: 900] [[
Timeout out waiting for Microprofile Config startup
java.lang.IllegalStateException: Payara Microprofile Config needs running server environment to work. Either it's not running, or you're experiencing a race condition
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.await(ConfigProviderResolverSync.java:55)
at fish.payara.nucleus.microprofile.config.spi.ConfigProviderResolverSync.getConfig(ConfigProviderResolverSync.java:77)
at org.eclipse.microprofile.config.ConfigProvider.getConfig(ConfigProvider.java:93)
at org.eclipse.microprofile.metrics.MetricID.<init>(MetricID.java:121)
at fish.payara.microprofile.metrics.impl.MetricRegistryImpl.register(MetricRegistryImpl.java:314)
at fish.payara.microprofile.metrics.jmx.MBeanMetadataHelper.registerMetadata(MBeanMetadataHelper.java:118)
at fish.payara.microprofile.metrics.MetricsService.initMetadataConfig(MetricsService.java:241)
at fish.payara.microprofile.metrics.MetricsService.bootstrap(MetricsService.java:453)
at fish.payara.microprofile.metrics.MetricsService.lambda$init$0(MetricsService.java:144)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
]]
I am facing a similar problem, in my case I had to remove the Hotswap libs to be able to run the server again, it just stopped working from one day to the next.
I also noticed changes in domain.xml that I didn't do.
<context-service object-type="system-all" jndi-name="concurrent/__defaultContextService"></context-service>
<managed-thread-factory object-type="system-all" jndi-name="concurrent/__defaultManagedThreadFactory"></managed-thread-factory>
<resource-ref ref="concurrent/__defaultContextService"></resource-ref>
<resource-ref ref="concurrent/__defaultManagedThreadFactory"></resource-ref>
<microprofile-openapi-configuration></microprofile-openapi-configuration>
<ejb-container>
<ejb-timer-service></ejb-timer-service>
</ejb-container>
<rest-config></rest-config>
<environment-warning-configuration></environment-warning-configuration>
<cdi-service></cdi-service>
<jdbc-config-source-configuration></jdbc-config-source-configuration>
I have 2 Payaras (4.1.2 and 5.2021), both throw the same error
Related
I'm tearing my hair off with IBM MobileFirst Platform 8.0 on deploying the adapter.
I'm quite new to this platform and trying to following the instruction here
http://mobilefirstplatform.ibmcloud.com/tutorials/en/foundation/8.0/adapters/creating-adapters/#creating-adapters-using-mobilefirst-cli
I installed the mfp server, the mfpdev-cli, installed maven, created an adapter (which is just a default adapter). Then, run
mfpdev adapter build
The operation was success.
However, when I tried to deploy to the mfp server using mfpdev, there was an error in the console and the adapter was not deployed.
Here's the error :
[INFO] -----------------------------------------------------------------------
[INFO] Building SampleAdapter 1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- adapter-maven-plugin:8.0.2018021101:deploy (default-cli) # SampleAdapter ---
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.529 s
[INFO] Finished at: 2561-03-08T19:20:29+07:00
[INFO] Final Memory: 8M/112M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.ibm.mfp:adapter-maven-plugin:8.0.2018021101:deploy (default-cli) on project SampleAdapter: Unexpected response from http://localhost:9080/mfpadmin/management-apis/2.0/runtimes/mfp/adapters -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
Error deploying adapter
undefined
Error: An error occurred during an attempt to deploy the adapter. See the
preceding messages for details.
And when I looked to the mfp server log, it showed this error.
[ERROR ] RuntimeMBeanCallable.call() exception
java.lang.reflect.UndeclaredThrowableException
[err] java.lang.reflect.UndeclaredThrowableException
[err] at com.sun.proxy.$Proxy342.changeDeploymentState(Unknown Source)
[err] at com.ibm.mfp.admin.actions.ArtifactDeploymentTransaction.prepareMBean(ArtifactDeploymentTransaction.java:822)
[err] at com.ibm.mfp.admin.actions.util.RuntimeMBeanWorkerThreadCaller$RuntimeMBeanCallale.call(RuntimeMBeanWorkerThreadCaller.java:76)
[err] at com.ibm.mfp.admin.actions.util.RuntimeMBeanWorkerThreadCaller.callSynchronouslyRuntimeMBeanWorkerThreadCaller.java:206)
[err] at com.ibm.mfp.admin.actions.util.RuntimeMBeanPoolCaller.callRuntimeMBeans(RuntimeMBeanPoolCaller.java:91)
.
.
.
.
[err] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
[err] at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:501)
[err] at java.lang.Throwable.readObject(Throwable.java:914)
[err] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[err] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[err] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[err] at java.lang.reflect.Method.invoke(Method.java:497)
[err] at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
[err] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900)
[err] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
[err] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
[err] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
[err] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
[err] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
[err] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
[err] at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
[err] at com.ibm.ws.jmx.connector.server.rest.JSONSerializationHelper.readObject(JSONSerializationHelper.java:69)
[err] at [internal classes]
[err] ... 102 more
[ERROR ] Unable to delete configuration with id ADAPTER_CONTENT due to exception FWLSE3208E: An invalid status code "404" was returned.
The response content is "{"reason":"configuration_not_found","details":"CNFSRVE115: configuration with id 'ADAPTER_CONTENT' for schema 'mfp_default_schema' with version '1.0' not found"}".
However, I did skim back to the server starting log, there seemed to have some [err], which I'm not sure whether it is an error or not.
[WARNING ] CWNEN0070W: The javax.ws.rs.CookieParam annotation class will not be recognized because it was loaded from the file:/D:/MobileFirst/mfp server/usr/servers/mfp/apps/mfp-push-service.war location rather than from a product class loader.
[err] 670 PushPU-derby INFO [Default Executor-thread-2] openjpa.Runtime - Starting OpenJPA 2.4.1
[err] 1363 PushPU-derby INFO [Default Executor-thread-2] openjpa.jdbc.JDBC - Using dictionary class "org.apache.openjpa.jdbc.sql.DerbyDictionary".
[err] 2688 PushPU-derby INFO [Default Executor-thread-2] openjpa.jdbc.JDBC - Connected to Apache Derby version 10.10 using JDBC driver Apache Derby Embedded JDBC Driver version 10.11.1.1 - (1616546).
[AUDIT ] CWWKZ0001I: Application mfp started in 47.549 seconds.
[AUDIT ] CWWKZ0001I: Application imfpush started in 49.088 seconds.
[19:12:51,128][WARN ][org.elasticsearch.bootstrap] JNA not found. native methods will be disabled.
[err] 24634 WorklightManagementPU-derby INFO [Default Executor-thread-5] openjpa.Runtime - Starting OpenJPA 2.4.1
[err] 24634 WorklightManagementPU-derby INFO [Default Executor-thread-5] openjpa.jdbc.JDBC - Using dictionary class "org.apache.openjpa.jdbc.sql.DerbyDictionary" (Apache Derby 10.11.1.1 - (1616546) ,Apache Derby Embedded JDBC Driver 10.11.1.1 - (1616546)).
[err] 24650 WorklightManagementPU-derby INFO [Default Executor-thread-5] openjpa.jdbc.JDBC - Connected to Apache Derby version 10.10 using JDBC driver Apache Derby Embedded JDBC Driver version 10.11.1.1 - (1616546).
[AUDIT ] CWWKZ0001I: Application analytics-service started in 58.394 seconds.
I couldn't find any solution or resource regarded to this problem. There are just some few thread talking about this but they couldn't manage to solve it either.
Configuration with id 'ADAPTER_CONTENT' for schema 'mfp_default_schema' with version '1.0' not found
and
https://www.cpume.com/question/fezseeoz-unable-to-delete-configuration-with-id-adapter-content-due-to-exception-fwlse320.html
I also tried to deploy from MobileFirst Application Web Console. It also failed.
My machine env are as follow:
OS : Win7 SP1
JDK : 1.8.0_60-b27
Maven : 3.5.2
MFP Server : 8.0.0.00-20180220-083852
mfpdev-cli : 8.0.0-2017102406
Anyone has experienced this before?
All helps and suggestions would be greatly appreciated...
I`m trying to create a cluster with two nodes using glassfish 4.1.1 build 1.
One node is local, an the other one is ssh.The node is working as if I ping it it responds ok. ( Successfully made SSH connection to node node2 (gfNode2))
I have setup ssh, create the node, create one instance (i2) on that node but when i want to start the instance i get:
i2: Could not start instance i2 on node node2 (gfNode2). Command failed on node node2 (gfNode2): Previous synchronization failed at Sep 10, 2016 12:25:27 PM Will perform full synchronization. Removing all cached state for instance i2. CLI802 Synchronization failed for directory config, caused by: remote failure: SynchronizeFiles: Exception reading request Command start-local-instance failed. To complete this operation run the following command locally on host gfNode2 from the GlassFish install location /opt/glassfish4: lib/nadmin start-local-instance --node node2 --sync normal i2
if i run this command on node 2 machine i get:
./nadmin start-local-instance --node node2 --sync normal i2
Previous synchronization failed at Sep 10, 2016 12:25:27 PM
Will perform full synchronization.
Removing all cached state for instance i2.
Enter admin user name> admin
Enter admin password for user "admin">
CLI802 Synchronization failed for directory config, caused by:
remote failure: SynchronizeFiles: Exception reading request
Command start-local-instance failed.
any idea what to try next ?
Update:
The DAS is reachabe, the ssh is working properly (ping-node-ssh works from das).
What I have noticed is that even after i have installed (install-node-ssh) and create with(create-node-ssh), node 2 has no files inside.
At /glassfish4/glassfish/nodes/node2/i2 there is only one file: .syncstate which is empty. The node2/i2 directories are there but nothing in i2. Maybe due to : Removing all cached state for instance i2.
That is what i got in DAS logs:
[2016-09-10T19:31:14.806+0000] [glassfish 4.1] [WARNING] [] [javax.enterprise.system.core] [tid: _ThreadID=106 _ThreadName=admin- listener(5)] [timeMillis: 1473535874806] [levelValue: 900] [[
Could not start instance i2 on node node2 (gfNode2).: Command ' /opt/glassfish4/glassfish/lib/nadmin --_auxinput - --interactive=false start-local-instance --node node2 --sync normal i2' failed on node node2 (gfNode2): Previous synchronization failed at Sep 10, 2016 12:25:27 PM
Will perform full synchronization.
Removing all cached state for instance i2.
Command start-local-instance failed.
CLI802 Synchronization failed for directory config, caused by:
remote failure: SynchronizeFiles: Exception reading request: To complete this operation run the following command locally on host gfNode2 from the GlassFish install location /opt/glassfish4:
lib/nadmin start-local-instance --node node2 --sync normal i2]]
[2016-09-10T19:31:14.818+0000] [glassfish 4.1] [SEVERE] [] [org.glassfish.admingui] [tid: _ThreadID=102 _ThreadName=admin-listener(1)] [timeMillis: 1473535874818] [levelValue: 1000] [[
RestResponse.getResponse() gives FAILURE. endpoint = 'https://localhost:4848/management/domain/servers/server/i2/start-instance'; attrs = '{}']]
[2016-09-10T19:31:14.820+0000] [glassfish 4.1] [SEVERE] [] [org.glassfish.admingui] [tid: _ThreadID=102 _ThreadName=admin-listener(1)] [timeMillis: 1473535874820] [levelValue: 1000] [[
Error in instanceAction ;
endpoint=https://localhost:4848/management/domain/servers/server/i2/start-instance;attrsMap=null]]
If I try to run the command from node2 I got what is showed on first code block of the post...
The problem here is that the remote instance i2 can't communicate with the DAS to download its configuration.
You will need to verify:
Is the DAS online?
Is the server where the DAS is reachable by the remote node?
Is SSH communication working properly? (use the asadmin command ping-node-ssh
If you open the server.log file for the instance and on the DAS, that should give you a more detailed error message and indicate whether or not the request is reaching the DAS.
The instance logs are located in:
$GLASSFISH_HOME/glassfish/nodes/node2/i2/logs/server.log
The domain logs are located in:
$GLASSFISH_HOME/glassfish/domains/domain1/logs/server.log
I have installed Apache Tez 0.8.1, Hadoop version 2.7.0 and Hive version 2.01.I am able to successfully run the Map Reduce Jobs.But when I configure hive and tried to run a simple count query, it returned the below error.From the error it is trying to look for a jar,I have placed the jar in classpath but still error did not resolve.
Please help me in resolving this.Thanks in Advance!!.
hive> select count(*) from sample1;
Query ID = root_20160728215555_a58e91a6-8913-4a57-8715-bc1739a2cb02
Total jobs = 1
Launching Job 1 out of 1
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 container FAILED -1 0 0 -1 0 0
Reducer 2 container KILLED 1 0 0 1 0 0
----------------------------------------------------------------------------------------------
VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 0.17 s
----------------------------------------------------------------------------------------------
Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1469720608711_0011_1_00, diagnostics=[Vertex vertex_1469720608711_0011_1_00 [Map 1] killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator
at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:70)
at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:89)
at org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializer(RootInputInitializerManager.java:138)
at org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers(RootInputInitializerManager.java:115)
at org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager(VertexImpl.java:4676)
at org.apache.tez.dag.app.dag.impl.VertexImpl.access$4300(VertexImpl.java:204)
at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.handleInitEvent(VertexImpl.java:3445)
at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:3394)
at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:3375)
at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1975)
at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:203)
at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2090)
at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2076)
at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:68)
... 20 more
Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/split/SplitLocationProvider
at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.<init>(HiveSplitGenerator.java:96)
... 25 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.split.SplitLocationProvider
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 26 more
]
Vertex killed, vertexName=Reducer 2, vertexId=vertex_1469720608711_0011_1_01, diagnostics=[Vertex received Kill in NEW state., Vertex vertex_1469720608711_0011_1_01 [Reducer 2] killed/failed due to:OTHER_VERTEX_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
UPDATE:
After I face the above issue, I have copied the hadoop-core-1.2.1.jar in hive lib folder.After that I am facing another issue while starting hive.From the trace I could figure out that there is some illegal argument passed.
Exception in thread "main" java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1550)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3080)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3108)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:543)
at org.apache.hadoop.hive.ql.session.SessionState.beginStart(SessionState.java:516)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:712)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1548)
... 14 more
Caused by: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 1.2.1
at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:165)
at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:132)
at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:93)
at org.apache.hadoop.hive.metastore.ObjectStore.getDataSourceProps(ObjectStore.java:376)
at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:268)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:58)
at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:67)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:517)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:482)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:544)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:370)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:219)
at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:67)
Issue is with the Apache Tez version.Apache Tez 0.8.1 is not compatible with Hadoop 2.7.0 and hive 2.0.1.
Have downloaded 0.8.4 src and built it which has resolved the issue.
Thanks!!.
when I run my project on eclipse it appears this
21:24:52,883 Infos [org.jboss.modules] JBoss Modules version 1.1.1.GA
21:24:53,056 INFO [org.jboss.msc] JBoss MSC version 1.0.2.GA
21:24:53,103 INFO [org.jboss.as] JBAS015899: JBoss AS 7.1.0.Final "Thunder" starting
21:24:53,442 ERROR [org.jboss.as.controller] JBAS014601: Error booting the container: java.lang.RuntimeException: org.jboss.as.controller.persistence.ConfigurationPersistenceException: JBAS014676: Failed to parse configuration
at org.jboss.as.controller.AbstractControllerService$1.run(AbstractControllerService.java:161) [jboss-as-controller-7.1.0.Final.jar:7.1.0.Final]
at java.lang.Thread.run(Unknown Source) [rt.jar:1.7.0_03]
Caused by: org.jboss.as.controller.persistence.ConfigurationPersistenceException: JBAS014676: Failed to parse configuration
at org.jboss.as.controller.persistence.XmlConfigurationPersister.load(XmlConfigurationPersister.java:125) [jboss-as-controller-7.1.0.Final.jar:7.1.0.Final]
at org.jboss.as.controller.AbstractControllerService.boot(AbstractControllerService.java:187) [jboss-as-controller-7.1.0.Final.jar:7.1.0.Final]
at org.jboss.as.server.ServerService.boot(ServerService.java:261) [jboss-as-server-7.1.0.Final.jar:7.1.0.Final]
at org.jboss.as.controller.AbstractControllerService$1.run(AbstractControllerService.java:155) [jboss-as-controller-7.1.0.Final.jar:7.1.0.Final]
... 1 more
Caused by: javax.xml.stream.XMLStreamException: ParseError at [row,col]:[3,1]
Message: Unexpected element '{urn:jboss:domain:1.2}server'
at org.jboss.staxmapper.XMLMapperImpl.processNested(XMLMapperImpl.java:108) [staxmapper-1.1.0.Final.jar:1.1.0.Final]
at org.jboss.staxmapper.XMLMapperImpl.parseDocument(XMLMapperImpl.java:69) [staxmapper-1.1.0.Final.jar:1.1.0.Final]
at org.jboss.as.controller.persistence.XmlConfigurationPersister.load(XmlConfigurationPersister.java:117) [jboss-as-controller-7.1.0.Final.jar:7.1.0.Final]
... 4 more
21:24:53,443 INFO [org.jboss.as] JBAS015950: JBoss AS 7.1.0.Final "Thunder" stopped in 4ms
my eclipse is luna and my jboss is 7.1
please help me to solve this problem
thank you very much
Hi I am trying to do a fresh build of Apache Usergrid but have been running into a build error when it reaches the Usergrid Launcher. The following is the log that gets displayed when I run: mvn -X clean install -DskipTests=true
Am I correct that it seems to be pointing to Apple Java Extensions to be the cause of the problem? If so how do I go about fixing the issue?
[DEBUG] junit:junit:jar:4.11:test
[DEBUG] org.hamcrest:hamcrest-core:jar:1.3:test
[DEBUG] org.springframework:spring-test:jar:3.1.2.RELEASE:test
[DEBUG] org.slf4j:jcl-over-slf4j:jar:1.6.1:compile
[DEBUG] org.slf4j:jul-to-slf4j:jar:1.6.1:compile
[DEBUG] log4j:log4j:jar:1.2.16:compile
[DEBUG] com.apple:AppleJavaExtensions:jar:1.5.4:compile
[DEBUG] org.slf4j:slf4j-api:jar:1.6.1:compile
[DEBUG] Using connector WagonRepositoryConnector with priority 0.0 for file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m/repository
Downloading: file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m2/repository/com/apple/AppleJavaExtensions/1.5.4/AppleJavaExtensions-1.5.4.jar
[DEBUG] Writing tracking file C:\Users\Alex\.m2\repository\com\apple\AppleJavaExtensions\1.5.4\AppleJavaExtensions-1.5.4.jar.lastUpdated
[DEBUG] Using connector WagonRepositoryConnector with priority 0.0 for https://repo.maven.apache.org/maven2
Downloading: https://repo.maven.apache.org/maven2/com/apple/AppleJavaExtensions/1.5.4/AppleJavaExtensions-1.5.4.jar
[DEBUG] Writing tracking file C:\Users\Alex\.m2\repository\com\apple\AppleJavaExtensions\1.5.4\AppleJavaExtensions-1.5.4.jar.lastUpdated
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Usergrid Parent .................................... SUCCESS [01:29 min]
[INFO] Usergrid Java SDK (old) ............................ SUCCESS [ 8.208 s]
[INFO] Usergrid Build Tools ............................... SUCCESS [ 0.955 s]
[INFO] Usergrid Config .................................... SUCCESS [ 1.616 s]
[INFO] Usergrid Test Utils ................................ SUCCESS [ 9.847 s]
[INFO] Usergrid Core ...................................... SUCCESS [ 31.411 s]
[INFO] Usergrid Services .................................. SUCCESS [ 27.583 s]
[INFO] Usergrid MongoDB Emulator .......................... SUCCESS [ 10.643 s]
[INFO] Usergrid REST ...................................... SUCCESS [01:02 min]
[INFO] Usergrid Tools ..................................... SUCCESS [13:34 min]
[INFO] Usergrid Websocket ................................. SUCCESS [ 27.734 s]
[INFO] Usergrid Launcher .................................. FAILURE [ 21.943 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 18:27 min
[INFO] Finished at: 2014-08-28T00:05:29-06:00
[INFO] Final Memory: 58M/178M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project usergrid-launcher: Could not resolve dependencies for project org.apache.usergrid:usergrid-launcher:jar:1.0.0:
Could not find artifact com.apple:AppleJavaExtensions:jar:1.5.4 in local-dependencies (file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m2/repository) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project usergrid-launcher: Could not resolve dependencies
for project org.apache.usergrid:usergrid-launcher:jar:1.0.0: Could not find artifact com.apple:AppleJavaExtensions:jar:1.5.4 in
local-dependencies (file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m2/repository)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:220)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127)
at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:257)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:200)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for
project org.apache.usergrid:usergrid-launcher:jar:1.0.0: Could not find artifact
com.apple:AppleJavaExtensions:jar:1.5.4 in local-dependencies
(file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m2/repository)
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:198)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDpendencyResolver.java:195)
... 22 more
Caused by: org.eclipse.aether.resolution.DependencyResolutionException: Could not find artifact
com.apple:AppleJavaExtensions:jar:1.5.4 in local-dependencies (file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m2/repository)
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:384)
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:192)
... 23 more
Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: Could not find artifact
com.apple:AppleJavaExtensions:jar:1.5.4 in local-dependencies (file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m2/repository)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:459)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:262)
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:367)
... 24 more
Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could not find artifact
com.apple:AppleJavaExtensions:jar:1.5.4 in local-dependencies (file://D:\incubator-usergrid-master\incubator-usergrid-master\stack\launcher/../m2/repository)
at org.eclipse.aether.connector.wagon.WagonRepositoryConnector$6.wrap(WagonRepositoryConnector.java:1012)
at org.eclipse.aether.connector.wagon.WagonRepositoryConnector$6.wrap(WagonRepositoryConnector.java:1004)
at org.eclipse.aether.connector.wagon.WagonRepositoryConnector$GetTask.run(WagonRepositoryConnector.java:725)
at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :usergrid-launcher D:\incubator-usergrid-master\incubator-usergrid-master\stack>
Any help would be greatly appreciated. Thanks.
Clearly its missing in a repo somewhere, for now get the jar from
https://code.google.com/r/ahduros-ooo-maven/source/browse/repository/com/apple/applejavaextensions/1.5.4/
and install it locally with
mvn install:install-file -Dfile=<path-to-file> -DpomFile=<path-to-pomfile>
You also have to either hack the jar or the pom.xml for launcher around a bit. I did the latter:
<dependency>
<groupId>com.apple</groupId>
<artifactId>applejavaextensions</artifactId>
<version>1.5.4</version>
</dependency>