I export table input to big data Parquet output. I set Location=Local, and Folder/File name= "file:///G:/temp/feng",and run the transformation,get the follow errors:
2022/05/08 20:30:09 - Spoon - Using legacy execution engine
2022/05/08 20:30:09 - Spoon - Transformation opened.
2022/05/08 20:30:09 - Spoon - Launching transformation [v_bi_test_to_parquet]...
2022/05/08 20:30:09 - Spoon - Started the transformation execution.
2022/05/08 20:30:09 - v_bi_test_to_parquet - Dispatching started for transformation [v_bi_test_to_parquet]
2022/05/08 20:30:10 - Parquet output.0 - ERROR (version 8.3.0.0-371, build 8.3.0.0-371 from 2019-06-11 11.09.08 by buildguy) : Unexpected error
2022/05/08 20:30:10 - Parquet output.0 - ERROR (version 8.3.0.0-371, build 8.3.0.0-371 from 2019-06-11 11.09.08 by buildguy) : org.pentaho.di.core.exception.KettleException:
2022/05/08 20:30:10 - Parquet output.0 - can't get service format shim
2022/05/08 20:30:10 - Parquet output.0 - org.pentaho.hadoop.shim.ConfigurationException: Unable to load Hadoop configuration java.util.ServiceConfigurationError: org.pentaho.hadoop.shim.common.authorization.NoOpHadoopAuthorizationService: Provider org.pentaho.hadoop.shim.mapr60.authorization.ShimNoOpHadoopAuthorizationService could not be instantiated
2022/05/08 20:30:10 - Parquet output.0 -
2022/05/08 20:30:10 - Parquet output.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.parquet.output.ParquetOutput.init(ParquetOutput.java:101)
2022/05/08 20:30:10 - Parquet output.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.parquet.output.ParquetOutput.processRow(ParquetOutput.java:64)
2022/05/08 20:30:10 - Parquet output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2022/05/08 20:30:10 - Parquet output.0 - at java.lang.Thread.run(Thread.java:748)
2022/05/08 20:30:10 - Parquet output.0 - Caused by: org.pentaho.big.data.api.initializer.ClusterInitializationException: org.pentaho.hadoop.shim.ConfigurationException: Unable to load Hadoop configuration java.util.ServiceConfigurationError: org.pentaho.hadoop.shim.common.authorization.NoOpHadoopAuthorizationService: Provider org.pentaho.hadoop.shim.mapr60.authorization.ShimNoOpHadoopAuthorizationService could not be instantiated
2022/05/08 20:30:10 - Parquet output.0 - at org.pentaho.big.data.impl.shim.initializer.ClusterInitializerProviderImpl.initialize(ClusterInitializerProviderImpl.java:53)
2022/05/08 20:30:10 - Parquet output.0 - at Proxy7007af9d_3635_4f9d_bf71_525036c201f0.initialize(Unknown Source)
2022/05/08 20:30:10 - Parquet output.0 - at Proxy3114331f_fba1_4e42_aec2_2c5fd16bcea1.initialize(Unknown Source)
2022/05/08 20:30:10 - Parquet output.0 - at org.pentaho.big.data.api.initializer.impl.ClusterInitializerImpl.initialize(ClusterInitializerImpl.java:45)
2022/05/08 20:30:10 - Parquet output.0 - at Proxy1066287c_6d43_4647_b5db_91dd44f553e0.initialize(Unknown Source)
2022/05/08 20:30:10 - Parquet output.0 - at Proxy1b43f5f0_5092_4eeb_8b68_1741c28de27c.initialize(Unknown Source)
2022/05/08 20:30:10 - Parquet output.0 - at org.pentaho.big.data.api.cluster.service.locator.impl.NamedClusterServiceLocatorImpl.getService(NamedClusterServiceLocatorImpl.java:110)
2022/05/08 20:30:10 - Parquet output.0 - at Proxyf7550ee3_4ecd_4735_96a6_fb538ea631df.getService(Unknown Source)
2022/05/08 20:30:10 - Parquet output.0 - at Proxy435b60e6_4566_40ed_a8a6_42846dbeb2bc.getService(Unknown Source)
2022/05/08 20:30:10 - Parquet output.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.parquet.output.ParquetOutput.init(ParquetOutput.java:99)
2022/05/08 20:30:10 - Parquet output.0 - ... 3 more
What's the problem? What about shim service?
Related
In pentaho I get an error when I read a BigQuery table with a "Table Entry", I have these considerations:
This table was created from a Google Drive sheet with the service account
I can read this table with "Google Sheet Plugins"
[1]: https://i.stack.imgur.com/q9dl0.png
[2]: https://i.stack.imgur.com/gCxQK.png
2022/07/29 21:20:36 - Select.0 - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : An error occurred, processing will be stopped:
2022/07/29 21:20:36 - Select.0 - An error occurred executing SQL:
2022/07/29 21:20:36 - Select.0 - select 1 from `ms-data-warehouse.ms_Dev_Staging.ET_ods_hour`
2022/07/29 21:20:36 - Select.0 - [Simba][BigQueryJDBCDriver](100032) Error executing query job. Message: BIGQUERY_API_ERR
2022/07/29 21:20:36 - Select.0 - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : Error initializing step [Select]
2022/07/29 21:20:36 - insert drive - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : Step [Select.0] failed to initialize!
2022/07/29 21:20:36 - Select.0 - Finished reading query, closing connection.
2022/07/29 21:20:36 - Spoon - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : insert drive: preparing transformation execution failed
2022/07/29 21:20:36 - Spoon - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : org.pentaho.di.core.exception.KettleException:
2022/07/29 21:20:36 - Spoon - We failed to initialize at least one step. Execution can not begin!
Your second screenshot says that it doesn't have the Drive access.
BigQuery doesn't keep the credential for accessing the Google Drive, instead, BigQuery uses the "current user" credential trying to access Google Drive.
Apparently the "service account" has the Google Drive access (in order to create that table) but either your account or the account used to setup the Simba BigQueryJDBCDriver doesn't have the access to the Google Drive file.
We failed to initialize at least one step. Execution can not begin!
2021/01/18 15:31:45 - Carte - Installing timer to purge stale objects after 1440 minutes.
2021/01/18 15:33:05 - /Transformation 1 - Dispatching started for transformation [/Transformation 1]
2021/01/18 15:33:05 - CSV file input.0 - ERROR (version 9.1.0.0-324, build 9.1.0.0-324 from 2020-09-07 05.09.05 by buildguy) : Error initializing step [CSV file input]
2021/01/18 15:33:05 - CSV file input.0 - ERROR (version 9.1.0.0-324, build 9.1.0.0-324 from 2020-09-07 05.09.05 by buildguy) : java.lang.NumberFormatException: For input string: ""
2021/01/18 15:33:05 - CSV file input.0 - at java.lang.NumberFormatException.forInputString(Unknown Source)
2021/01/18 15:33:05 - CSV file input.0 - at java.lang.Integer.parseInt(Unknown Source)
2021/01/18 15:33:05 - CSV file input.0 - at java.lang.Integer.parseInt(Unknown Source)
2021/01/18 15:33:05 - CSV file input.0 - at org.pentaho.di.trans.steps.csvinput.CsvInput.init(CsvInput.java:875)
2021/01/18 15:33:05 - CSV file input.0 - at org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:69)
2021/01/18 15:33:05 - CSV file input.0 - at java.lang.Thread.run(Unknown Source)
2021/01/18 15:33:05 - /Transformation 1 - ERROR (version 9.1.0.0-324, build 9.1.0.0-324 from 2020-09-07 05.09.05 by buildguy) : Step [CSV file input.0] failed to initialize!
This time I need help with this software. I'm trying to create a transformation that, obtaining a mbox, return certains parts of the emails. But! When I use the step Email Message Input preview function, Pentaho return me this.
2016/09/09 14:52:53 - cfgbuilder - Warning: The configuration
parameter [org] is not supported by the default configuration builder
for scheme: sftp 2016/09/09 14:54:58 - DBCache - Loading database
cache from file: [C:\Users\fangonzalez.kettle\db.cache-6.1.0.1-196]
2016/09/09 14:54:58 - DBCache - We read 0 cached rows from the
database cache! 2016/09/09 14:54:59 - Spoon - Trying to open the last
file used. 2016/09/09 15:03:37 -
C:\Users\fangonzalez\Desktop\Pentaho\trans.ktr : trans - Dispatching
started for transformation
[C:\Users\fangonzalez\Desktop\Pentaho\trans.ktr : trans] 2016/09/09
15:03:37 - Email messages input.0 - ERROR (version 6.1.0.1-196, build
1 from 2016-04-07 12.08.49 by buildguy) : Error opening folder 1 :
java.lang.NullPointerException 2016/09/09 15:03:37 - Email messages
input.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49
by buildguy) : java.lang.NullPointerException 2016/09/09 15:03:37 -
Email messages input.0 - at
org.pentaho.di.trans.steps.mailinput.MailInput.openNextFolder(MailInput.java:347)
2016/09/09 15:03:37 - Email messages input.0 - at
org.pentaho.di.trans.steps.mailinput.MailInput.getOneRow(MailInput.java:214)
2016/09/09 15:03:37 - Email messages input.0 - at
org.pentaho.di.trans.steps.mailinput.MailInput.processRow(MailInput.java:75)
2016/09/09 15:03:37 - Email messages input.0 - at
org.pentaho.di.trans.step.RunThread.run(RunThread.java:62) 2016/09/09
15:03:37 - Email messages input.0 - at java.lang.Thread.run(Unknown
Source) 2016/09/09 15:03:37 - Email messages input.0 - Finished
processing (I=0, O=0, R=0, W=0, U=0, E=1) 2016/09/09 15:03:37 -
C:\Users\fangonzalez\Desktop\Pentaho\trans.ktr : trans -
Transformation detected one or more steps with errors. 2016/09/09
15:03:37 - C:\Users\fangonzalez\Desktop\Pentaho\trans.ktr : trans -
Transformation is killing the other steps!
There is the pic of the step config screen
The option "Fetch in batches" cannot be enable if you use only one mbox.
I clone the latest version (master) of Storm source code from https://github.com/apache/storm.git. I am using Ubuntu 14.02.
But when I run "mvn test" command, the test process fails and terminates at backtype.storm.multilang-test.
Here is the context of backtype.storm.multilang-test.xml file:
171293 [Thread-1212-1] ERROR b.s.util - Async loop died!
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:91) ~[classes/:?]
at backtype.storm.spout.ShellSpout.open(ShellSpout.java:84) ~[classes/:?]
at backtype.storm.daemon.executor$fn__4594$fn__4609.invoke(executor.clj:559) ~[classes/:?]
at backtype.storm.util$async_loop$fn__643.invoke(util.clj:473) [classes/:?]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
171294 [Thread-1212-1] ERROR b.s.d.executor -
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:91) ~[classes/:?]
at backtype.storm.spout.ShellSpout.open(ShellSpout.java:84) ~[classes/:?]
at backtype.storm.daemon.executor$fn__4594$fn__4609.invoke(executor.clj:559) ~[classes/:?]
at backtype.storm.util$async_loop$fn__643.invoke(util.clj:473) [classes/:?]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
171297 [Thread-1221-2] INFO b.s.d.executor - Preparing bolt 2:(2)
171297 [Thread-1221-2] INFO b.s.u.ShellProcess - Storm multilang serializer: backtype.storm.multilang.JsonSerializer
171298 [Thread-1203-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
171300 [Thread-1217-__acker] INFO b.s.d.executor - Preparing bolt __acker:(13)
171301 [Thread-1217-__acker] INFO b.s.d.executor - Prepared bolt __acker:(13)
171301 [Thread-1214-__system] INFO b.s.d.executor - Preparing bolt __system:(-1)
171300 [Thread-1226-__acker] INFO b.s.d.executor - Preparing bolt __acker:(3)
171302 [Thread-1214-__system] INFO b.s.d.executor - Prepared bolt __system:(-1)
171302 [Thread-1226-__acker] INFO b.s.d.executor - Prepared bolt __acker:(3)
171302 [Thread-1228-__acker] INFO b.s.d.executor - Preparing bolt __acker:(14)
171302 [Thread-1228-__acker] INFO b.s.d.executor - Prepared bolt __acker:(14)
171300 [Thread-1223-__system] INFO b.s.d.executor - Preparing bolt __system:(-1)
171304 [Thread-1223-__system] INFO b.s.d.executor - Prepared bolt __system:(-1)
171304 [Thread-1221-2] ERROR b.s.util - Async loop died!
java.lang.RuntimeException: Error when launching multilang subprocess
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:87) ~[classes/:?]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:126) ~[classes/:?]
at backtype.storm.daemon.executor$fn__4664$fn__4677.invoke(executor.clj:755) ~[classes/:?]
at backtype.storm.util$async_loop$fn__643.invoke(util.clj:473) [classes/:?]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
Caused by: java.io.IOException: Broken pipe
at java.io.FileOutputStream.writeBytes(Native Method) ~[?:1.7.0_79]
at java.io.FileOutputStream.write(FileOutputStream.java:345) ~[?:1.7.0_79]
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) ~[?:1.7.0_79]
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) ~[?:1.7.0_79]
at java.io.DataOutputStream.flush(DataOutputStream.java:123) ~[?:1.7.0_79]
at backtype.storm.multilang.JsonSerializer.writeString(JsonSerializer.java:96) ~[classes/:?]
at backtype.storm.multilang.JsonSerializer.writeMessage(JsonSerializer.java:89) ~[classes/:?]
at backtype.storm.multilang.JsonSerializer.connect(JsonSerializer.java:61) ~[classes/:?]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:85) ~[classes/:?]
... 5 more
171306 [Thread-1221-2] ERROR b.s.d.executor -
java.lang.RuntimeException: Error when launching multilang subprocess
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:87) ~[classes/:?]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:126) ~[classes/:?]
at backtype.storm.daemon.executor$fn__4664$fn__4677.invoke(executor.clj:755) ~[classes/:?]
at backtype.storm.util$async_loop$fn__643.invoke(util.clj:473) [classes/:?]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
Caused by: java.io.IOException: Broken pipe
at java.io.FileOutputStream.writeBytes(Native Method) ~[?:1.7.0_79]
at java.io.FileOutputStream.write(FileOutputStream.java:345) ~[?:1.7.0_79]
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) ~[?:1.7.0_79]
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) ~[?:1.7.0_79]
at java.io.DataOutputStream.flush(DataOutputStream.java:123) ~[?:1.7.0_79]
at backtype.storm.multilang.JsonSerializer.writeString(JsonSerializer.java:96) ~[classes/:?]
at backtype.storm.multilang.JsonSerializer.writeMessage(JsonSerializer.java:89) ~[classes/:?]
at backtype.storm.multilang.JsonSerializer.connect(JsonSerializer.java:61) ~[classes/:?]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:85) ~[classes/:?]
... 5 more
171308 [Thread-1231-__system] INFO b.s.d.executor - Preparing bolt __system:(-1)
171308 [Thread-1231-__system] INFO b.s.d.executor - Prepared bolt __system:(-1)
171309 [Thread-1233-__system] INFO b.s.d.executor - Preparing bolt __system:(-1)
171310 [Thread-1233-__system] INFO b.s.d.executor - Prepared bolt __system:(-1)
171315 [Thread-1235-__acker] INFO b.s.d.executor - Preparing bolt __acker:(15)
171315 [Thread-1203] INFO b.s.s.a.AuthUtils - Got AutoCreds []
171315 [Thread-1235-__acker] INFO b.s.d.executor - Prepared bolt __acker:(15)
171315 [Thread-1203] INFO b.s.d.worker - Reading Assignments.
171316 [Thread-1238-__acker] INFO b.s.d.executor - Preparing bolt __acker:(16)
171316 [Thread-1238-__acker] INFO b.s.d.executor - Prepared bolt __acker:(16)
171319 [refresh-active-timer] INFO b.s.d.worker - All connections are ready for worker 7dea90e5-ca16-4136-a112-88d756cd9014:1028 with id a74f15a4-ce44-4959-89a5-483b4aff164f
171324 [Thread-1203] INFO b.s.d.worker - Launching receive-thread for 6737d54e-6cc5-4de7-af27-171ba758fb5b:1025
171325 [Thread-1286-worker-receiver-thread-0] INFO b.s.m.loader - Starting receive-thread: [stormId: test-1-1438588543, port: 1025, thread-id: 0 ]
171325 [Thread-1240-__acker] INFO b.s.d.executor - Preparing bolt __acker:(4)
171325 [Thread-1240-__acker] INFO b.s.d.executor - Prepared bolt __acker:(4)
171325 [Thread-1212-1] ERROR b.s.util - Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332) [classes/:?]
at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
at backtype.storm.daemon.worker$fn__5151$fn__5152.invoke(worker.clj:532) [classes/:?]
at backtype.storm.daemon.executor$mk_executor_data$fn__4493$fn__4494.invoke(executor.clj:261) [classes/:?]
at backtype.storm.util$async_loop$fn__643.invoke(util.clj:485) [classes/:?]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
171325 [Thread-1221-2] ERROR b.s.util - Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332) [classes/:?]
at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
at backtype.storm.daemon.worker$fn__5151$fn__5152.invoke(worker.clj:532) [classes/:?]
at backtype.storm.daemon.executor$mk_executor_data$fn__4493$fn__4494.invoke(executor.clj:261) [classes/:?]
at backtype.storm.util$async_loop$fn__643.invoke(util.clj:485) [classes/:?]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
Any help is highly appreciated.
This problem has been solved after I install nodejs manually. The error is due to the improper default nodejs installation on Ubuntu.
Here is a list of software required to pass all the tests in Apache Storm:
List item
nodejs
python
zmq
ruby(requires json module to be installed)
Hope this list is helpful for anyone failing to pass the tests.
I'm using Eclipse Luna (Build id: 20150109-0600, 64 bits) on Windows with SonarQube plugin (SonarQube Java Analyser 3.4.0.20140404-0949-RELEASE)
When I try to Run Analyze, the plugin can connect with the server and download the issues of the last analyze (the problems are shown on SonarQube Issues view), but after that there is this error:
java.lang.IllegalStateException: Error status [command: C:\Program Files\Java\jre8\bin\java.exe -cp D:\temp\sonar-runner-impl1326048247551966004.jar org.sonar.runner.impl.BatchLauncherMain D:\temp\sonar-project7307491695046280128.properties]: 1
at org.sonar.runner.api.ForkedRunner.fork(ForkedRunner.java:199)
at org.sonar.runner.api.ForkedRunner.doExecute(ForkedRunner.java:144)
at org.sonar.runner.api.Runner.execute(Runner.java:90)
at org.sonar.ide.eclipse.core.internal.jobs.AnalyseProjectJob.run(AnalyseProjectJob.java:343)
at org.sonar.ide.eclipse.core.internal.jobs.AnalyseProjectJob.run(AnalyseProjectJob.java:130)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
The strange thing is that in D:\temp there is no file sonar-runner-implXXX.jar or sonar-projectXXX.properties but there are files sonar-runner-batchXXX.jar (like sonar-runner-batch1316679692029245803.jar)
Another strange thing, the command line is using a JRE 8, but my JAVA_HOME is a JDK 7, the projet where I'm running the Analyze is configured to use a JDK 7 and all my "Installed Jres" on Eclipse are acctually JDKs.
Can someone help me?
========================================================================
Hi
1 - About the temp files, they are really created and then deleted (I made a test "monitoring" the temp file while running the Analyze)
2 - And I could even copy the files and run the command line by hand, in this case i could se the real stack trace:
C:\>c:\Progra~1\Java\jdk1.8.0\jre\bin\java.exe -cp D:\temp\sonar-runner-impl5987517469765765781.jar org.sonar.runner.impl.BatchLauncherMain D:\temp\sonar-project5904228863019510021.properties
INFO: SonarQube Server 4.3.2
14:01:54.841 INFO - Preview mode
14:01:54.851 INFO - Load batch settings
14:01:55.338 INFO - User cache: C:\Users\fred\.sonar\cache
14:01:55.353 INFO - Install plugins
14:01:55.391 INFO - Include plugins:
14:01:55.391 INFO - Exclude plugins: devcockpit, buildstability, pdfreport, report, buildbreaker, scmactivity, views, jira
Exception in thread "main" org.sonar.runner.impl.RunnerException: Unable to execute Sonar
at org.sonar.runner.impl.BatchLauncher$1.delegateExecution(BatchLauncher.java:91)
at org.sonar.runner.impl.BatchLauncher$1.run(BatchLauncher.java:75)
at java.security.AccessController.doPrivileged(Native Method)
at org.sonar.runner.impl.BatchLauncher.doExecute(BatchLauncher.java:69)
at org.sonar.runner.impl.BatchLauncher.execute(BatchLauncher.java:50)
at org.sonar.runner.impl.BatchLauncherMain.execute(BatchLauncherMain.java:41)
at org.sonar.runner.impl.BatchLauncherMain.main(BatchLauncherMain.java:59)
Caused by: org.sonar.api.utils.SonarException: You're not authorized to execute a dry run analysis. Please contact your SonarQube administrator.
at org.sonar.batch.bootstrap.ServerClient.handleHttpException(ServerClient.java:120)
at org.sonar.batch.bootstrap.ServerClient.download(ServerClient.java:71)
at org.sonar.batch.bootstrap.PreviewDatabase.downloadDatabase(PreviewDatabase.java:85)
at org.sonar.batch.bootstrap.PreviewDatabase.start(PreviewDatabase.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.picocontainer.lifecycle.ReflectionLifecycleStrategy.invokeMethod(ReflectionLifecycleStrategy.java:110)
at org.picocontainer.lifecycle.ReflectionLifecycleStrategy.start(ReflectionLifecycleStrategy.java:89)
at org.picocontainer.injectors.AbstractInjectionFactory$LifecycleAdapter.start(AbstractInjectionFactory.java:84)
at org.picocontainer.behaviors.AbstractBehavior.start(AbstractBehavior.java:169)
at org.picocontainer.behaviors.Stored$RealComponentLifecycle.start(Stored.java:132)
at org.picocontainer.behaviors.Stored.start(Stored.java:110)
at org.picocontainer.DefaultPicoContainer.potentiallyStartAdapter(DefaultPicoContainer.java:1015)
at org.picocontainer.DefaultPicoContainer.startAdapters(DefaultPicoContainer.java:1008)
at org.picocontainer.DefaultPicoContainer.start(DefaultPicoContainer.java:766)
at org.sonar.api.platform.ComponentContainer.startComponents(ComponentContainer.java:91)
at org.sonar.api.platform.ComponentContainer.execute(ComponentContainer.java:77)
at org.sonar.batch.bootstrapper.Batch.startBatch(Batch.java:92)
at org.sonar.batch.bootstrapper.Batch.execute(Batch.java:74)
at org.sonar.runner.batch.IsolatedLauncher.execute(IsolatedLauncher.java:45)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.sonar.runner.impl.BatchLauncher$1.delegateExecution(BatchLauncher.java:87)
... 6 more
C:\>
3 - The real problem seems to be a lack of a permission...
But how can I give permission to "dry run analysis" to an user?
========================================================================
3 - I could solve the permission problem adding "Execute Preview Analysis" permission to the users.
4 - Now other error happened: Caused by: org.apache.bcel.classfile.ClassFormatException: Invalid byte tag in constant pool: 15
And i have no clue about it...
C:\>c:\Progra~1\Java\jdk1.8.0\jre\bin\java.exe -cp D:\temp\sonar-runner-impl5987517469765765781.jar org.sonar.runner.impl.BatchLauncherMain D:\temp\sonar-project5904228863019510021.properties
INFO: SonarQube Server 4.3.2
14:53:18.370 INFO - Preview mode
14:53:18.389 INFO - Load batch settings
14:53:18.794 INFO - User cache: C:\Users\fred\.sonar\cache
14:53:18.814 INFO - Install plugins
14:53:18.854 INFO - Include plugins:
14:53:18.854 INFO - Exclude plugins: devcockpit, buildstability, pdfreport, report, buildbreaker, scmactivity, views, jira
14:53:19.550 INFO - Create JDBC datasource for jdbc:h2:D:\workspaces\workspace-fred\.metadata\.plugins\org.eclipse.core.resources\.projects\sgl\org.sonar.ide.eclipse.core\.sonartmp\preview1422550399090-0
14:53:23.617 INFO - Initializing Hibernate
14:53:26.543 INFO - Load project settings
14:53:26.634 INFO - Apply project exclusions
14:53:26.862 INFO - ------------- Scan sgl
14:53:26.873 INFO - Load module settings
14:53:27.828 INFO - Loading technical debt model...
14:53:27.842 INFO - Loading technical debt model done: 14 ms
14:53:27.842 INFO - Loading rules...
14:53:28.111 INFO - Loading rules done: 269 ms
14:53:28.152 INFO - Configure Maven plugins
14:53:28.356 INFO - Compare to previous analysis (2015-01-29)
14:53:28.366 INFO - Compare over 30 days (2014-12-30, analysis of 2015-01-01 02:44:35.053)
14:53:28.376 INFO - Compare to previous version (2015-01-29)
14:53:28.376 INFO - No quality gate is configured.
14:53:28.485 INFO - Base dir: D:\workspaces\workspace-fred\sgl
14:53:28.485 INFO - Working dir: D:\workspaces\workspace-fred\.metadata\.plugins\org.eclipse.core.resources\.projects\sgl\org.sonar.ide.eclipse.core
14:53:28.485 INFO - Source dirs: D:\workspaces\workspace-fred\sgl\webApplication, D:\workspaces\workspace-fred\sgl\clientconf, D:\workspaces\workspace-fred\sgl\src\java, D:\workspaces\workspace-fred\sgl\src\conf, D:\workspaces\workspace-fred\sgl\conf
14:53:28.485 INFO - Test dirs: D:\workspaces\workspace-fred\sgl\src\test
14:53:28.485 INFO - Binary dirs: D:\workspaces\workspace-fred\sgl\webApplication\WEB-INF\classes
14:53:28.485 INFO - Source encoding: UTF-8, default locale: en_US
14:53:28.485 INFO - Index files
14:53:46.434 INFO - 959 files indexed
14:53:50.916 INFO - Quality profile for java: Minds Java Profile
14:53:51.088 INFO - Sensor JavaSquidSensor...
14:53:51.223 INFO - Java Main Files AST scan...
14:53:51.227 INFO - 946 source files to be analyzed
14:54:01.229 INFO - 127/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\model\DatabaseVersion.java
14:54:11.240 INFO - 176/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\model\MaterialReservationStatus.java
14:54:21.269 INFO - 240/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\model\strategy\AbstractTicketChangeRequestStatusStrategy.java
14:54:31.299 INFO - 321/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\permission\ApplicationModuleStrategyCourse.java
14:54:36.119 ERROR - Class not found: org.slf4j.Logger
14:54:41.320 INFO - 455/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\web\action\ActionInitSaveCorrectiveMaintenance.java
14:54:51.324 INFO - 541/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\web\action\ActionListProvider.java
14:55:01.370 INFO - 614/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\web\action\ActionSearch.java
14:55:11.395 INFO - 674/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\web\dwr\MessageManager.java
14:55:21.398 INFO - 748/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\web\service\model\xstream\WsPackageTrackingMainData.java
14:55:23.288 ERROR - Class not found: javax.el.ELContext
14:55:23.650 ERROR - Class not found: javax.el.ELContext
14:55:23.781 ERROR - Class not found: javax.el.ELContext
14:55:23.890 ERROR - Class not found: javax.el.ELContext
14:55:24.429 ERROR - Class not found: javax.el.ELContext
14:55:24.531 ERROR - Class not found: javax.el.ELContext
14:55:24.657 ERROR - Class not found: javax.el.ELContext
14:55:24.757 ERROR - Class not found: javax.el.ELContext
14:55:24.877 ERROR - Class not found: javax.el.ELContext
14:55:24.982 ERROR - Class not found: javax.el.ELContext
14:55:25.102 ERROR - Class not found: javax.el.ELContext
14:55:25.212 ERROR - Class not found: javax.el.ELContext
14:55:25.332 ERROR - Class not found: javax.el.ELContext
14:55:25.437 ERROR - Class not found: javax.el.ELContext
14:55:25.537 ERROR - Class not found: javax.el.ELContext
14:55:25.639 ERROR - Class not found: javax.el.ELContext
14:55:25.731 ERROR - Class not found: javax.el.ELContext
14:55:25.931 ERROR - Class not found: javax.el.ELContext
14:55:26.022 ERROR - Class not found: javax.el.ELContext
14:55:26.127 ERROR - Class not found: javax.el.ELContext
14:55:26.295 ERROR - Class not found: javax.el.ELContext
14:55:26.398 ERROR - Class not found: javax.el.ELContext
14:55:26.479 ERROR - Class not found: javax.el.ELContext
14:55:26.560 ERROR - Class not found: javax.el.ELContext
14:55:26.665 ERROR - Class not found: javax.el.ELContext
14:55:26.786 ERROR - Class not found: javax.el.ELContext
14:55:26.878 ERROR - Class not found: javax.el.ELContext
14:55:27.438 ERROR - Class not found: javax.el.ELContext
14:55:27.741 ERROR - Class not found: javax.el.ELContext
14:55:28.152 ERROR - Class not found: javax.el.ELContext
14:55:28.366 ERROR - Class not found: javax.el.ELContext
14:55:28.457 ERROR - Class not found: javax.el.ELContext
14:55:28.556 ERROR - Class not found: javax.el.ELContext
14:55:28.631 ERROR - Class not found: javax.el.ELContext
14:55:28.709 ERROR - Class not found: javax.el.ELContext
14:55:28.801 ERROR - Class not found: javax.el.ELContext
14:55:28.873 ERROR - Class not found: javax.el.ELContext
14:55:28.953 ERROR - Class not found: javax.el.ELContext
14:55:29.026 ERROR - Class not found: javax.el.ELContext
14:55:29.355 ERROR - Class not found: javax.el.ELContext
14:55:29.435 ERROR - Class not found: javax.el.ELContext
14:55:29.624 ERROR - Class not found: javax.el.ELContext
14:55:29.694 ERROR - Class not found: javax.el.ELContext
14:55:31.380 INFO - 848/946 files analyzed, current is D:\workspaces\workspace-fred\sgl\src\java\br\com\mindsatwork\sgl\web\taglib\display\export\ReportExcelHssfView.java
14:55:31.436 ERROR - Class not found: javax.el.ELContext
14:55:31.536 ERROR - Class not found: javax.el.ELContext
14:55:39.628 INFO - 946/946 source files analyzed
14:55:39.791 INFO - Java Main Files AST scan done: 108568 ms
14:55:39.880 INFO - Java bytecode scan...
14:55:41.734 INFO - Java bytecode scan done: 1854 ms
14:55:41.734 INFO - Java Test Files AST scan...
14:55:41.735 INFO - 13 source files to be analyzed
14:55:41.964 INFO - Java Test Files AST scan done: 230 ms
14:55:41.964 INFO - 13/13 source files analyzed
14:55:42.290 INFO - Package design analysis...
14:55:43.038 INFO - Package design analysis done: 748 ms
14:55:43.509 INFO - Sensor JavaSquidSensor done: 112421 ms
14:55:43.509 INFO - Sensor QProfileSensor...
14:55:43.512 INFO - Sensor QProfileSensor done: 3 ms
14:55:43.512 INFO - Sensor PmdSensor...
14:55:43.515 INFO - Execute PMD 5.1.1...
14:55:43.546 INFO - Java version: 1.7
14:55:43.593 INFO - PMD configuration: D:\workspaces\workspace-fred\.metadata\.plugins\org.eclipse.core.resources\.projects\sgl\org.sonar.ide.eclipse.core\pmd.xml
14:55:52.299 INFO - PMD configuration: D:\workspaces\workspace-fred\.metadata\.plugins\org.eclipse.core.resources\.projects\sgl\org.sonar.ide.eclipse.core\pmd-unit-tests.xml
14:55:52.300 INFO - Execute PMD 5.1.1 done: 8785 ms
14:55:52.328 INFO - Sensor PmdSensor done: 8816 ms
14:55:52.328 INFO - Sensor SurefireSensor...
14:55:52.330 INFO - parsing D:\workspaces\workspace-fred\.metadata\.plugins\org.eclipse.core.resources\.projects\sgl\org.sonar.ide.eclipse.core\build\surefire-reports
14:55:52.330 WARN - Reports path not found: D:\workspaces\workspace-fred\.metadata\.plugins\org.eclipse.core.resources\.projects\sgl\org.sonar.ide.eclipse.core\build\surefire-reports
14:55:52.330 INFO - Sensor SurefireSensor done: 2 ms
14:55:52.330 INFO - Sensor InitialOpenIssuesSensor...
14:55:52.373 INFO - Sensor InitialOpenIssuesSensor done: 43 ms
14:55:52.374 INFO - Sensor ProfileEventsSensor...
14:55:52.396 INFO - Sensor ProfileEventsSensor done: 22 ms
14:55:52.396 INFO - Sensor ProjectLinksSensor...
14:55:52.409 INFO - Sensor ProjectLinksSensor done: 13 ms
14:55:52.410 INFO - Sensor FindbugsSensor...
14:55:52.412 INFO - Execute Findbugs 2.0.3...
14:55:53.888 INFO - Findbugs output report: D:\workspaces\workspace-fred\.metadata\.plugins\org.eclipse.core.resources\.projects\sgl\org.sonar.ide.eclipse.core\findbugs-result.xml
Exception in thread "main" org.sonar.runner.impl.RunnerException: Unable to execute Sonar
at org.sonar.runner.impl.BatchLauncher$1.delegateExecution(BatchLauncher.java:91)
at org.sonar.runner.impl.BatchLauncher$1.run(BatchLauncher.java:75)
at java.security.AccessController.doPrivileged(Native Method)
at org.sonar.runner.impl.BatchLauncher.doExecute(BatchLauncher.java:69)
at org.sonar.runner.impl.BatchLauncher.execute(BatchLauncher.java:50)
at org.sonar.runner.impl.BatchLauncherMain.execute(BatchLauncherMain.java:41)
at org.sonar.runner.impl.BatchLauncherMain.main(BatchLauncherMain.java:59)
Caused by: org.sonar.api.utils.SonarException: Can not execute Findbugs
at org.sonar.plugins.findbugs.FindbugsExecutor.execute(FindbugsExecutor.java:154)
at org.sonar.plugins.findbugs.FindbugsSensor.analyse(FindbugsSensor.java:59)
at org.sonar.batch.phases.SensorsExecutor.executeSensor(SensorsExecutor.java:79)
at org.sonar.batch.phases.SensorsExecutor.execute(SensorsExecutor.java:70)
at org.sonar.batch.phases.PhaseExecutor.execute(PhaseExecutor.java:131)
at org.sonar.batch.scan.ModuleScanContainer.doAfterStart(ModuleScanContainer.java:178)
at org.sonar.api.platform.ComponentContainer.startComponents(ComponentContainer.java:92)
at org.sonar.api.platform.ComponentContainer.execute(ComponentContainer.java:77)
at org.sonar.batch.scan.ProjectScanContainer.scan(ProjectScanContainer.java:199)
at org.sonar.batch.scan.ProjectScanContainer.scanRecursively(ProjectScanContainer.java:194)
at org.sonar.batch.scan.ProjectScanContainer.doAfterStart(ProjectScanContainer.java:187)
at org.sonar.api.platform.ComponentContainer.startComponents(ComponentContainer.java:92)
at org.sonar.api.platform.ComponentContainer.execute(ComponentContainer.java:77)
at org.sonar.batch.scan.ScanTask.scan(ScanTask.java:56)
at org.sonar.batch.scan.ScanTask.execute(ScanTask.java:44)
at org.sonar.batch.bootstrap.TaskContainer.doAfterStart(TaskContainer.java:82)
at org.sonar.api.platform.ComponentContainer.startComponents(ComponentContainer.java:92)
at org.sonar.api.platform.ComponentContainer.execute(ComponentContainer.java:77)
at org.sonar.batch.bootstrap.BootstrapContainer.executeTask(BootstrapContainer.java:175)
at org.sonar.batch.bootstrap.BootstrapContainer.doAfterStart(BootstrapContainer.java:163)
at org.sonar.api.platform.ComponentContainer.startComponents(ComponentContainer.java:92)
at org.sonar.api.platform.ComponentContainer.execute(ComponentContainer.java:77)
at org.sonar.batch.bootstrapper.Batch.startBatch(Batch.java:92)
at org.sonar.batch.bootstrapper.Batch.execute(Batch.java:74)
at org.sonar.runner.batch.IsolatedLauncher.execute(IsolatedLauncher.java:45)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.sonar.runner.impl.BatchLauncher$1.delegateExecution(BatchLauncher.java:87)
... 6 more
Caused by: java.util.concurrent.ExecutionException: java.lang.ExceptionInInitializerError
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:206)
at org.sonar.plugins.findbugs.FindbugsExecutor.execute(FindbugsExecutor.java:146)
... 35 more
Caused by: java.lang.ExceptionInInitializerError
at edu.umd.cs.findbugs.detect.SerializableIdiom.visit(SerializableIdiom.java:609)
at edu.umd.cs.findbugs.visitclass.BetterVisitor.visitField(BetterVisitor.java:286)
at org.apache.bcel.classfile.Field.accept(Field.java:92)
at edu.umd.cs.findbugs.visitclass.PreorderVisitor.doVisitField(PreorderVisitor.java:266)
at edu.umd.cs.findbugs.visitclass.PreorderVisitor.visitJavaClass(PreorderVisitor.java:349)
at org.apache.bcel.classfile.JavaClass.accept(JavaClass.java:214)
at edu.umd.cs.findbugs.detect.SerializableIdiom.visitClassContext(SerializableIdiom.java:133)
at edu.umd.cs.findbugs.DetectorToDetector2Adapter.visitClass(DetectorToDetector2Adapter.java:74)
at edu.umd.cs.findbugs.FindBugs2.analyzeApplication(FindBugs2.java:1209)
at edu.umd.cs.findbugs.FindBugs2.execute(FindBugs2.java:282)
at org.sonar.plugins.findbugs.FindbugsExecutor$FindbugsTask.call(FindbugsExecutor.java:201)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.bcel.classfile.ClassFormatException: Invalid byte tag in constant pool: 15
at org.apache.bcel.classfile.Constant.readConstant(Constant.java:147)
at org.apache.bcel.classfile.ConstantPool.<init>(ConstantPool.java:68)
at org.apache.bcel.classfile.ClassParser.readConstantPool(ClassParser.java:237)
at org.apache.bcel.classfile.ClassParser.parse(ClassParser.java:143)
at org.apache.bcel.util.SyntheticRepository.loadClass(SyntheticRepository.java:179)
at org.apache.bcel.util.SyntheticRepository.loadClass(SyntheticRepository.java:127)
at edu.umd.cs.findbugs.ba.AnalysisContext.lookupSystemClass(AnalysisContext.java:501)
at edu.umd.cs.findbugs.DeepSubtypeAnalysis.<clinit>(DeepSubtypeAnalysis.java:39)
... 15 more
C:\>
========================================================================
Hi
Find a link that report the same error on tomcat and tells that it only happens with JDK 7.
So I change de JDK version used by the Analyze (the project is compiled with JDK 7 64 bits)
I tried:
JDK 6 32 bits: no error (but a lot of warnings "java.lang.UnsupportedClassVersionError" as project is compiled to java 7)
JDK 7 32 bits: no error
JDK 7 64 bits: no error
JDK 8 64 bits: Caused by: org.apache.bcel.classfile.ClassFormatException: Invalid byte tag in constant pool: 15
It seems that Sonar only support JDK 8 on recent versions, since 4.3.
But my Sonar server is 4.3.2, so it should support....
OBS: If I compile the project with JDK 8 and then do an Anylize I receive a different error:
...
Caused by: java.lang.ArrayIndexOutOfBoundsException: 7352
at org.objectweb.asm.ClassReader.readClass(Unknown Source)
at org.objectweb.asm.ClassReader.accept(Unknown Source)
at edu.umd.cs.findbugs.asm.FBClassReader.accept(FBClassReader.java:44)
at org.objectweb.asm.ClassReader.accept(Unknown Source)
at edu.umd.cs.findbugs.classfile.engine.ClassParserUsingASM.parse(ClassParserUsingASM.java:110)
at edu.umd.cs.findbugs.classfile.engine.ClassParserUsingASM.parse(ClassParserUsingASM.java:587)
at edu.umd.cs.findbugs.classfile.engine.ClassInfoAnalysisEngine.analyze(ClassInfoAnalysisEngine.java:76)
at edu.umd.cs.findbugs.classfile.engine.ClassInfoAnalysisEngine.analyze(ClassInfoAnalysisEngine.java:38)
at edu.umd.cs.findbugs.classfile.impl.AnalysisCache.getClassAnalysis(AnalysisCache.java:268)
at edu.umd.cs.findbugs.ba.XFactory.getXClass(XFactory.java:652)
at edu.umd.cs.findbugs.ba.AnalysisContext.setAppClassList(AnalysisContext.java:932)
at edu.umd.cs.findbugs.FindBugs2.setAppClassList(FindBugs2.java:997)
at edu.umd.cs.findbugs.FindBugs2.execute(FindBugs2.java:225)
at org.sonar.plugins.findbugs.FindbugsExecutor$FindbugsTask.call(FindbugsExecutor.java:201)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
I had the exactly the same problem.
The issue was that our sonar server was working with java 7, while the eclipse sonarQube plugin was working with java 8.
(You can check that from Help->About Eclipse -> Installation Details -> Configuration tab)
I managed to solve the issue by adding bellow to the eclipse.ini file (located under the eclipse installation library.
-vm
C:\Program Files (x86)\Java\jdk1.7.0_72\bin\javaw.exe
(this should come above -vmargs)