if I use following load command
A = LOAD '/home/mapr/resoucr' using PigStorage(',');
It throws following error:
org.apache.hadoop.conf.Configuration.deprecation - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
These are the deprecation warnings. Possibly you are lacking in newer hadoop configuration.
To get rid of this, you need to update your hadoop configuration files.
Related
After removing JndiLookupClass from the classpath under $HIVE_HOME/lib/log4j-core-2.6.2.jar we are getting multiple warnings when we open hive cli and also while running the queries.
PFA error lines.
2021-12-17 18:47:32,880 main WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassNotFoundException: org.apache.logging.log4j.core.lookup.JndiLookup
We have tried commenting the line #appenders = console, DRFA in log4j2.properties file present under $HIVE_HOME/conf but still the issue is persisting.
There are no updates in the official documentation of hive.
Can someone help with the fix.
Is there any way to suppress the warning messages as it is hampering the output.
I got this error:
Error CREATEing SolrCore 'my': Unable to create core [my] Caused by: Input length = 1
I don't have any idea about this error. I am using solr 6.2.1.
I made the collection folder, added solrconfig, schema, data-config file in conf folder, it first gave me an error to add lang/stopwords_it.txt, and after that it showed this error. Please help. I am new to solr.
Under Unix, you could create a new solr core with the following bash-script:
https://github.com/patrick0585/Solr-Core-Creator
./solr_core_creator.sh --core --conf --lib
New to logstash and following the tutorial posted https://www.elastic.co/guide/en/logstash/current/advanced-pipeline.html
Trying to set up my first-pipeline.conf where in i need to specify the input , filter and the output configurations
When i specify these configurations , and try
logsstash -f first-pipeline.conf -configtest i get a RuntimeError
RuntimeError : translation missing : en.logstash.runner.configuration.file-not-found>, class=> RuntimeError : backtrace => ["C:/ELK/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lob/logstash/config/loader/rb:58 in 'local_config" and bunch of other stack trace
Here below is the snip of stack trace
looks like im missing some files in my logstash installation direcotory..
BTW here is what my first-pipeline.conf file looks like
Also , i commented out the filter portion of my first-pipeline.conf as was not sure if grok was causing this issue and still the same error is reproducible
The error "io/console not supported; tty will not be manipulated" seems a jruby bug:
https://github.com/jruby/jruby/issues/3550
And It seems to be fixed on version 1.7.24. In Logstash 2.3.2 jruby version is 1.7.23 that the bug opened for. So you can try to download jruby 1.7.25 and replace it with the one under vendor/jruby.
For the other error, you are running Logstast from bin folder. Is your configuration (first-pipeline.conf) file actually in that folder? If not specify it from where it is.
I'm trying to upgrade the sensu-puppet module and im getting an error when i run puppet now: the error is:
Error: Could not retrieve catalog from remote server: Error 400 on
SERVER: Invalid parameter prefetch on Sensurabbitmqconfig[<(hostname
is here, removed for this post on ask puppet)>] at
/etc/puppet/environments/staging/modules/sensu/manifests/rabbitmq/config.pp:123
Warning: Not using cache on failed catalog Error: Could not retrieve
catalog; skipping run
I have no idea what's going wrong or how to fix it. I looked in the pathway at the rabbitmq config and found this:
prefetch => $sensu::rabbitmq_prefetch
But I'm not sure what the issue is. Anyone know what might be causing this?
Where did you get the puppet module and what way?
Did you use puppet module install or a git pull?
Make sure sure that the parameter you want to use is in
modules/sensu/lib/puppet/provider/sensu_rabbitmq_config/json.rb
and also
modules/sensu/lib/puppet/type/sensu_rabbitmq_config.rb
I am trying to use a library from Piggybank and it's giving me some errors.
This is my code:
REGISTER /usr/lib/pig/piggybank.jar;
DEFINE CSVExcelStorage org.apache.pig.piggybank.storage.CSVExcelStorage;
a = LOAD 'csvtest/' USING CSVExcelStorage()
And the errors:
2015-09-15 00:18:15,480 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 101: file '/usr/lib/pig/piggybank.jar' does not exist.
I followed the instructions from this guide, PiggyBank, and already built the project.
Should I move piggybank.jar to /usr/lib/pig/piggybank.jar?
Thanks.
REGISTER <path of piggybank jar>;
You need you specify the path of the jar in your local system where you have extracted the pig.
For example this the path for me:
/Users/username/pig-0.13.0/lib/piggybank.jar
Had similar trouble where I used: REGISTER 'hdfs:///usr/lib/pig/piggybank.jar'