I'm trying to create tables in hive in cloudera quickstartvm 5.5, but it says "Logging intializing" and takes long time, even after long time it doesn't create tables in hive, also cannot import tables to hive.. I have seen lot of questions in stackoverflow on the same issue, but can't find answer. If someone know or got answer for this please share the info. Thanks in advance..
I tried the below from Cloudera community blog
After restarting Hive Service, I tried creating table using Hue worked.. After that create tables in hive started working.. Not sure about the magic behind..
I was new to Cloudera VM and did the following steps. Stopped Hue followed by Hive and started Hive & Hue. One extra thing which I did is to follow the quick start steps in Hue which installed couple of sample tables/databases in Hive. Hope this helps for others who are new to Cloudera VM and facing the same issue.
Related
I am trying to connect Grafana and create a dashboard from data present in Hive tables.
Not sure if this is possible, hence seeking SO community's help.
If there are any other open source suggestions for dashboard creation from Hive, would also help.
I have a hive table lets say it as table A. My requirement is to capture all the DML and DDL operations on table A in table B. Is there any way to capture the same?
Thanks in advance..
I have not come across any such tool however Cloudera Navigator helps to manage it. Refer the detailed documentation.
Cloudera Navigator
Cloudera Navigator auditing supports tracking access to:
HDFS entities accessed by HDFS, Hive, HBase, Impala, and Solr
services
HBase and Impala
Hive metadata
Sentry
Solr
Cloudera Navigator Metadata Server
Alternatively, if you are not using cloudera distribution, you can still access hive-metastore log file under /var/log/hive/hadoop-cmf-hive-HIVEMETASTORE.log.out and check the changes applied to the different table.
I haven't used Apache atlas yet, but from the documentation, it looks like they have Audit store and hive bridge. That works for operational events as well.
https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.1/atlas-overview/content/apache_atlas_features.html
I am running Cloudera 5.15, with Kerboros enabled on the cluster. Sentry is installed to configure user access to various tables/databases ...etc.
Everything is installed and working fine for Hive, but not for Impala.
I'm using Hue web UI for issuing hive/impala queries. (I'm getting same results using beeline and impala-shell though)
From Hue/Hive:
show current roles;
return --> "professors_role"
From Hue/Impala
show current roles;
return --> no results
When I issue "select current_user()" from hive and impala query editors I'm getting different results.
From hive "select current_user()" returns "hive"
from impala "select current_user()" returns "professor1"
I'm thinking perhaps this is the kulprit, but i'm not sure how to fix? Maybe I've missed a configuration setting in impala somewhere?
Everything works fine in hive - logging in as different users shows me different databases and tables as I would expect based on their assigned roles. Users logged into Impala can't see anything.
Any help is greatly appreciated.
Thanks
I've had this problem, but I fix it now.
You can check which machine you install the impala statestore, and you must have the same impala user/group on the linux system.
I restarted by hadoop dfs and yarn processes and now hive doesn't see any tables.
However, if I look in hdfs /user/hive, I see the tables there.
Hive's show tables, however shows no tables.
Any suggestions?
Hive needs to be started in the same directory.
I have Oracle Big Data. I have created a table in HIVE. I am able to view the data through HUE in HIVE. But when I am trying to browse to that file I am getting error related HDFS Super User.
Please assist.
Make sure that WebHdfs is configured properly.