I am new in HortonWorks and Ambari, I was watching some tutorials and in that tutorials I see the Views -> Hive Views, but my installation only has Yarn Queue Manager, Files View and Workflow Manager.
I am using Admin user (in user setting says "This is user is an Ambari Admin and has all privileges".
Please could you advise if I need to configure some else to see all options?
#West14 depending on the version of Ambari you will not see a Hive View. The Hive View is HDP2. The Hive View is no longer part of HDP3.
An alternative to Hive View for HDP3 is Hue.
Related
I am not able to view the spark-ui for databricks jobs executed through notebook activity in Azure datafactory.
Does anyone know which permissions needs to be added to enable the same?
--Update
Ensure you have Cluster-level permissions on PROD env
Job permissions
There are five permission levels for jobs: No Permissions, Can View,
Can Manage Run, Is Owner, and Can Manage. Admins are granted the Can
Manage permission by default, and they can assign that permission to
non-admin users.
Next...
Am able to view the completed jobs in the Spark UI without any additional setup.
It maybe that the stuff you are doing in the Notebook, does not constitute for a Spark Job.
Refer: Web UI and Monitoring and Instrumentation for more details.
Checkout Spark Glossary
Note: Job A parallel computation consisting of multiple tasks that gets spawned in response to a Spark action (e.g. save, collect);
you'll see this term used in the driver's logs.
View cluster information in the Apache Spark UI
You can get details about active and terminated clusters. If you
restart a terminated cluster, the Spark UI displays information for
the restarted cluster, not the historical information for the
terminated cluster.
So, If I run a notebook with a task to simply display my mounts or with a task that failed or exception, it is not listed in Spark UI.
#job/83 is not seen
Ambari shows me an alert message:
"Ranger Admin password check
User:admin credentials on Ambari UI are not in sync with Ranger"
How I can resolve this ? What should I need to do.
I have tried to set the same password for (amb_ranger_admin, admin, etc) but it didn't help.
My version of Ambari is 2.7.1
HDP 3.0.1
This topic seems to have been discussed here: https://community.hortonworks.com/answers/221995/view.html
To summarize, the key steps are:
Set the password first in ranger and then in ambari
Check if the passwords are the same
If they are not the same? : Analyze which one (likely Ambari) is not updating the config
If they are the same? : Analyze why you still get the warning
I am trying to install and setup MobileFirst. SO i was able to install WAS ND, create a server, Install Mobilefirst Server, Install database, Create database and now i am trying to create a runtime with the configuration tool.
Below is the Database screenshot which proves that the database exist
This is a screenshot of the creating admin configuration and also it show that the port number is ok
This is a screen shot of the database additional extra setting which is checking for the database WLADM70 which i have given, validation happened without problem but its always in the checking for the database state.
Background:
By default the Sentry service has the users hive, hue and impala as the sentry admins. This is w.r.t to the property on Cloudera Manager (CM) sentry.service.admin.group. I want to add a user or group which has my user account, so that I can become the Sentry admin.
Current environment:
Cloudera 5.4.7 with CM
Postgres databases for CDH, Hive and Sentry
Sentry version 1.4
Question:
I have integrated OpenLDAP so that Beeline authentication can be done through LDAP user and password credentials. Before LDAP integration to HiveServer2, I used root as the Sentry admin, (Beeline does not strictly check for password without LDAP) so I could execute commands like show roles; and create roles; as root.
Now with LDAP integrated I cannot login as root, since it does not have an entry on the LDAP server and adding it there is not an option, so I want to add a user called johndoe as the admin for Sentry so that he can create roles like how root did.
Is this something that I need to set at a Postgres level? I mean by entering the Sentry database and GRANT'ing some privilege there?
What have I tried so far:
I have tried all combinations of using local users in the property sentry.service.admin.group, adding local users to the hive group, using LDAP users, LDAP groups - Nothing !
I don't understand where it is going wrong. Or is it that Sentry only identifies hive, hue and impala as the admins.
Any help would be greatly appreciated. Stuck on this for ten days now.
You need to use the Unix group to which the Unix-User you are using belongs. Sentry can only use the Unix group, which in the case of Hive, Hue and Impala in the default configuration is hive, hue and impala.
Sentry cannot use LDAP groups. You need to use Unix groups in the setting sentry.service.admin.group.
I have cluster with cloudera installed on it with all services running. I have to make one configuration change for hive(used in hive-site.xml). I have changed into machine where hive is installed.
/etc/hive/conf/hive-site.xml
I did changes in machine where hive is installed and changes gets reflected and gettign desired results.But after restarting cluster changes are getting overridden.
Please let me know what should i do here.
You should not hand edit the client hive-site.xml if your cluster is being managed by Cloudera Manager. Instead, there is a configuration you can make in Cloudera Manager that will handle the edits for you.
In Cloudera Manager go to Hive > Configuration > Service-Wide > Advanced.
Add or overrride configurations in Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml (your name may be different depending on your CM version).
Click Save Changes button.
Click Actions button and click Deploy Client Configuration. This will update hive-site.xml across all of your cluster hosts.