Hive / Hadoop: Monitor the running processes [closed] - apache

Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
Is there anyway to monitor running Hive processes and ensure that they are indeed working in parallel?
I have setup an experimental Linux cluster (4 machines) and would like to understand the underlying processes.
top and ps don't give me too much info.

Hive query is divided into several MR called sql_text-stage 1, sql_text-stage-2 etc.
You can enter UI of your cluster's JobTracker web UI on
job_tracker_adress:50030
There you will see hive jobs and their progress.
For each job there will be list of tasks and for each task you can see on which nodes they are running, and their basic statistics

Related

Ruby high CPU Usage Even using ELB with 2 M3.large type Instance in AWS why? [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 5 years ago.
Improve this question
I am using EC2 servers (with 2 instances m3.large type in Elastic Load Balancer) with Ruby on Rails3 installed for API calls and Database RDS(Mysql), I created an alarm in AWS for my instance CPU Utilization greater than 80%.
I am getting High CPU Utilization issue by mail since one week, and many of my app users are not even log in or signup that time due to this issue.
I used top command to find out the process, where I found the Ruby command is responsible for 100% CPU usage, below is the detail of top command -
user ec2-user %CPU 100 Command ruby
please help me how it can be solved.

Does SQL Server allow Multi table clustering? [closed]

Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 7 years ago.
Improve this question
My question is simple.
Does SQL Server allow Multi table clustering?
No - SQL Server has the concept of clusters in which two or instances of SQL Server (the program) is running (or is available to run) and if one fails the other instance can very rapidly take over. They work on the same data which is stored in a shared drive. But only one is active at a time.

Administer multiple SQL servers - possibilites [closed]

Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 9 years ago.
Improve this question
I want to be able to run queries against multiple SQL servers.
How this can be done?
Thanks
The closest that you will come is Multi Server Administration.
http://msdn.microsoft.com/en-us/library/aa213819(v=sql.80).aspx
http://msdn.microsoft.com/en-us/library/ms191305.aspx
This will allow you to schedule jobs, which can run queries against multiple servers.
Another concept that might apply is Federated Servers. This allows you to split data between servers and balance the work load.
http://msdn.microsoft.com/en-us/library/ms187075(v=sql.105).aspx
SQL introduced a new feature call "Central Management Servers (CMS)" which allows you to administer multiple servers.
For more details, please check this out
http://www.mssqltips.com/sqlservertip/1767/execute-sql-server-query-on-multiple-servers-at-the-same-time/

No Jobs Ran in the Last 12 Hours? [closed]

Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
I noticed that none of my jobs on my server ran in the last 12 hours. SQL Server Agent is online, but I have had to "reset" all of my job scheduels (go in change it to something new and then change the schedule back to it's original settings) for the jobs to start running again. Has anyone ever had this problem before and know what causes it?
Server was down during the interval. Jobs are now running on schedule

Amazon Instance Network Out Spike (Attacked?) [closed]

Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 11 years ago.
Improve this question
I've been developing a website on a Micro EC2 Instance. This morning, it stopped responding and when I went to the AWS console, it showed that there had been a spike in Networking Out.
I don't have any traffic to speak of yet and I'm not scrapping in an automated fashion.
Does this mean that someone found my site and DOS attacked me or something along those lines?
Thanks
One of Amazon's datacenters suffered an outage today and it is affecting several large companies.
Please check http://status.aws.amazon.com/ for more information. It's possible that you are being affected by this.
http://status.aws.amazon.com/
Also, this question doesn't belong on StackOverflow.