I try to configure hadoop 2.3.0 on windows but its give me
Error: Could not find or load main class org.apache.hadoop.hdfs.tools.GetConf
and lots of other error like "winutils.exe","hadoop.dll messing" and "load main class" error.
Please help me to configure Hadoop on windows 8 machine.
I have installed
JDK 1.7
cygwin64
If we directly take the binary distribution of Apache Hadoop 2.3 release and try to run it on Microsoft Windows, then we'll encounter ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path.
The binary distribution of Apache Hadoop 2.3 release does not contain some windows native components (like winutils.exe, hadoop.dll etc). These are required (not optional) to run Hadoop on Windows.
So you need to build windows native binary distribution of hadoop from source codes following "BUILD.txt" file located inside the source distribution of hadoop. You can follow the following posts (applicable for hadoop 2.3 as well) for step by step guide with screen shot
Build, Install, Configure and Run Apache Hadoop 2.2.0 in Microsoft Windows OS
ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path
Follow the steps described in the below link which describes the installation of Hadoop 2.3.0 in a windows 8 machine.
http://www.srccodes.com/p/article/38/build-install-configure-run-apache-hadoop-2.2.0-microsoft-windows-os
This works perfectly.
Thanks
Installing in windows:
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0-Win/bk_installing_hdp_for_windows/content/win-chap2-singlenode.html
Prerrequisites:
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0-Win/bk_installing_hdp_for_windows/content/win-getting-ready-2-3-2.HTML
In the suggested tutorial above, the build instructions do not work for the most recent version of visual studio/.NET framework/Windows.
http://www.srccodes.com/p/article/38/build-install-configure-run-apache-hadoop-2.2.0-microsoft-windows-os
First download the desired source version and ...
You do not need the windows 7 sdk/build will fail to create the binary. For windows 8, you can build the hadoop-2.5.2-src\hadoop-common-project\hadoop-common\src\main\winutils solution and C:\hfds\hadoop-2.5.2-src\hadoop-common-project\hadoop-common\src\main\native solutions in visual studio
Then download the binary version...
and place the output files in hadoop-2.5.2-src\hadoop-common-project\hadoop-common\target\bin in the bin directory of the downloaded hadoop binary bin folder.
Then follow the remaining steps of the tutorial...
Related
I tried to install rubyrep following their instructions on their website and the the files are not running for installation. I have the latest JVM and on Windows 7. The application I am using is using POSTGRE 9.3.
I was running the batch file generated from the folder rubyrep.bat or is there a way to run the installation ?
Can someone guide me or give me tip on troubleshooting this problem even though the installation is straight forward?
From the command line change into the directory where you have extracted the rubyrep zip file. You then just run rubyrep NOT rubyrep.bat as shown in the picture below.
I seem to have some problems initialising the CloudBees SDK locally to be able to run a simple application.
I've downloaded the SDK, added the required paths; everything ok up to the point where I am trying to execute the bees run command from my newly created application folder.
The error I get seems related to the JDK installation on my computer - JAVA_HOME is pointing to C:\Program Files\Java\jre7 and not to jdk .
I've checked all the local PATHS and they seem ok.
By the way I am using Windows 8.0 Enterprise 64 bit.
Fully uninstalling Java from my system followed by installing only the 64bit version and recreating System paths seems to have fixed the problem.
Am using
Apache Hadoop 1.0.4
JDK 1.7
CentOS 5.6
When I install Hadoop Cluster with 2-nodes, it runs fine. I am able to see the status through http://:50070 and http://:50030. However when I build the Hadoop native libraries from source, the cluster continues to work fine, but the monitoring app (Jetty) goes for a toss. The above links dont work.
I compile the native libraries after Hadoop installation (which is basically tar -zxvf). The namenode is already formatted before the compilation, but the cluster is not brought up until native libraries are compiled. Any ideas, how to troubleshoot this? Am using simple ant -Dcompile.native=true compile-native command to build native libraries.
I have installed the standalone IDE for salesforce force.com platform. On trying to start the ide i am getting "JVM terminated. Exit Code=-1" error. Any idea what this error code means ?
This is a common loading error for force.com IDE.
There are different solutions. Try anyone of these:
A) Change the workspace location.
OR
B) (i). Install Eclipse 3.6 for Java Developers (Helios) from the link http://www.eclipse.org/downloads/packages/eclipse-ide-java-developers/heliossr2
Click your operating system from the window on your right.
(ii). Using the below link, follow the instructions to install Force.com IDE plugin for Eclipse 3.6 http://wiki.developerforce.com/page/Force.com_IDE_Installation_for_Eclipse_3.6
OR
C) In the default Force.com IDE install directory:
C:\Program Files\salesforce.com\Force.com IDE
Locate the config file:
forceide
And comment out the following at the end of the file (note the leading #):
#-vmargs
#-Dfile.encoding=UTF-8
#-Xms256m
#-Xmx1024m
#-XX:PermSize=128M
#-XX:MaxPermSize=512M
I hope it works now.
Cheers!
This could be because of various reasons. Say, if you do not have enough memory (RAM) as specified in config file(forceide.ini). As said in this link Force.com IDE – JVM terminated , probably reduce MaxPermSize in config file to say 256M and check.
This exact thing happened to me a few days ago.
My setup is:
Windows 7 64 bit
jre7 64 bit
Force.com IDE 64 bit
When I ran the java auto update to update my jre it installed the 32 bit version (a whole other gripe). So I manually downloaded the 64 bit version of the jre installed it over the top of the 32 bit version and the IDE started working again.
I'm new to Linux but have to port a asp.net app to Linux platform. (CentOS 5.2)
I downloaded the mono source files and manually build them on my dev box, because there's no aviable Binary package for CentOS 5.2 (almost the same as RedHat), the app works well on the dev box.
The next step is to setup the production server, which has minimal libraries installed.
My question is... how to make the Mono binary files into a install package so I don't need to download and build them in the production server.
(My dev box is the same configuration as the production one)
I have tried to copy all mono related files into the server, but with no luck... May I missed some files or some settings...
You can still get binary RPMS here
EDIT:
Recently, Mono announced support for RHEL/CentOS. You can get packages from them here.