本文主要讲解如何编译安装配置 Hadoop2.x eclipse plugin插件的详细过程: 环境参数 编译过程 安装配置 [一]、环境参数 Eclipse Juno Service Release 2 Hadoop2.2.0 Java 1.6.0_65 Mac OXS 10.9.2 [二]、编译过程 目前Hadoop2.x的插件源码托管在github上,
本文主要讲解如何编译安装配置 H
adoop2.x eclipse plugin插件的详细过程:
- 环境参数
- 编译过程
- 安装配置
[一]、环境参数
- Eclipse Juno Service Release 2
- Hadoop2.2.0
- Java 1.6.0_65
- Mac OXS 10.9.2
[二]、编译过程目前Hadoop2.x的插件源码托管在github上,第一步肯定是下载源码
git clone https://github.com/winghc/hadoop2x-eclipse-plugin.git
编译源码:
$cd src/contrib/eclipse-plugin$ant jar -Dversion=2.2.0 -Declipse.home=/Applications/eclipse -Dhadoop.home=/usr/local/share/hadoop
但是在我的机器上第一次编译时失败了,类似下面的错误信息:
............[javac] Compiling 45 source files to /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/classes [javac] /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/src/contrib/eclipse-plugin/src/java/org/apache/hadoop/eclipse/MapReduceNature.java:35: package org.eclipse.jdt.core does not exist [javac] import org.eclipse.jdt.core.IClasspathEntry; [javac] ^ [javac] /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/src/contrib/eclipse-plugin/src/java/org/apache/hadoop/eclipse/MapReduceNature.java:36: package org.eclipse.jdt.core does not exist [javac] import org.eclipse.jdt.core.IJavaProject; [javac] ^..............
初步判断估计是我的eclipse中没有 org.eclipse.jdt.core*
相关lib包,无法找到类引起的,后来去我的本机目录?/Applications/eclipse/plugins/
下查看发现确实没有类似的lib包,证明了之前的判断。只好从其他同事电脑上找到一个 org.eclipse.jdt.core_3.7.3.v20120119-1537.jar
?copy到插件的源码目录 ?src/contrib/eclipse-plugin/lib
下,同时需要修改?src/contrib/eclipse-plugin/build.xml
文件,增加两处修改具体如下:
<!---ecms -ecms ex-jar 是需要增加的配置 micmiu.com--> ...... <!---ecms -ecms Override classpath to include Eclipse SDK jars --> <!---ecms -ecms pathelement location="${hadoop.root}/build/classes"/--> <!---ecms -ecms 需要增加的配置 micmiu.com--> ......
然后再执行编译命令,看到?BUILD SUCCESSFUL 表示编译成功:
micmiu-mbp:eclipse-plugin micmiu$ ant jar -Dversion=2.2.0 -Declipse.home=/Applications/eclipse -Dhadoop.home=/usr/local/share/hadoopBuildfile: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/src/contrib/eclipse-plugin/build.xmlcheck-contrib:init: [echo] contrib: eclipse-plugininit-contrib:ivy-download: [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.1.0/ivy-2.1.0.jar [get] To: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/ivy/ivy-2.1.0.jar [get] Not modified - so not downloadedivy-probe-antlib:ivy-init-antlib:ivy-init:[ivy:configure] :: Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ ::[ivy:configure] :: loading settings :: file = /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/ivy/ivysettings.xmlivy-resolve-common:ivy-retrieve-common:[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead[ivy:cachepath] :: loading settings :: file = /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/ivy/ivysettings.xmlcompile: [echo] contrib: eclipse-plugin ...... [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. [javac] 7 warningsjar: [mkdir] Created dir: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/lib [copy] Copying 9 files to /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/lib ...... [jar] Building jar: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/hadoop-eclipse-plugin-2.2.0.jarBUILD SUCCESSFULTotal time: 37 secondsmicmiu-mbp:eclipse-plugin m
编译成功后可以在?build/contrib/eclipse-plugin/hadoop-eclipse-plugin-2.2.0.jar 找到生成的jar包。下载地址:http://yun.baidu.com/s/1o6K457c#dir/path=%2Fsourcecode%2Fbuilder[三]、安装配置1、复制生成的 hadoop-eclipse-plugin-2.2.0.jar 到 eclipse/plugins 路径下,重启eclipse即可。2、在eclipse菜单依次点击 ?windows →?show view →?other… ,选择“Show View”对话框打开,搜索框输入“map”,会找到项“Map/Reduce Locations”,点击“确定”按钮:3、控制台会多出一个“Map/Reduce Locations”的Tab页:4、在“Map/Reduce Locations” Tab页 点击图标 ? 或者在空白的地方右键,选择“New Hadoop location…”,弹出对话框“New hadoop location…”,配置如下内容:
- Location name :随便取个名字 比如 hadoop2.2.0
- Map/Reduce(V2) Master :根据
hdfs-site.xml
中配置dfs.datanode.ipc.address的值填写 - DFS Master: Name Node的IP和端口,根据
core-site.xml
中配置fs.defaultFS的值填写
配置成功后可以看到类似如下信息:5、打开“preferences”对话框,搜索“hadoop”,找到”Hadoop Map/Reduce”项,点击”Browse…” 配置hadoop的路径,比如我的路径是 /usr/local/share/hadoop-2.2.0
—————– ?EOF?@Michael Sun?—————–