돼지와 하둡 연결 오류

Question

나는 맵리 듀스 모드에서 돼지를 실행하고 때 이 오류를 ConnectionRefused 얻고있다.

Details :
나는 tarball (pig-0.14)에서 Pig를 설치하고 bashrc에서 classpath를 내 보냈다.
모든 Hadoop (hadoop-2.5) 데몬이 설치되어 실행 중입니다 (JPS가 확인).

[root@localhost sbin]# jps 
2272 Jps 
2130 DataNode 
2022 NameNode 
2073 SecondaryNameNode 
2238 NodeManager 
2190 ResourceManager 

나는 맵리 듀스 모드에서 돼지 실행하고 있습니다 :

[root@localhost sbin]# pig 
grunt> file = LOAD '/input/pig_input.csv' USING PigStorage(',') AS (col1,col2,col3); 
grunt> dump file; 

을 그리고 나는 오류가 점점 오전 : 나는 돼지 tarball.Do의 모든 설정 파일을 구성하지 않은

java.io.IOException: java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused 
    at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) 
    at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) 
    at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532) 
    at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:183) 
    at org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.getTaskReports(HadoopShims.java:231) 
    at org.apache.pig.tools.pigstats.mapreduce.MRJobStats.addMapReduceStatistics(MRJobStats.java:352) 
    at org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil.addSuccessJobStats(MRPigStatsUtil.java:233) 
    at org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil.accumulateStats(MRPigStatsUtil.java:165) 
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:360) 
    at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:280) 
    at org.apache.pig.PigServer.launchPlan(PigServer.java:1390) 
    at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375) 
    at org.apache.pig.PigServer.storeEx(PigServer.java:1034) 
    at org.apache.pig.PigServer.store(PigServer.java:997) 
    at org.apache.pig.PigServer.openIterator(PigServer.java:910) 
    at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:746) 
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372) 
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230) 
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205) 
    at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66) 
    at org.apache.pig.Main.run(Main.java:558) 
    at org.apache.pig.Main.main(Main.java:170) 
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
    at java.lang.reflect.Method.invoke(Method.java:483) 
    at org.apache.hadoop.util.RunJar.main(RunJar.java:212) 
Caused by: java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused 
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) 
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 
    at java.lang.reflect.Constructor.newInstance(Constructor.java:408) 
    at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783) 
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730) 
    at org.apache.hadoop.ipc.Client.call(Client.java:1415) 
    at org.apache.hadoop.ipc.Client.call(Client.java:1364) 
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) 
    at com.sun.proxy.$Proxy15.getJobReport(Unknown Source) 
    at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getJobReport(MRClientProtocolPBClientImpl.java:133) 
    at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
    at java.lang.reflect.Method.invoke(Method.java:483) 
    at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:320) 
    ... 26 more 
Caused by: java.net.ConnectException: Connection refused 
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) 
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712) 
    at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) 
    at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) 
    at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) 
    at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:606) 
    at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:700) 
    at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:367) 
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:1463) 
    at org.apache.hadoop.ipc.Client.call(Client.java:1382) 
    ... 34 more 

을 내가 hadoop 설치를 식별하기 위해 돼지 구성을 변경해야합니까? bashrc에서 HADOOP_HOME이 올바르게 설정되었습니다.
도와주세요.

Answer 1

는이를 시작 하둡의의 sbin 디렉토리로 이동 한 후 등 hdfs-site.xml 같은 하둡의 설정 파일이있는 디렉토리가 명령

mr-jobhistory-server.sh start historyserver --config $HADOOP_CONF_DIR 

$HADOOP_CONF_DIR을 입력합니다. (2017 년 기준)

Answer 2

해결책을 찾았습니다.
라인 : JobHistoryServer가없는 경우

Caused by: java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused 

가 제공됩니다.
JobHistoryServer을 시작하면이 문제가 해결됩니다.
다음 명령을 시작할 하둡의 sbin 디렉토리로 이동합니다 :

mr-jobhistory-server.sh start 

은 돼지 명령을-실행 다시 다음 JobHistoryServer가 인 경우 jps 확인을 수행합니다.

Answer 3

업데이트 된 명령 :

./mr-jobhistory-daemon.sh --config $HADOOP_CONF_DIR start historyserver 

체크

jps