2012-09-11 2 views
0

Cloudera Manager가 설치되어 있고 노드 2 개가 마스터 노드에 연결되어 있습니다. https://ccp.cloudera.com/display/SUPPORT/Hadoop+Tutorial#HadoopTutorial-InputsandOutputsCloudera Manager 4.0 워드 카운트 예

클라우 데라 내가 명령 프롬프트에서 나노를 사용하여 만든 WordCount.java 파일을 컴파일 말한다 : 나는이 링크에서 클라우 데라에서 제공하는 튜토리얼을 사용하여 단어 수 프로그램을 실행하려합니다. 디렉토리에 Wordcount_Classes를 만들고 wordcount.java 파일을 거기에 넣습니다. 나는 그 디렉토리가 java 코드가 작동하도록 cloudera 디렉토리 중 하나에있는 곳으로 이동해야하는지 잘 모르겠다. 또는 내가 뭔가 다른 일을하고 있다면. 나는 Cloudera Manager를 설치했고 이미 모든 노드에 ClouderaHadoop을 자동으로 설치했습니다.

[email protected]*****:~/wordcount_classes$ javac WordCount.java 
WordCount.java:6: package org.apache.hadoop.fs does not exist 
import org.apache.hadoop.fs.Path; 
         ^
WordCount.java:7: package org.apache.hadoop.conf does not exist 
import org.apache.hadoop.conf.*; 
^ 
WordCount.java:8: package org.apache.hadoop.io does not exist 
import org.apache.hadoop.io.*; 
^ 
WordCount.java:9: package org.apache.hadoop.mapred does not exist 
import org.apache.hadoop.mapred.*; 
^ 
WordCount.java:10: package org.apache.hadoop.util does not exist 
import org.apache.hadoop.util.*; 
^ 
WordCount.java:14: cannot find symbol 
symbol : class MapReduceBase 
location: class org.myorg.WordCount 
    public static class Map extends MapReduceBase implements Mapper<LongWritable, Text, Text, IntWritable> { 
           ^
WordCount.java:14: cannot find symbol 
symbol : class Mapper 
location: class org.myorg.WordCount 
    public static class Map extends MapReduceBase implements Mapper<LongWritable, Text, Text, IntWritable> { 
                 ^
WordCount.java:14: cannot find symbol 
symbol : class LongWritable 
location: class org.myorg.WordCount 
    public static class Map extends MapReduceBase implements Mapper<LongWritable, Text, Text, IntWritable> { 
                   ^
WordCount.java:14: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount 
    public static class Map extends MapReduceBase implements Mapper<LongWritable, Text, Text, IntWritable> { 
                       ^
WordCount.java:14: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount 
    public static class Map extends MapReduceBase implements Mapper<LongWritable, Text, Text, IntWritable> { 
                        ^
WordCount.java:14: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount 
    public static class Map extends MapReduceBase implements Mapper<LongWritable, Text, Text, IntWritable> { 
                          ^
WordCount.java:14: interface expected here 
    public static class Map extends MapReduceBase implements Mapper<LongWritable, Text, Text, IntWritable> { 
                   ^
WordCount.java:15: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount.Map 
    private final static IntWritable one = new IntWritable(1); 
         ^
WordCount.java:16: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount.Map 
    private Text word = new Text(); 
      ^
WordCount.java:18: cannot find symbol 
symbol : class LongWritable 
location: class org.myorg.WordCount.Map 
    public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
        ^
WordCount.java:18: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount.Map 
    public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
            ^
WordCount.java:18: cannot find symbol 
symbol : class OutputCollector 
location: class org.myorg.WordCount.Map 
    public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
               ^
WordCount.java:18: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount.Map 
    public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
                   ^
WordCount.java:18: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount.Map 
    public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
                     ^
WordCount.java:18: cannot find symbol 
symbol : class Reporter 
location: class org.myorg.WordCount.Map 
    public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
                          ^
WordCount.java:28: cannot find symbol 
symbol : class MapReduceBase 
location: class org.myorg.WordCount 
    public static class Reduce extends MapReduceBase implements Reducer<Text, IntWritable, Text, IntWritable> { 
            ^
WordCount.java:28: cannot find symbol 
symbol : class Reducer 
location: class org.myorg.WordCount 
    public static class Reduce extends MapReduceBase implements Reducer<Text, IntWritable, Text, IntWritable> { 
                  ^
WordCount.java:28: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount 
    public static class Reduce extends MapReduceBase implements Reducer<Text, IntWritable, Text, IntWritable> { 
                    ^
WordCount.java:28: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount 
    public static class Reduce extends MapReduceBase implements Reducer<Text, IntWritable, Text, IntWritable> { 
                      ^
WordCount.java:28: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount 
    public static class Reduce extends MapReduceBase implements Reducer<Text, IntWritable, Text, IntWritable> { 
                         ^
WordCount.java:28: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount 
    public static class Reduce extends MapReduceBase implements Reducer<Text, IntWritable, Text, IntWritable> { 
                          ^
WordCount.java:28: interface expected here 
    public static class Reduce extends MapReduceBase implements Reducer<Text, IntWritable, Text, IntWritable> { 
                    ^
WordCount.java:29: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount.Reduce 
    public void reduce(Text key, Iterator<IntWritable> values, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
        ^
WordCount.java:29: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount.Reduce 
    public void reduce(Text key, Iterator<IntWritable> values, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
             ^
WordCount.java:29: cannot find symbol 
symbol : class OutputCollector 
location: class org.myorg.WordCount.Reduce 
    public void reduce(Text key, Iterator<IntWritable> values, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
                  ^
WordCount.java:29: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount.Reduce 
    public void reduce(Text key, Iterator<IntWritable> values, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
                      ^
WordCount.java:29: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount.Reduce 
    public void reduce(Text key, Iterator<IntWritable> values, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
                        ^
WordCount.java:29: cannot find symbol 
symbol : class Reporter 
location: class org.myorg.WordCount.Reduce 
    public void reduce(Text key, Iterator<IntWritable> values, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { 
                             ^
WordCount.java:15: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount.Map 
    private final static IntWritable one = new IntWritable(1); 
              ^
WordCount.java:16: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount.Map 
    private Text word = new Text(); 
          ^
WordCount.java:32: operator + cannot be applied to int,IntWritable.get 
     sum += values.next().get(); 
      ^
WordCount.java:32: inconvertible types 
found : <nulltype> 
required: int 
     sum += values.next().get(); 
           ^
WordCount.java:34: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount.Reduce 
     output.collect(key, new IntWritable(sum)); 
          ^
WordCount.java:39: cannot find symbol 
symbol : class JobConf 
location: class org.myorg.WordCount 
    JobConf conf = new JobConf(WordCount.class); 
    ^
WordCount.java:39: cannot find symbol 
symbol : class JobConf 
location: class org.myorg.WordCount 
    JobConf conf = new JobConf(WordCount.class); 
        ^
WordCount.java:42: cannot find symbol 
symbol : class Text 
location: class org.myorg.WordCount 
    conf.setOutputKeyClass(Text.class); 
         ^
WordCount.java:43: cannot find symbol 
symbol : class IntWritable 
location: class org.myorg.WordCount 
    conf.setOutputValueClass(IntWritable.class); 
          ^
WordCount.java:49: cannot find symbol 
symbol : class TextInputFormat 
location: class org.myorg.WordCount 
    conf.setInputFormat(TextInputFormat.class); 
         ^
WordCount.java:50: cannot find symbol 
symbol : class TextOutputFormat 
location: class org.myorg.WordCount 
    conf.setOutputFormat(TextOutputFormat.class); 
         ^
WordCount.java:52: cannot find symbol 
symbol : class Path 
location: class org.myorg.WordCount 
    FileInputFormat.setInputPaths(conf, new Path(args[0])); 
              ^
WordCount.java:52: cannot find symbol 
symbol : variable FileInputFormat 
location: class org.myorg.WordCount 
    FileInputFormat.setInputPaths(conf, new Path(args[0])); 
    ^
WordCount.java:53: cannot find symbol 
symbol : class Path 
location: class org.myorg.WordCount 
    FileOutputFormat.setOutputPath(conf, new Path(args[1])); 
              ^
WordCount.java:53: cannot find symbol 
symbol : variable FileOutputFormat 
location: class org.myorg.WordCount 
    FileOutputFormat.setOutputPath(conf, new Path(args[1])); 
    ^
WordCount.java:55: cannot find symbol 
symbol : variable JobClient 
location: class org.myorg.WordCount 
    JobClient.runJob(conf); 
    ^
49 errors 

은 누군가가 나를 단어 수 프로그램을 실행하거나 내가 무엇을해야하는지에 나를 안내 도와주세요 수 또는 누군가가 좋은 튜토리얼 온라인으로 알고 있다면 내가 찾을 수 없습니다 그 : 내 단말기에이 얻을? 감사!

+1

클래스 패스에 필요한 jar를 추가 했습니까? –

답변

2

javac의 클래스 경로에 의존성 (가져 오기 문에 해당)이 필요합니다. 하둡으로

이는 hadoop classpath 유틸리티를 통해 할 쉽게 : 클래스 경로가 제대로 설정 후

$ javac -classpath `hadoop classpath`:. WordCount.java 

당신은 cannot find symbol가지 어떤 컴파일 문제가 안된다.

+0

내가 연락 할 수있는 이메일 주소가 있습니까? – user1663321

+0

안녕하세요, 거친 [cloudera] [dot] com에서 저에게 연락하실 수 있습니다. –