Hadoop自定义输出的代码 第7页

   FileSplit inputsplit = (FileSplit)split; 
                FileName = (inputsplit).getPath().getName();     
            } 
     
            @Override 
            public void close() throws IOException { 
                // TODO Auto-generated method stub 
                 
            } 
     
            @Override 
            public float getProgress() throws IOException, InterruptedException { 
                // TODO Auto-generated method stub 
                return 0; 
            } 
     
            @Override 
            public boolean nextKeyValue() throws IOException, InterruptedException { 
                // TODO Auto-generated method stub 
                return false; 
            } 
        } 
    } 

Hadoop中也内置了很多的输出格式与RecordWriter.输出格式完成输出规范检查，作业结果数据输出。

自定义的输出格式：

[java] view plaincopy

    public static class AlphaOutputFormat extends multiformat<Text, IntWritable>{ 
             
            @Override 
            protected String generateFileNameForKeyValue(Text key, 
                    IntWritable value, Configuration conf) { 
                // TODO Auto-generated method stub 
                char c = key.toString().toLowerCase().charAt(0); 
                if( c>='a' && c<='z'){ 
                    return c+".txt"; 
                }else{ 
                    return "other.txt"; 
                } 
            } 
             
        } 

[java] view plaincopy

    //设置输出格式 
            job.setOutputFormatClass(AlphaOutputFormat.class); 

[java] view plaincopy

    package com.rpc.nefu; 
    import java.io.DataOutputStream;   
    import java.io.IOException;   
    import java.util.HashMap;   
    import java.util.Iterator;   
    import org.apache.hadoop.conf.Configuration;   
    import org.apache.hadoop.fs.FSDataOutputStream;   
    import org.apache.hadoop.fs.Path;   
    import org.apache.hadoop.io.Writable;   
    import org.apache.hadoop.io.WritableComparable;   
  &nb

上一页  [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] 下一页