Package org.apache.nutch.crawl
Class CrawlDbReader.CrawlDatumJsonOutputFormat
- java.lang.Object
-
- org.apache.hadoop.mapreduce.OutputFormat<K,V>
-
- org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<Text,CrawlDatum>
-
- org.apache.nutch.crawl.CrawlDbReader.CrawlDatumJsonOutputFormat
-
- Enclosing class:
- CrawlDbReader
public static class CrawlDbReader.CrawlDatumJsonOutputFormat extends FileOutputFormat<Text,CrawlDatum>
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description protected static class
CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter
static class
CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer
-
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
FileOutputFormat.Counter
-
-
Field Summary
-
Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART
-
-
Constructor Summary
Constructors Constructor Description CrawlDatumJsonOutputFormat()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description RecordWriter<Text,CrawlDatum>
getRecordWriter(TaskAttemptContext context)
-
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath
-
-
-
-
Method Detail
-
getRecordWriter
public RecordWriter<Text,CrawlDatum> getRecordWriter(TaskAttemptContext context) throws IOException
- Specified by:
getRecordWriter
in classFileOutputFormat<Text,CrawlDatum>
- Throws:
IOException
-
-