Package org.apache.avro.mapreduce
Class AvroKeyValueOutputFormat<K,V>
java.lang.Object
org.apache.hadoop.mapreduce.OutputFormat<K,V>
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>
org.apache.avro.mapreduce.AvroOutputFormatBase<K,V>
org.apache.avro.mapreduce.AvroKeyValueOutputFormat<K,V>
- Type Parameters:
K
- The type of key. If an Avro type, it must be wrapped in anAvroKey
.V
- The type of value. If an Avro type, it must be wrapped in anAvroValue
.
FileOutputFormat for writing Avro container files of key/value pairs.
Since Avro container files can only contain records (not key/value pairs), this output format puts the key and value into an Avro generic record with two fields, named 'key' and 'value'.
The keys and values given to this output format may be Avro objects wrapped
in AvroKey
or AvroValue
objects. The basic Writable
types are also supported (e.g., IntWritable, Text); they will be converted to
their corresponding Avro types.
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
FileOutputFormat.Counter
-
Field Summary
Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART
-
Constructor Summary
-
Method Summary
Methods inherited from class org.apache.avro.mapreduce.AvroOutputFormatBase
getAvroFileOutputStream, getCompressionCodec, getSyncInterval
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath
-
Constructor Details
-
AvroKeyValueOutputFormat
public AvroKeyValueOutputFormat()
-
-
Method Details
-
getRecordWriter
- Specified by:
getRecordWriter
in classFileOutputFormat<K,
V> - Throws:
IOException
-