Package org.apache.trevni.avro
Class AvroTrevniInputFormat<T>
java.lang.Object
org.apache.hadoop.mapred.FileInputFormat<AvroWrapper<T>,NullWritable>
org.apache.trevni.avro.AvroTrevniInputFormat<T>
- All Implemented Interfaces:
InputFormat<AvroWrapper<T>,
NullWritable>
An
InputFormat
for Trevni files.
A subset schema to be read may be specified with
AvroJob.setInputSchema(JobConf,Schema)
.
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat
FileInputFormat.Counter
-
Field Summary
Fields inherited from class org.apache.hadoop.mapred.FileInputFormat
INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptiongetRecordReader
(InputSplit split, JobConf job, Reporter reporter) protected boolean
isSplitable
(FileSystem fs, Path filename) protected FileStatus[]
listStatus
(JobConf job) Methods inherited from class org.apache.hadoop.mapred.FileInputFormat
addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize
-
Constructor Details
-
AvroTrevniInputFormat
public AvroTrevniInputFormat()
-
-
Method Details
-
isSplitable
- Overrides:
isSplitable
in classFileInputFormat<AvroWrapper<T>,
NullWritable>
-
listStatus
- Overrides:
listStatus
in classFileInputFormat<AvroWrapper<T>,
NullWritable> - Throws:
IOException
-
getRecordReader
public RecordReader<AvroWrapper<T>,NullWritable> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException - Specified by:
getRecordReader
in interfaceInputFormat<AvroWrapper<T>,
NullWritable> - Specified by:
getRecordReader
in classFileInputFormat<AvroWrapper<T>,
NullWritable> - Throws:
IOException
-