Package | Description |
---|---|
org.apache.avro |
Avro kernel classes.
|
org.apache.avro.data |
Interfaces and base classes shared by generic, specific and reflect.
|
org.apache.avro.generic |
A generic representation for Avro data.
|
org.apache.avro.hadoop.file | |
org.apache.avro.hadoop.io | |
org.apache.avro.io |
Utilities for Encoding and Decoding Avro data.
|
org.apache.avro.ipc.generic | |
org.apache.avro.mapred |
Run Hadoop MapReduce jobs over
Avro data, with map and reduce functions written in Java.
|
org.apache.avro.mapreduce | |
org.apache.avro.message | |
org.apache.avro.protobuf |
Protocol Buffer
compatibility.
|
org.apache.avro.reflect |
Use Java reflection to generate schemas and protocols for existing
classes.
|
org.apache.avro.specific |
Generate specific Java classes for schemas and protocols.
|
org.apache.avro.thrift |
Thrift compatibility.
|
org.apache.trevni.avro |
Read and write Avro data
in Trevni column files.
|
Modifier and Type | Method and Description |
---|---|
static Resolver.Action |
Resolver.resolve(Schema writer,
Schema reader,
GenericData data)
Returns a
Resolver.Action tree for resolving the writer schema
writer and the reader schema reader. |
static Resolver.Action |
Resolver.Promote.resolve(Schema w,
Schema r,
GenericData d)
Return a promotion.
|
static Resolver.Action |
Resolver.EnumAdjust.resolve(Schema w,
Schema r,
GenericData d)
If writer and reader don't have same name, a
Resolver.ErrorAction.ErrorType.NAMES_DONT_MATCH is returned, otherwise an
appropriate Resolver.EnumAdjust is. |
static Resolver.Action |
Resolver.WriterUnion.resolve(Schema writeSchema,
Schema readSchema,
GenericData data,
Map<Schema.SeenPair,Resolver.Action> seen) |
static Resolver.Action |
Resolver.ReaderUnion.resolve(Schema w,
Schema r,
GenericData d,
Map<Schema.SeenPair,Resolver.Action> seen)
Returns a
Resolver.ReaderUnion action for resolving w and r,
or an Resolver.ErrorAction if there is no branch in the reader that matches
the writer. |
Constructor and Description |
---|
Action(Schema w,
Schema r,
GenericData data,
Resolver.Action.Type t) |
Container(Schema w,
Schema r,
GenericData d,
Resolver.Action e) |
DoNothing(Schema w,
Schema r,
GenericData d) |
ErrorAction(Schema w,
Schema r,
GenericData d,
Resolver.ErrorAction.ErrorType e) |
ReaderUnion(Schema w,
Schema r,
GenericData d,
int firstMatch,
Resolver.Action actual) |
Skip(Schema w,
GenericData d) |
Modifier and Type | Method and Description |
---|---|
protected GenericData |
RecordBuilderBase.data() |
Constructor and Description |
---|
RecordBuilderBase(RecordBuilderBase<T> other,
GenericData data)
RecordBuilderBase copy constructor.
|
RecordBuilderBase(Schema schema,
GenericData data)
Creates a RecordBuilderBase for building records of the given type.
|
Modifier and Type | Method and Description |
---|---|
static GenericData |
GenericData.get()
Return the singleton instance.
|
GenericData |
GenericDatumWriter.getData()
Return the
GenericData implementation. |
GenericData |
GenericDatumReader.getData()
Return the
GenericData implementation. |
GenericData |
GenericData.setFastReaderEnabled(boolean flag) |
Constructor and Description |
---|
GenericDatumReader(GenericData data) |
GenericDatumReader(Schema writer,
Schema reader,
GenericData data) |
GenericDatumWriter(GenericData data) |
GenericDatumWriter(Schema root,
GenericData data) |
Modifier and Type | Method and Description |
---|---|
GenericData |
SortedKeyValueFile.Reader.Options.getDataModel()
Return the data model.
|
GenericData |
SortedKeyValueFile.Writer.Options.getDataModel()
Return the data model.
|
Modifier and Type | Method and Description |
---|---|
SortedKeyValueFile.Reader.Options |
SortedKeyValueFile.Reader.Options.withDataModel(GenericData model)
Set the data model.
|
SortedKeyValueFile.Writer.Options |
SortedKeyValueFile.Writer.Options.withDataModel(GenericData model)
Set the data model.
|
Modifier and Type | Method and Description |
---|---|
static GenericData |
AvroSerialization.createDataModel(org.apache.hadoop.conf.Configuration conf)
Gets an instance of data model implementation, defaulting to
ReflectData if not explicitly specified. |
Modifier and Type | Method and Description |
---|---|
static Class<? extends GenericData> |
AvroSerialization.getDataModelClass(org.apache.hadoop.conf.Configuration conf)
Gets the data model class for de/serialization.
|
Modifier and Type | Method and Description |
---|---|
static void |
AvroSerialization.setDataModelClass(org.apache.hadoop.conf.Configuration conf,
Class<? extends GenericData> modelClass)
Sets the data model class for de/serialization.
|
Modifier and Type | Method and Description |
---|---|
static boolean |
FastReaderBuilder.isSupportedData(GenericData data) |
Constructor and Description |
---|
FastReaderBuilder(GenericData parentData) |
Modifier and Type | Method and Description |
---|---|
GenericData |
GenericResponder.getGenericData() |
GenericData |
GenericRequestor.getGenericData() |
Constructor and Description |
---|
GenericRequestor(Protocol protocol,
Transceiver transceiver,
GenericData data) |
GenericResponder(Protocol local,
GenericData data) |
Modifier and Type | Method and Description |
---|---|
static GenericData |
AvroJob.createDataModel(org.apache.hadoop.conf.Configuration conf) |
static GenericData |
AvroJob.createInputDataModel(org.apache.hadoop.conf.Configuration conf) |
static GenericData |
AvroJob.createMapOutputDataModel(org.apache.hadoop.conf.Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static Class<? extends GenericData> |
AvroJob.getDataModelClass(org.apache.hadoop.conf.Configuration conf)
Return the job's data model implementation class.
|
Modifier and Type | Method and Description |
---|---|
static void |
AvroJob.setDataModelClass(org.apache.hadoop.mapred.JobConf job,
Class<? extends GenericData> modelClass)
Configure a job's data model implementation class.
|
Modifier and Type | Method and Description |
---|---|
protected org.apache.hadoop.mapreduce.RecordWriter<AvroKey<T>,org.apache.hadoop.io.NullWritable> |
AvroKeyOutputFormat.RecordWriterFactory.create(Schema writerSchema,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream,
int syncInterval)
Creates a new record writer instance.
|
Modifier and Type | Method and Description |
---|---|
static void |
AvroJob.setDataModelClass(org.apache.hadoop.mapreduce.Job job,
Class<? extends GenericData> modelClass)
Sets the job data model class.
|
Constructor and Description |
---|
AvroKeyRecordWriter(Schema writerSchema,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream)
Constructor.
|
AvroKeyRecordWriter(Schema writerSchema,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream,
int syncInterval)
Constructor.
|
AvroKeyValueRecordWriter(AvroDatumConverter<K,?> keyConverter,
AvroDatumConverter<V,?> valueConverter,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream)
Constructor.
|
AvroKeyValueRecordWriter(AvroDatumConverter<K,?> keyConverter,
AvroDatumConverter<V,?> valueConverter,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream,
int syncInterval)
Constructor.
|
Constructor and Description |
---|
BinaryMessageDecoder(GenericData model,
Schema readSchema)
Creates a new
BinaryMessageEncoder that uses the given
data model to construct datum instances described by the
schema . |
BinaryMessageDecoder(GenericData model,
Schema readSchema,
SchemaStore resolver)
Creates a new
BinaryMessageEncoder that uses the given
data model to construct datum instances described by the
schema . |
BinaryMessageEncoder(GenericData model,
Schema schema)
Creates a new
BinaryMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
BinaryMessageEncoder(GenericData model,
Schema schema,
boolean shouldCopy)
Creates a new
BinaryMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
RawMessageDecoder(GenericData model,
Schema schema)
Creates a new
RawMessageDecoder that uses the given
data model to construct datum instances described by the
schema . |
RawMessageDecoder(GenericData model,
Schema writeSchema,
Schema readSchema)
Creates a new
RawMessageDecoder that uses the given
data model to construct datum instances described by the
readSchema . |
RawMessageEncoder(GenericData model,
Schema schema)
Creates a new
RawMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
RawMessageEncoder(GenericData model,
Schema schema,
boolean shouldCopy)
Creates a new
RawMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
Modifier and Type | Class and Description |
---|---|
class |
ProtobufData
Utilities for serializing Protobuf data in Avro format.
|
Modifier and Type | Class and Description |
---|---|
class |
ReflectData
Utilities to use existing Java classes and interfaces via reflection.
|
static class |
ReflectData.AllowNull
ReflectData implementation that permits null field values. |
Modifier and Type | Class and Description |
---|---|
class |
SpecificData
Utilities for generated Java classes and interfaces.
|
Modifier and Type | Class and Description |
---|---|
class |
ThriftData
Utilities for serializing Thrift data in Avro format.
|
Modifier and Type | Method and Description |
---|---|
AvroColumnReader.Params |
AvroColumnReader.Params.setModel(GenericData model)
Set data representation.
|
Constructor and Description |
---|
AvroColumnWriter(Schema s,
ColumnFileMetaData meta,
GenericData model) |
Copyright © 2009–2020 The Apache Software Foundation. All rights reserved.