Package | Description |
---|---|
org.apache.avro |
Avro kernel classes.
|
org.apache.avro.compiler.idl | |
org.apache.avro.compiler.specific | |
org.apache.avro.data |
Interfaces and base classes shared by generic, specific and reflect.
|
org.apache.avro.file |
A container file for Avro data.
|
org.apache.avro.generic |
A generic representation for Avro data.
|
org.apache.avro.hadoop.file | |
org.apache.avro.hadoop.io | |
org.apache.avro.io |
Utilities for Encoding and Decoding Avro data.
|
org.apache.avro.io.parsing |
Implementation of Avro schemas as LL(1) grammars.
|
org.apache.avro.ipc |
Support for inter-process calls.
|
org.apache.avro.ipc.generic | |
org.apache.avro.ipc.reflect | |
org.apache.avro.ipc.specific | |
org.apache.avro.ipc.trace | |
org.apache.avro.mapred |
Run Hadoop MapReduce jobs over
Avro data, with map and reduce functions written in Java.
|
org.apache.avro.mapred.tether |
Run Hadoop MapReduce jobs over
Avro data, with map and reduce functions run in a sub-process.
|
org.apache.avro.mapreduce | |
org.apache.avro.protobuf |
Protocol Buffer
compatibility.
|
org.apache.avro.reflect |
Use Java reflection to generate schemas and protocols for existing
classes.
|
org.apache.avro.specific |
Generate specific Java classes for schemas and protocols.
|
org.apache.avro.thrift |
Thrift compatibility.
|
org.apache.trevni.avro |
Read and write Avro data
in Trevni column files.
|
org.apache.trevni.avro.mapreduce |
Modifier and Type | Field and Description |
---|---|
static Schema |
Protocol.SYSTEM_ERROR
An error that can be thrown by any message.
|
static Schema |
Protocol.SYSTEM_ERRORS
Union type for generating system errors.
|
Modifier and Type | Method and Description |
---|---|
static Schema |
Schema.applyAliases(Schema writer,
Schema reader)
Rewrite a writer's schema using the aliases from a reader's schema.
|
static Schema |
Schema.create(Schema.Type type)
Create a schema for a primitive type.
|
static Schema |
Schema.createArray(Schema elementType)
Create an array schema.
|
static Schema |
Schema.createEnum(String name,
String doc,
String namespace,
List<String> values)
Create an enum schema.
|
static Schema |
Schema.createFixed(String name,
String doc,
String space,
int size)
Create a union schema.
|
static Schema |
Schema.createMap(Schema valueType)
Create a map schema.
|
static Schema |
Schema.createRecord(List<Schema.Field> fields)
Create an anonymous record schema.
|
static Schema |
Schema.createRecord(String name,
String doc,
String namespace,
boolean isError)
Create a named record schema.
|
static Schema |
Schema.createUnion(List<Schema> types)
Create a union schema.
|
Schema |
Schema.getElementType()
If this is an array, returns its element type.
|
Schema |
Protocol.Message.getErrors()
Errors that might be thrown.
|
Schema |
Protocol.Message.getRequest()
The parameters of this message.
|
Schema |
Protocol.Message.getResponse()
The returned data.
|
Schema |
Protocol.getType(String name)
Returns the named type.
|
Schema |
UnresolvedUnionException.getUnionSchema() |
Schema |
Schema.getValueType()
If this is a map, returns its value type.
|
static Schema |
Schema.parse(File file)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Parser.parse(File file)
Parse a schema from the provided file.
|
static Schema |
Schema.parse(InputStream in)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Parser.parse(InputStream in)
Parse a schema from the provided stream.
|
static Schema |
Schema.parse(String jsonSchema)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Parser.parse(String s)
Parse a schema from the provided string.
|
static Schema |
Schema.parse(String jsonSchema,
boolean validate)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Field.schema()
This field's
Schema . |
Modifier and Type | Method and Description |
---|---|
List<Schema> |
Schema.getTypes()
If this is a union, returns its types.
|
Map<String,Schema> |
Schema.Parser.getTypes()
Returns the set of defined, named types known to this parser.
|
Collection<Schema> |
Protocol.getTypes()
The types of this protocol.
|
Modifier and Type | Method and Description |
---|---|
static Schema |
Schema.applyAliases(Schema writer,
Schema reader)
Rewrite a writer's schema using the aliases from a reader's schema.
|
static Schema |
Schema.createArray(Schema elementType)
Create an array schema.
|
static Schema |
Schema.createMap(Schema valueType)
Create a map schema.
|
<T> Protocol.Message |
Protocol.createMessage(String name,
String doc,
Map<String,T> propMap,
Schema request)
Create a one-way message.
|
<T> Protocol.Message |
Protocol.createMessage(String name,
String doc,
Map<String,T> propMap,
Schema request,
Schema response,
Schema errors)
Create a two-way message.
|
Protocol.Message |
Protocol.createMessage(String name,
String doc,
Schema request)
Deprecated.
|
Protocol.Message |
Protocol.createMessage(String name,
String doc,
Schema request,
Schema response,
Schema errors)
Deprecated.
|
static byte[] |
SchemaNormalization.parsingFingerprint(String fpName,
Schema s)
Returns
SchemaNormalization.fingerprint(java.lang.String, byte[]) applied to the parsing canonical form
of the supplied schema. |
static long |
SchemaNormalization.parsingFingerprint64(Schema s)
Returns
SchemaNormalization.fingerprint64(byte[]) applied to the parsing canonical form
of the supplied schema. |
static String |
SchemaNormalization.toParsingForm(Schema s)
Returns "Parsing Canonical Form" of a schema as defined by Avro
spec.
|
Modifier and Type | Method and Description |
---|---|
Schema.Parser |
Schema.Parser.addTypes(Map<String,Schema> types)
Adds the provided types to the set of defined, named types known to
this parser.
|
static Schema |
Schema.createUnion(List<Schema> types)
Create a union schema.
|
void |
Protocol.setTypes(Collection<Schema> newTypes)
Set the types of this protocol.
|
Constructor and Description |
---|
Schema.Field(String name,
Schema schema,
String doc,
JsonNode defaultValue) |
Schema.Field(String name,
Schema schema,
String doc,
JsonNode defaultValue,
Schema.Field.Order order) |
UnresolvedUnionException(Schema unionSchema,
Object unresolvedDatum) |
Modifier and Type | Method and Description |
---|---|
Schema |
Idl.ArrayType() |
Schema |
Idl.EnumDeclaration() |
Schema |
Idl.FixedDeclaration() |
Schema |
Idl.FormalParameters() |
Schema |
Idl.ImportSchema() |
Schema |
Idl.MapType() |
Schema |
Idl.NamedSchemaDeclaration(Map<String,JsonNode> props) |
Schema |
Idl.PrimitiveType() |
Schema |
Idl.RecordDeclaration() |
Schema |
Idl.ReferenceType()
A reference to some other existing type
|
Schema |
Idl.ResultType()
Result types are like other types, except we provide "void" as
an alias of "null"
|
Schema |
Idl.Type() |
Schema |
Idl.UnionDefinition() |
Modifier and Type | Method and Description |
---|---|
void |
Idl.VariableDeclarator(Schema type,
List<Schema.Field> fields) |
Modifier and Type | Method and Description |
---|---|
void |
Idl.ErrorList(List<Schema> errors) |
Modifier and Type | Method and Description |
---|---|
static String |
SpecificCompiler.generateClearMethod(Schema schema,
Schema.Field field)
Generates the name of a field "clear" method.
|
static String |
SpecificCompiler.generateGetMethod(Schema schema,
Schema.Field field)
Generates the name of a field accessor method.
|
static String |
SpecificCompiler.generateHasMethod(Schema schema,
Schema.Field field)
Generates the name of a field "has" method.
|
static String |
SpecificCompiler.generateSetMethod(Schema schema,
Schema.Field field)
Generates the name of a field mutator method.
|
static boolean |
SpecificCompiler.isUnboxedJavaTypeNullable(Schema schema)
Tests whether an unboxed Java type can be set to null
|
String |
SpecificCompiler.javaType(Schema schema)
Utility for template use.
|
String |
SpecificCompiler.javaUnbox(Schema schema)
Utility for template use.
|
Constructor and Description |
---|
SpecificCompiler(Schema schema) |
Modifier and Type | Field and Description |
---|---|
static Schema |
Json.SCHEMA
The schema for Json data.
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
RecordBuilderBase.schema() |
Modifier and Type | Method and Description |
---|---|
void |
Json.Writer.setSchema(Schema schema) |
void |
Json.Reader.setSchema(Schema schema) |
Constructor and Description |
---|
RecordBuilderBase(Schema schema,
GenericData data)
Creates a RecordBuilderBase for building records of the given type.
|
Modifier and Type | Method and Description |
---|---|
Schema |
DataFileReader12.getSchema()
Return the schema used in this file.
|
Schema |
FileReader.getSchema()
Return the schema for data in this file.
|
Schema |
DataFileStream.getSchema()
Return the schema used in this file.
|
Modifier and Type | Method and Description |
---|---|
DataFileWriter<D> |
DataFileWriter.create(Schema schema,
File file)
Open a new file for data matching a schema.
|
DataFileWriter<D> |
DataFileWriter.create(Schema schema,
OutputStream outs)
Open a new file for data matching a schema.
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
GenericData.getEnumSchema(Object enu)
Called to obtain the schema of a enum.
|
Schema |
GenericDatumReader.getExpected()
Get the reader's schema.
|
protected Schema |
GenericData.getFixedSchema(Object fixed)
Called to obtain the schema of a fixed.
|
protected Schema |
GenericData.getRecordSchema(Object record)
Called to obtain the schema of a record.
|
Schema |
GenericDatumReader.getSchema()
Return the writer's schema.
|
Schema |
GenericContainer.getSchema()
The schema of this instance.
|
Schema |
GenericData.Record.getSchema() |
Schema |
GenericData.Array.getSchema() |
Schema |
GenericData.Fixed.getSchema() |
Schema |
GenericData.EnumSymbol.getSchema() |
Schema |
GenericData.induce(Object datum)
Create a schema given an example datum.
|
Modifier and Type | Method and Description |
---|---|
int |
GenericData.compare(Object o1,
Object o2,
Schema s)
Compare objects according to their schema.
|
protected int |
GenericData.compare(Object o1,
Object o2,
Schema s,
boolean equals)
Comparison implementation.
|
DatumReader |
GenericData.createDatumReader(Schema schema)
Returns a
DatumReader for this kind of data. |
protected Object |
GenericDatumReader.createEnum(String symbol,
Schema schema)
Called to create an enum value.
|
protected Object |
GenericDatumReader.createFixed(Object old,
byte[] bytes,
Schema schema)
Deprecated.
As of Avro 1.6.0 this method has been moved to
GenericData.createFixed(Object, byte[], Schema) |
Object |
GenericData.createFixed(Object old,
byte[] bytes,
Schema schema)
Called to create an fixed value.
|
protected Object |
GenericDatumReader.createFixed(Object old,
Schema schema)
Deprecated.
As of Avro 1.6.0 this method has been moved to
GenericData.createFixed(Object, Schema) |
Object |
GenericData.createFixed(Object old,
Schema schema)
Called to create an fixed value.
|
<T> T |
GenericData.deepCopy(Schema schema,
T value)
Makes a deep copy of a value given its schema.
|
protected Object |
GenericData.getRecordState(Object record,
Schema schema)
Produce state for repeated calls to
GenericData.getField(Object,String,int,Object) and GenericData.setField(Object,String,int,Object,Object) on the same record. |
protected ResolvingDecoder |
GenericDatumReader.getResolver(Schema actual,
Schema expected)
Gets a resolving decoder for use by this GenericDatumReader.
|
int |
GenericData.hashCode(Object o,
Schema s)
Compute a hash code according to a schema, consistent with
GenericData.compare(Object,Object,Schema) . |
protected int |
GenericData.hashCodeAdd(int hashCode,
Object o,
Schema s)
Add the hash code for an object into an accumulated hash code.
|
protected boolean |
GenericData.instanceOf(Schema schema,
Object datum)
Called by
GenericData.resolveUnion(Schema,Object) . |
protected Object |
GenericDatumReader.newArray(Object old,
int size,
Schema schema)
Called to create new array instances.
|
protected Object |
GenericDatumReader.newRecord(Object old,
Schema schema)
Deprecated.
As of Avro 1.6.0 this method has been moved to
GenericData.newRecord(Object, Schema) |
Object |
GenericData.newRecord(Object old,
Schema schema)
Called to create new record instances.
|
protected Object |
GenericDatumReader.read(Object old,
Schema expected,
ResolvingDecoder in)
Called to read data.
|
protected Object |
GenericDatumReader.readArray(Object old,
Schema expected,
ResolvingDecoder in)
Called to read an array instance.
|
protected Object |
GenericDatumReader.readBytes(Object old,
Schema s,
Decoder in)
Called to read byte arrays.
|
protected Object |
GenericDatumReader.readEnum(Schema expected,
Decoder in)
Called to read an enum value.
|
protected Object |
GenericDatumReader.readFixed(Object old,
Schema expected,
Decoder in)
Called to read a fixed value.
|
protected Object |
GenericDatumReader.readInt(Object old,
Schema expected,
Decoder in)
Called to read integers.
|
protected Object |
GenericDatumReader.readMap(Object old,
Schema expected,
ResolvingDecoder in)
Called to read a map instance.
|
protected Object |
GenericDatumReader.readMapKey(Object old,
Schema expected,
Decoder in)
Called by the default implementation of
GenericDatumReader.readMap(java.lang.Object, org.apache.avro.Schema, org.apache.avro.io.ResolvingDecoder) to read a
key value. |
protected Object |
GenericDatumReader.readRecord(Object old,
Schema expected,
ResolvingDecoder in)
Called to read a record instance.
|
protected Object |
GenericDatumReader.readString(Object old,
Schema expected,
Decoder in)
Called to read strings.
|
int |
GenericData.resolveUnion(Schema union,
Object datum)
Return the index for a datum within a union.
|
protected int |
GenericDatumWriter.resolveUnion(Schema union,
Object datum)
Called to find the index for a datum within a union.
|
void |
GenericDatumReader.setExpected(Schema reader)
Set the reader's schema.
|
void |
GenericDatumReader.setSchema(Schema writer) |
protected void |
GenericData.Fixed.setSchema(Schema schema) |
void |
GenericDatumWriter.setSchema(Schema root) |
static void |
GenericData.setStringType(Schema s,
GenericData.StringType stringType)
Set the Java type to be used when reading this schema.
|
static void |
GenericDatumReader.skip(Schema schema,
Decoder in)
Skip an instance of a schema.
|
boolean |
GenericData.validate(Schema schema,
Object datum)
Returns true if a Java datum matches a schema.
|
protected void |
GenericDatumWriter.write(Schema schema,
Object datum,
Encoder out)
Called to write data.
|
protected void |
GenericDatumWriter.writeArray(Schema schema,
Object datum,
Encoder out)
Called to write a array.
|
protected void |
GenericDatumWriter.writeEnum(Schema schema,
Object datum,
Encoder out)
Called to write an enum value.
|
protected void |
GenericDatumWriter.writeFixed(Schema schema,
Object datum,
Encoder out)
Called to write a fixed value.
|
protected void |
GenericDatumWriter.writeMap(Schema schema,
Object datum,
Encoder out)
Called to write a map.
|
protected void |
GenericDatumWriter.writeRecord(Schema schema,
Object datum,
Encoder out)
Called to write a record.
|
protected void |
GenericDatumWriter.writeString(Schema schema,
Object datum,
Encoder out)
Called to write a string.
|
Constructor and Description |
---|
GenericData.Array(int capacity,
Schema schema) |
GenericData.Array(Schema schema,
Collection<T> c) |
GenericData.EnumSymbol(Schema schema,
String symbol) |
GenericData.Fixed(Schema schema) |
GenericData.Fixed(Schema schema,
byte[] bytes) |
GenericData.Record(Schema schema) |
GenericDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
GenericDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
GenericDatumReader(Schema writer,
Schema reader,
GenericData data) |
GenericDatumWriter(Schema root) |
GenericDatumWriter(Schema root,
GenericData data) |
GenericRecordBuilder(Schema schema)
Creates a GenericRecordBuilder for building Record instances.
|
Modifier and Type | Method and Description |
---|---|
Schema |
SortedKeyValueFile.Reader.Options.getKeySchema()
Gets the reader schema for the key.
|
Schema |
SortedKeyValueFile.Writer.Options.getKeySchema()
Gets the key schema.
|
Schema |
SortedKeyValueFile.Reader.Options.getValueSchema()
Gets the reader schema for the value.
|
Schema |
SortedKeyValueFile.Writer.Options.getValueSchema()
Gets the value schema.
|
Modifier and Type | Method and Description |
---|---|
SortedKeyValueFile.Reader.Options |
SortedKeyValueFile.Reader.Options.withKeySchema(Schema keySchema)
Sets the reader schema for the key.
|
SortedKeyValueFile.Writer.Options |
SortedKeyValueFile.Writer.Options.withKeySchema(Schema keySchema)
Sets the key schema.
|
SortedKeyValueFile.Reader.Options |
SortedKeyValueFile.Reader.Options.withValueSchema(Schema valueSchema)
Sets the reader schema for the value.
|
SortedKeyValueFile.Writer.Options |
SortedKeyValueFile.Writer.Options.withValueSchema(Schema valueSchema)
Sets the value schema.
|
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroSerialization.getKeyReaderSchema(org.apache.hadoop.conf.Configuration conf)
Gets the reader schema of the AvroKey datum that is being serialized/deserialized.
|
static Schema |
AvroSerialization.getKeyWriterSchema(org.apache.hadoop.conf.Configuration conf)
Gets the writer schema of the AvroKey datum that is being serialized/deserialized.
|
Schema |
AvroDeserializer.getReaderSchema()
Gets the reader schema used for deserializing.
|
static Schema |
AvroKeyValue.getSchema(Schema keySchema,
Schema valueSchema)
Creates a KeyValuePair generic record schema.
|
static Schema |
AvroSerialization.getValueReaderSchema(org.apache.hadoop.conf.Configuration conf)
Gets the reader schema of the AvroValue datum that is being serialized/deserialized.
|
static Schema |
AvroSerialization.getValueWriterSchema(org.apache.hadoop.conf.Configuration conf)
Gets the writer schema of the AvroValue datum that is being serialized/deserialized.
|
Schema |
AvroDeserializer.getWriterSchema()
Gets the writer schema used for deserializing.
|
Schema |
AvroSerializer.getWriterSchema()
Gets the writer schema being used for serialization.
|
Schema |
AvroDatumConverterFactory.AvroWrapperConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.BooleanWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.BytesWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.ByteWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.DoubleWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.FloatWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.IntWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.LongWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.NullWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Schema |
AvroDatumConverterFactory.TextConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
abstract Schema |
AvroDatumConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro datum.
|
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroKeyValue.getSchema(Schema keySchema,
Schema valueSchema)
Creates a KeyValuePair generic record schema.
|
static void |
AvroSerialization.setKeyReaderSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the reader schema of the AvroKey datum that is being serialized/deserialized.
|
static void |
AvroSerialization.setKeyWriterSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the writer schema of the AvroKey datum that is being serialized/deserialized.
|
static void |
AvroSerialization.setValueReaderSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the reader schema of the AvroValue datum that is being serialized/deserialized.
|
static void |
AvroSerialization.setValueWriterSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the writer schema of the AvroValue datum that is being serialized/deserialized.
|
AvroSequenceFile.Writer.Options |
AvroSequenceFile.Writer.Options.withKeySchema(Schema keyWriterSchema)
Sets the writer schema of the key records when using Avro data.
|
AvroSequenceFile.Reader.Options |
AvroSequenceFile.Reader.Options.withKeySchema(Schema keyReaderSchema)
Sets the reader schema of the key records when using Avro data.
|
AvroSequenceFile.Writer.Options |
AvroSequenceFile.Writer.Options.withValueSchema(Schema valueWriterSchema)
Sets the writer schema of the value records when using Avro data.
|
AvroSequenceFile.Reader.Options |
AvroSequenceFile.Reader.Options.withValueSchema(Schema valueReaderSchema)
Sets the reader schema of the value records when using Avro data.
|
Constructor and Description |
---|
AvroDatumConverterFactory.AvroWrapperConverter(Schema schema) |
AvroDeserializer(Schema writerSchema,
Schema readerSchema,
ClassLoader classLoader)
Constructor.
|
AvroKeyDeserializer(Schema writerSchema,
Schema readerSchema,
ClassLoader classLoader)
Constructor.
|
AvroSerializer(Schema writerSchema)
Constructor.
|
AvroValueDeserializer(Schema writerSchema,
Schema readerSchema,
ClassLoader classLoader)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
static int |
BinaryData.compare(byte[] b1,
int s1,
byte[] b2,
int s2,
Schema schema)
Compare binary encoded data.
|
static int |
BinaryData.compare(byte[] b1,
int s1,
int l1,
byte[] b2,
int s2,
int l2,
Schema schema)
Compare binary encoded data.
|
static int |
BinaryData.hashCode(byte[] bytes,
int start,
int length,
Schema schema)
Hash binary encoded data.
|
JsonDecoder |
DecoderFactory.jsonDecoder(Schema schema,
InputStream input)
Creates a
JsonDecoder using the InputStrim provided for reading
data that conforms to the Schema provided. |
JsonDecoder |
DecoderFactory.jsonDecoder(Schema schema,
String input)
Creates a
JsonDecoder using the String provided for reading data
that conforms to the Schema provided. |
JsonEncoder |
EncoderFactory.jsonEncoder(Schema schema,
JsonGenerator gen)
Creates a
JsonEncoder using the JsonGenerator provided for
output of data conforming to the Schema provided. |
JsonEncoder |
EncoderFactory.jsonEncoder(Schema schema,
OutputStream out)
Creates a
JsonEncoder using the OutputStream provided for writing
data conforming to the Schema provided. |
static Object |
ResolvingDecoder.resolve(Schema writer,
Schema reader)
Produces an opaque resolver that can be used to construct a new
ResolvingDecoder.ResolvingDecoder(Object, Decoder) . |
ResolvingDecoder |
DecoderFactory.resolvingDecoder(Schema writer,
Schema reader,
Decoder wrapped)
Creates a
ResolvingDecoder wrapping the Decoder provided. |
void |
DatumWriter.setSchema(Schema schema)
Set the schema.
|
void |
DatumReader.setSchema(Schema schema)
Set the writer's schema.
|
ValidatingDecoder |
DecoderFactory.validatingDecoder(Schema schema,
Decoder wrapped)
Creates a
ValidatingDecoder wrapping the Decoder provided. |
ValidatingEncoder |
EncoderFactory.validatingEncoder(Schema schema,
Encoder encoder)
Creates a
ValidatingEncoder that wraps the Encoder provided. |
Modifier and Type | Method and Description |
---|---|
static void |
ResolvingGrammarGenerator.encode(Encoder e,
Schema s,
JsonNode n)
Encodes the given Json node n on to the encoder e
according to the schema s.
|
Symbol |
ValidatingGrammarGenerator.generate(Schema schema)
Returns the non-terminal that is the start symbol
for the grammar for the given schema sc.
|
Symbol |
JsonGrammarGenerator.generate(Schema schema)
Returns the non-terminal that is the start symbol
for the grammar for the grammar for the given schema sc.
|
Symbol |
ValidatingGrammarGenerator.generate(Schema sc,
Map<org.apache.avro.io.parsing.ValidatingGrammarGenerator.LitS,Symbol> seen)
Returns the non-terminal that is the start symbol
for the grammar for the given schema sc.
|
Symbol |
JsonGrammarGenerator.generate(Schema sc,
Map<org.apache.avro.io.parsing.ValidatingGrammarGenerator.LitS,Symbol> seen)
Returns the non-terminal that is the start symbol
for grammar of the given schema sc.
|
Symbol |
ResolvingGrammarGenerator.generate(Schema writer,
Schema reader)
Resolves the writer schema writer and the reader schema
reader and returns the start symbol for the grammar generated.
|
Symbol |
ResolvingGrammarGenerator.generate(Schema writer,
Schema reader,
Map<org.apache.avro.io.parsing.ValidatingGrammarGenerator.LitS,Symbol> seen)
Resolves the writer schema writer and the reader schema
reader and returns the start symbol for the grammar generated.
|
Modifier and Type | Field and Description |
---|---|
static Schema |
HandshakeMatch.SCHEMA$ |
static Schema |
HandshakeResponse.SCHEMA$ |
static Schema |
MD5.SCHEMA$ |
static Schema |
HandshakeRequest.SCHEMA$ |
Modifier and Type | Method and Description |
---|---|
static Schema |
HandshakeMatch.getClassSchema() |
static Schema |
HandshakeResponse.getClassSchema() |
static Schema |
MD5.getClassSchema() |
static Schema |
HandshakeRequest.getClassSchema() |
Schema |
HandshakeResponse.getSchema() |
Schema |
HandshakeRequest.getSchema() |
Modifier and Type | Method and Description |
---|---|
Object |
Requestor.readError(Schema schema,
Decoder in)
Deprecated.
|
abstract Exception |
Requestor.readError(Schema writer,
Schema reader,
Decoder in)
Reads an error message.
|
abstract Object |
Responder.readRequest(Schema actual,
Schema expected,
Decoder in)
Reads a request message.
|
Object |
Requestor.readResponse(Schema schema,
Decoder in)
Deprecated.
|
abstract Object |
Requestor.readResponse(Schema writer,
Schema reader,
Decoder in)
Reads a response message.
|
abstract void |
Responder.writeError(Schema schema,
Object error,
Encoder out)
Writes an error message.
|
abstract void |
Requestor.writeRequest(Schema schema,
Object request,
Encoder out)
Writes a request message.
|
abstract void |
Responder.writeResponse(Schema schema,
Object response,
Encoder out)
Writes a response message.
|
Modifier and Type | Method and Description |
---|---|
protected DatumReader<Object> |
GenericResponder.getDatumReader(Schema actual,
Schema expected) |
protected DatumWriter<Object> |
GenericResponder.getDatumWriter(Schema schema) |
Exception |
GenericRequestor.readError(Schema writer,
Schema reader,
Decoder in) |
Object |
GenericResponder.readRequest(Schema actual,
Schema expected,
Decoder in) |
Object |
GenericRequestor.readResponse(Schema writer,
Schema reader,
Decoder in) |
void |
GenericResponder.writeError(Schema schema,
Object error,
Encoder out) |
void |
GenericRequestor.writeRequest(Schema schema,
Object request,
Encoder out) |
void |
GenericResponder.writeResponse(Schema schema,
Object response,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
protected DatumReader<Object> |
ReflectRequestor.getDatumReader(Schema writer,
Schema reader) |
protected DatumReader<Object> |
ReflectResponder.getDatumReader(Schema actual,
Schema expected) |
protected DatumWriter<Object> |
ReflectRequestor.getDatumWriter(Schema schema) |
protected DatumWriter<Object> |
ReflectResponder.getDatumWriter(Schema schema) |
void |
ReflectResponder.writeError(Schema schema,
Object error,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
protected DatumReader<Object> |
SpecificRequestor.getDatumReader(Schema schema)
Deprecated.
|
protected DatumReader<Object> |
SpecificRequestor.getDatumReader(Schema writer,
Schema reader) |
protected DatumReader<Object> |
SpecificResponder.getDatumReader(Schema actual,
Schema expected) |
protected DatumWriter<Object> |
SpecificRequestor.getDatumWriter(Schema schema) |
protected DatumWriter<Object> |
SpecificResponder.getDatumWriter(Schema schema) |
Exception |
SpecificRequestor.readError(Schema writer,
Schema reader,
Decoder in) |
Object |
SpecificRequestor.readResponse(Schema writer,
Schema reader,
Decoder in) |
void |
SpecificResponder.writeError(Schema schema,
Object error,
Encoder out) |
void |
SpecificRequestor.writeRequest(Schema schema,
Object request,
Encoder out) |
Modifier and Type | Field and Description |
---|---|
static Schema |
Span.SCHEMA$ |
static Schema |
ID.SCHEMA$ |
static Schema |
TimestampedEvent.SCHEMA$ |
static Schema |
SpanEvent.SCHEMA$ |
Modifier and Type | Method and Description |
---|---|
static Schema |
Span.getClassSchema() |
static Schema |
ID.getClassSchema() |
static Schema |
TimestampedEvent.getClassSchema() |
static Schema |
SpanEvent.getClassSchema() |
Schema |
Span.getSchema() |
Schema |
TimestampedEvent.getSchema() |
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroJob.getInputSchema(org.apache.hadoop.conf.Configuration job)
Return a job's map input schema.
|
static Schema |
Pair.getKeySchema(Schema pair)
Return a pair's key schema.
|
static Schema |
AvroJob.getMapOutputSchema(org.apache.hadoop.conf.Configuration job)
Return a job's map output key schema.
|
static Schema |
AvroJob.getOutputSchema(org.apache.hadoop.conf.Configuration job)
Return a job's output key schema.
|
static Schema |
Pair.getPairSchema(Schema key,
Schema value)
Get a pair schema.
|
Schema |
SequenceFileReader.getSchema() |
Schema |
Pair.getSchema() |
static Schema |
Pair.getValueSchema(Schema pair)
Return a pair's value schema.
|
Modifier and Type | Method and Description |
---|---|
static void |
AvroMultipleOutputs.addMultiNamedOutput(org.apache.hadoop.mapred.JobConf conf,
String namedOutput,
Class<? extends org.apache.hadoop.mapred.OutputFormat> outputFormatClass,
Schema schema)
Adds a multi named output for the job.
|
static void |
AvroMultipleOutputs.addNamedOutput(org.apache.hadoop.mapred.JobConf conf,
String namedOutput,
Class<? extends org.apache.hadoop.mapred.OutputFormat> outputFormatClass,
Schema schema)
Adds a named output for the job.
|
static Schema |
Pair.getKeySchema(Schema pair)
Return a pair's key schema.
|
static Schema |
Pair.getPairSchema(Schema key,
Schema value)
Get a pair schema.
|
static Schema |
Pair.getValueSchema(Schema pair)
Return a pair's value schema.
|
static void |
AvroJob.setInputSchema(org.apache.hadoop.mapred.JobConf job,
Schema s)
Configure a job's map input schema.
|
static void |
AvroJob.setMapOutputSchema(org.apache.hadoop.mapred.JobConf job,
Schema s)
Configure a job's map output schema.
|
static void |
AvroJob.setOutputSchema(org.apache.hadoop.mapred.JobConf job,
Schema s)
Configure a job's output schema.
|
Constructor and Description |
---|
Pair(K key,
Schema keySchema,
V value,
Schema valueSchema) |
Pair(Schema schema) |
Modifier and Type | Field and Description |
---|---|
static Schema |
TaskType.SCHEMA$ |
Modifier and Type | Method and Description |
---|---|
static Schema |
TaskType.getClassSchema() |
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroJob.getInputKeySchema(org.apache.hadoop.conf.Configuration conf)
Gets the job input key schema.
|
static Schema |
AvroJob.getInputValueSchema(org.apache.hadoop.conf.Configuration conf)
Gets the job input value schema.
|
static Schema |
AvroJob.getMapOutputKeySchema(org.apache.hadoop.conf.Configuration conf)
Gets the map output key schema.
|
static Schema |
AvroJob.getMapOutputValueSchema(org.apache.hadoop.conf.Configuration conf)
Gets the map output value schema.
|
static Schema |
AvroJob.getOutputKeySchema(org.apache.hadoop.conf.Configuration conf)
Gets the job output key schema.
|
static Schema |
AvroJob.getOutputValueSchema(org.apache.hadoop.conf.Configuration conf)
Gets the job output value schema.
|
Schema |
AvroKeyValueRecordWriter.getWriterSchema()
Gets the writer schema for the key/value pair generic record.
|
Modifier and Type | Method and Description |
---|---|
static void |
AvroMultipleOutputs.addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String namedOutput,
Class<? extends org.apache.hadoop.mapreduce.OutputFormat> outputFormatClass,
Schema keySchema)
Adds a named output for the job.
|
static void |
AvroMultipleOutputs.addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String namedOutput,
Class<? extends org.apache.hadoop.mapreduce.OutputFormat> outputFormatClass,
Schema keySchema,
Schema valueSchema)
Adds a named output for the job.
|
protected org.apache.hadoop.mapreduce.RecordWriter<AvroKey<T>,org.apache.hadoop.io.NullWritable> |
AvroKeyOutputFormat.RecordWriterFactory.create(Schema writerSchema,
CodecFactory compressionCodec,
OutputStream outputStream)
Creates a new record writer instance.
|
static void |
AvroJob.setInputKeySchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job input key schema.
|
static void |
AvroJob.setInputValueSchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job input value schema.
|
static void |
AvroJob.setMapOutputKeySchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the map output key schema.
|
static void |
AvroJob.setMapOutputValueSchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the map output value schema.
|
static void |
AvroJob.setOutputKeySchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job output key schema.
|
static void |
AvroJob.setOutputValueSchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job output value schema.
|
void |
AvroMultipleOutputs.write(Object key,
Object value,
Schema keySchema,
Schema valSchema,
String baseOutputPath)
Write key value to an output file name.
|
Constructor and Description |
---|
AvroKeyRecordReader(Schema readerSchema)
Constructor.
|
AvroKeyRecordWriter(Schema writerSchema,
CodecFactory compressionCodec,
OutputStream outputStream)
Constructor.
|
AvroKeyValueRecordReader(Schema keyReaderSchema,
Schema valueReaderSchema)
Constructor.
|
AvroRecordReaderBase(Schema readerSchema)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
ProtobufData.getRecordSchema(Object record) |
Schema |
ProtobufData.getSchema(Class c)
Return a record schema given a protobuf message class.
|
Modifier and Type | Method and Description |
---|---|
DatumReader |
ProtobufData.createDatumReader(Schema schema) |
protected Object |
ProtobufDatumReader.createEnum(String symbol,
Schema schema) |
protected Object |
ProtobufData.getRecordState(Object r,
Schema s) |
Object |
ProtobufData.newRecord(Object old,
Schema schema) |
protected Object |
ProtobufDatumReader.readRecord(Object old,
Schema expected,
ResolvingDecoder in) |
protected void |
ProtobufDatumWriter.writeEnum(Schema schema,
Object datum,
Encoder out) |
Constructor and Description |
---|
ProtobufDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
ProtobufDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
ProtobufDatumReader(Schema writer,
Schema reader,
ProtobufData data) |
ProtobufDatumWriter(Schema schema) |
ProtobufDatumWriter(Schema root,
ProtobufData protobufData) |
Modifier and Type | Method and Description |
---|---|
protected Schema |
ReflectData.createFieldSchema(Field field,
Map<String,Schema> names)
Create a schema for a field.
|
protected Schema |
ReflectData.AllowNull.createFieldSchema(Field field,
Map<String,Schema> names) |
protected Schema |
ReflectData.createSchema(Type type,
Map<String,Schema> names) |
protected Schema |
ReflectData.getRecordSchema(Object record) |
static Schema |
ReflectData.makeNullable(Schema schema)
Create and return a union of the null schema and the provided schema.
|
Modifier and Type | Method and Description |
---|---|
protected int |
ReflectData.compare(Object o1,
Object o2,
Schema s,
boolean equals) |
DatumReader |
ReflectData.createDatumReader(Schema schema) |
Class |
ReflectData.getClass(Schema schema) |
static Schema |
ReflectData.makeNullable(Schema schema)
Create and return a union of the null schema and the provided schema.
|
protected Object |
ReflectDatumReader.newArray(Object old,
int size,
Schema schema) |
protected Object |
ReflectDatumReader.readBytes(Object old,
Schema s,
Decoder in) |
protected Object |
ReflectDatumReader.readInt(Object old,
Schema expected,
Decoder in) |
protected Object |
ReflectDatumReader.readMapKey(Object old,
Schema s,
Decoder in) |
protected Object |
ReflectDatumReader.readString(Object old,
Schema s,
Decoder in) |
boolean |
ReflectData.validate(Schema schema,
Object datum) |
protected void |
ReflectDatumWriter.write(Schema schema,
Object datum,
Encoder out) |
protected void |
ReflectDatumWriter.writeString(Schema schema,
Object datum,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
protected Schema |
ReflectData.createFieldSchema(Field field,
Map<String,Schema> names)
Create a schema for a field.
|
protected Schema |
ReflectData.AllowNull.createFieldSchema(Field field,
Map<String,Schema> names) |
protected Schema |
ReflectData.createSchema(Type type,
Map<String,Schema> names) |
Constructor and Description |
---|
ReflectDatumReader(Schema root)
Construct where the writer's and reader's schemas are the same.
|
ReflectDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
ReflectDatumReader(Schema writer,
Schema reader,
ReflectData data)
Construct given writer's and reader's schema and the data model.
|
ReflectDatumWriter(Schema root) |
ReflectDatumWriter(Schema root,
ReflectData reflectData) |
Modifier and Type | Method and Description |
---|---|
protected Schema |
SpecificData.createSchema(Type type,
Map<String,Schema> names)
Create the schema for a Java type.
|
protected Schema |
SpecificData.getEnumSchema(Object datum) |
abstract Schema |
SpecificRecordBase.getSchema() |
abstract Schema |
SpecificExceptionBase.getSchema() |
Schema |
SpecificData.getSchema(Type type)
Find the schema for a Java type.
|
Modifier and Type | Method and Description |
---|---|
protected int |
SpecificData.compare(Object o1,
Object o2,
Schema s,
boolean eq) |
DatumReader |
SpecificData.createDatumReader(Schema schema) |
protected Object |
SpecificDatumReader.createEnum(String symbol,
Schema schema) |
Object |
SpecificData.createFixed(Object old,
Schema schema) |
Class |
SpecificData.getClass(Schema schema)
Return the class that implements a schema, or null if none exists.
|
static String |
SpecificData.getClassName(Schema schema)
Returns the Java class name indicated by a schema's name and namespace.
|
static Object |
SpecificData.newInstance(Class c,
Schema s)
Create an instance of a class.
|
Object |
SpecificData.newRecord(Object old,
Schema schema) |
void |
SpecificDatumReader.setSchema(Schema actual) |
protected void |
SpecificDatumWriter.writeEnum(Schema schema,
Object datum,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
protected Schema |
SpecificData.createSchema(Type type,
Map<String,Schema> names)
Create the schema for a Java type.
|
Constructor and Description |
---|
SpecificDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
SpecificDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
SpecificDatumReader(Schema writer,
Schema reader,
SpecificData data)
Construct given writer's schema, reader's schema, and a
SpecificData . |
SpecificDatumWriter(Schema schema) |
SpecificDatumWriter(Schema root,
SpecificData specificData) |
SpecificErrorBuilderBase(Schema schema)
Creates a SpecificErrorBuilderBase for building errors of the given type.
|
SpecificRecordBuilderBase(Schema schema)
Creates a SpecificRecordBuilderBase for building records of the given type.
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
ThriftData.getEnumSchema(Object datum) |
protected Schema |
ThriftData.getRecordSchema(Object record) |
Schema |
ThriftData.getSchema(Class c)
Return a record schema given a thrift generated class.
|
Modifier and Type | Method and Description |
---|---|
DatumReader |
ThriftData.createDatumReader(Schema schema) |
protected Object |
ThriftDatumReader.createEnum(String symbol,
Schema schema) |
protected Object |
ThriftData.getRecordState(Object r,
Schema s) |
protected Object |
ThriftDatumReader.newArray(Object old,
int size,
Schema schema) |
Object |
ThriftData.newRecord(Object old,
Schema schema) |
protected Object |
ThriftDatumReader.readInt(Object old,
Schema s,
Decoder in) |
Constructor and Description |
---|
ThriftDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
ThriftDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
ThriftDatumReader(Schema writer,
Schema reader,
ThriftData data) |
ThriftDatumWriter(Schema schema) |
ThriftDatumWriter(Schema root,
ThriftData thriftData) |
Modifier and Type | Method and Description |
---|---|
Schema |
AvroColumnReader.getFileSchema()
Return the schema for data in this file.
|
Modifier and Type | Method and Description |
---|---|
AvroColumnReader.Params |
AvroColumnReader.Params.setSchema(Schema schema)
Set subset schema to project data down to.
|
Constructor and Description |
---|
AvroColumnWriter(Schema s,
ColumnFileMetaData meta) |
AvroColumnWriter(Schema s,
ColumnFileMetaData meta,
GenericData model) |
Modifier and Type | Field and Description |
---|---|
protected Schema |
AvroTrevniRecordWriterBase.schema
Provided avro schema from the context
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
AvroTrevniKeyValueRecordWriter.initSchema(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Use the task context to construct a schema for writing
|
protected abstract Schema |
AvroTrevniRecordWriterBase.initSchema(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Use the task context to construct a schema for writing
|
protected Schema |
AvroTrevniKeyRecordWriter.initSchema(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Use the task context to construct a schema for writing
|
Copyright © 2009-2013 The Apache Software Foundation. All Rights Reserved.