Package | Description |
---|---|
org.apache.avro |
Avro kernel classes.
|
org.apache.avro.codegentest | |
org.apache.avro.compiler.schema | |
org.apache.avro.compiler.specific | |
org.apache.avro.data |
Interfaces and base classes shared by generic, specific and reflect.
|
org.apache.avro.file |
A container file for Avro data.
|
org.apache.avro.generic |
A generic representation for Avro data.
|
org.apache.avro.hadoop.file | |
org.apache.avro.hadoop.io | |
org.apache.avro.io |
Utilities for Encoding and Decoding Avro data.
|
org.apache.avro.io.parsing |
Implementation of Avro schemas as LL(1) grammars.
|
org.apache.avro.ipc |
Support for inter-process calls.
|
org.apache.avro.ipc.generic | |
org.apache.avro.ipc.reflect | |
org.apache.avro.ipc.specific | |
org.apache.avro.mapred |
Run Hadoop MapReduce jobs over
Avro data, with map and reduce functions written in Java.
|
org.apache.avro.mapred.tether |
Run Hadoop MapReduce jobs over
Avro data, with map and reduce functions run in a sub-process.
|
org.apache.avro.mapreduce | |
org.apache.avro.message | |
org.apache.avro.protobuf |
Protocol Buffer
compatibility.
|
org.apache.avro.reflect |
Use Java reflection to generate schemas and protocols for existing
classes.
|
org.apache.avro.specific |
Generate specific Java classes for schemas and protocols.
|
org.apache.avro.thrift |
Thrift compatibility.
|
org.apache.avro.util |
Common utility classes.
|
org.apache.trevni.avro |
Read and write Avro data
in Trevni column files.
|
org.apache.trevni.avro.mapreduce |
Modifier and Type | Field and Description |
---|---|
Schema |
Resolver.Action.reader |
static Schema |
Protocol.SYSTEM_ERROR
An error that can be thrown by any message.
|
static Schema |
Protocol.SYSTEM_ERRORS
Union type for generating system errors.
|
Schema |
Resolver.Action.writer |
Modifier and Type | Method and Description |
---|---|
Schema |
LogicalTypes.Decimal.addToSchema(Schema schema) |
Schema |
LogicalType.addToSchema(Schema schema)
Add this logical type to the given Schema.
|
static Schema |
Schema.applyAliases(Schema writer,
Schema reader)
Rewrite a writer's schema using the aliases from a reader's schema.
|
static Schema |
Schema.create(Schema.Type type)
Create a schema for a primitive type.
|
static Schema |
Schema.createArray(Schema elementType)
Create an array schema.
|
static Schema |
Schema.createEnum(String name,
String doc,
String namespace,
List<String> values)
Create an enum schema.
|
static Schema |
Schema.createEnum(String name,
String doc,
String namespace,
List<String> values,
String enumDefault)
Create an enum schema.
|
static Schema |
Schema.createFixed(String name,
String doc,
String space,
int size)
Create a union schema.
|
static Schema |
Schema.createMap(Schema valueType)
Create a map schema.
|
static Schema |
Schema.createRecord(List<Schema.Field> fields)
Deprecated.
This method allows to create Schema objects that cannot be parsed
by
Schema.Parser.parse(String) . It will be removed in a
future version of Avro. Better use
icreateRecord(String, String, String, boolean, List) to
produce a fully qualified Schema. |
static Schema |
Schema.createRecord(String name,
String doc,
String namespace,
boolean isError)
Create a named record schema.
|
static Schema |
Schema.createRecord(String name,
String doc,
String namespace,
boolean isError,
List<Schema.Field> fields)
Create a named record schema with fields already set.
|
static Schema |
Schema.createUnion(List<Schema> types)
Create a union schema.
|
static Schema |
Schema.createUnion(Schema... types)
Create a union schema.
|
Schema |
Schema.getElementType()
If this is an array, returns its element type.
|
Schema |
Protocol.Message.getErrors()
Errors that might be thrown.
|
Schema |
SchemaCompatibility.SchemaPairCompatibility.getReader()
Gets the reader schema that was validated.
|
Schema |
SchemaCompatibility.Incompatibility.getReaderFragment()
Returns the fragment of the reader schema that failed compatibility check.
|
Schema |
Conversions.UUIDConversion.getRecommendedSchema() |
Schema |
Conversions.DecimalConversion.getRecommendedSchema() |
Schema |
Conversion.getRecommendedSchema() |
Schema |
Protocol.Message.getRequest()
The parameters of this message.
|
Schema |
Protocol.Message.getResponse()
The returned data.
|
Schema |
Protocol.getType(String name)
Returns the named type.
|
Schema |
UnresolvedUnionException.getUnionSchema() |
Schema |
Schema.getValueType()
If this is a map, returns its value type.
|
Schema |
SchemaCompatibility.SchemaPairCompatibility.getWriter()
Gets the writer schema that was validated.
|
Schema |
SchemaCompatibility.Incompatibility.getWriterFragment()
Returns the fragment of the writer schema that failed compatibility check.
|
static Schema |
Schema.parse(File file)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Parser.parse(File file)
Parse a schema from the provided file.
|
static Schema |
Schema.parse(InputStream in)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Parser.parse(InputStream in)
Parse a schema from the provided stream.
|
static Schema |
Schema.parse(String jsonSchema)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Parser.parse(String s)
Parse a schema from the provided string.
|
static Schema |
Schema.parse(String jsonSchema,
boolean validate)
Deprecated.
use
Schema.Parser instead. |
Schema |
Schema.Parser.parse(String s,
String... more)
Read a schema from one or more json strings
|
Schema |
Schema.Field.schema()
This field's
Schema . |
Modifier and Type | Method and Description |
---|---|
static SchemaBuilder.ArrayBuilder<Schema> |
SchemaBuilder.array()
Create a builder for an Avro array This is equivalent to:
|
static SchemaBuilder.TypeBuilder<Schema> |
SchemaBuilder.builder()
Create a builder for Avro schemas.
|
static SchemaBuilder.TypeBuilder<Schema> |
SchemaBuilder.builder(String namespace)
Create a builder for Avro schemas with a default namespace.
|
static SchemaBuilder.EnumBuilder<Schema> |
SchemaBuilder.enumeration(String name)
Create a builder for an Avro enum with the specified name and symbols
(values).
|
static SchemaBuilder.FixedBuilder<Schema> |
SchemaBuilder.fixed(String name)
Create a builder for an Avro fixed type with the specified name and size.
|
List<Schema> |
Schema.getTypes()
If this is a union, returns its types.
|
Map<String,Schema> |
Schema.Parser.getTypes()
Returns the set of defined, named types known to this parser.
|
Collection<Schema> |
Protocol.getTypes()
The types of this protocol.
|
static SchemaBuilder.MapBuilder<Schema> |
SchemaBuilder.map()
Create a builder for an Avro map This is equivalent to:
|
static SchemaBuilder.BaseTypeBuilder<Schema> |
SchemaBuilder.nullable()
Create a builder for a union of a type and null.
|
static SchemaBuilder.RecordBuilder<Schema> |
SchemaBuilder.record(String name)
Create a builder for an Avro record with the specified name.
|
static SchemaBuilder.BaseTypeBuilder<SchemaBuilder.UnionAccumulator<Schema>> |
SchemaBuilder.unionOf()
Create a builder for an Avro union This is equivalent to:
|
Modifier and Type | Method and Description |
---|---|
Schema |
LogicalTypes.Decimal.addToSchema(Schema schema) |
Schema |
LogicalType.addToSchema(Schema schema)
Add this logical type to the given Schema.
|
static Schema |
Schema.applyAliases(Schema writer,
Schema reader)
Rewrite a writer's schema using the aliases from a reader's schema.
|
static SchemaCompatibility.SchemaPairCompatibility |
SchemaCompatibility.checkReaderWriterCompatibility(Schema reader,
Schema writer)
Validates that the provided reader schema can be used to decode avro data
written with the provided writer schema.
|
static Object |
Conversions.convertToLogicalType(Object datum,
Schema schema,
LogicalType type,
Conversion<?> conversion)
Convert a underlying representation of a logical type (such as a ByteBuffer)
to a higher level object (such as a BigDecimal).
|
static <T> Object |
Conversions.convertToRawType(Object datum,
Schema schema,
LogicalType type,
Conversion<T> conversion)
Convert a high level representation of a logical type (such as a BigDecimal)
to the its underlying representation object (such as a ByteBuffer)
|
static Schema |
Schema.createArray(Schema elementType)
Create an array schema.
|
static Schema |
Schema.createMap(Schema valueType)
Create a map schema.
|
Protocol.Message |
Protocol.createMessage(Protocol.Message m,
Schema request)
Create a one-way message using the
name , doc , and
props of m . |
Protocol.Message |
Protocol.createMessage(Protocol.Message m,
Schema request,
Schema response,
Schema errors)
Create a two-way message using the
name , doc , and
props of m . |
<T> Protocol.Message |
Protocol.createMessage(String name,
String doc,
JsonProperties propMap,
Schema request)
Create a one-way message.
|
<T> Protocol.Message |
Protocol.createMessage(String name,
String doc,
JsonProperties propMap,
Schema request,
Schema response,
Schema errors)
Create a two-way message.
|
<T> Protocol.Message |
Protocol.createMessage(String name,
String doc,
Map<String,?> propMap,
Schema request)
Create a one-way message.
|
<T> Protocol.Message |
Protocol.createMessage(String name,
String doc,
Map<String,?> propMap,
Schema request,
Schema response,
Schema errors)
Create a two-way message.
|
Protocol.Message |
Protocol.createMessage(String name,
String doc,
Schema request)
Deprecated.
|
Protocol.Message |
Protocol.createMessage(String name,
String doc,
Schema request,
Schema response,
Schema errors)
Deprecated.
|
static Schema |
Schema.createUnion(Schema... types)
Create a union schema.
|
T |
Conversion.fromArray(Collection<?> value,
Schema schema,
LogicalType type) |
T |
Conversion.fromBoolean(Boolean value,
Schema schema,
LogicalType type) |
BigDecimal |
Conversions.DecimalConversion.fromBytes(ByteBuffer value,
Schema schema,
LogicalType type) |
T |
Conversion.fromBytes(ByteBuffer value,
Schema schema,
LogicalType type) |
UUID |
Conversions.UUIDConversion.fromCharSequence(CharSequence value,
Schema schema,
LogicalType type) |
T |
Conversion.fromCharSequence(CharSequence value,
Schema schema,
LogicalType type) |
T |
Conversion.fromDouble(Double value,
Schema schema,
LogicalType type) |
T |
Conversion.fromEnumSymbol(GenericEnumSymbol value,
Schema schema,
LogicalType type) |
BigDecimal |
Conversions.DecimalConversion.fromFixed(GenericFixed value,
Schema schema,
LogicalType type) |
T |
Conversion.fromFixed(GenericFixed value,
Schema schema,
LogicalType type) |
T |
Conversion.fromFloat(Float value,
Schema schema,
LogicalType type) |
T |
Conversion.fromInt(Integer value,
Schema schema,
LogicalType type) |
T |
Conversion.fromLong(Long value,
Schema schema,
LogicalType type) |
T |
Conversion.fromMap(Map<?,?> value,
Schema schema,
LogicalType type) |
T |
Conversion.fromRecord(IndexedRecord value,
Schema schema,
LogicalType type) |
static LogicalType |
LogicalTypes.fromSchema(Schema schema)
Returns the
LogicalType from the schema, if one is present. |
LogicalType |
LogicalTypes.LogicalTypeFactory.fromSchema(Schema schema) |
static LogicalType |
LogicalTypes.fromSchemaIgnoreInvalid(Schema schema) |
static SchemaCompatibility.SchemaCompatibilityResult |
SchemaCompatibility.SchemaCompatibilityResult.incompatible(SchemaCompatibility.SchemaIncompatibilityType incompatibilityType,
Schema readerFragment,
Schema writerFragment,
String message,
List<String> location)
Returns a details object representing an incompatible schema pair, including
error details.
|
static boolean |
Resolver.Promote.isValid(Schema w,
Schema r)
Returns true iff w and r are both primitive types and
either they are the same type or w is promotable to r.
|
R |
SchemaBuilder.ArrayBuilder.items(Schema itemsSchema)
Complete configuration of this array, setting the schema of the array items
to the schema provided.
|
static Schema.Field |
SchemaCompatibility.lookupWriterField(Schema writerSchema,
Schema.Field readerField)
Identifies the writer field that corresponds to the specified reader field.
|
static byte[] |
SchemaNormalization.parsingFingerprint(String fpName,
Schema s)
Returns
SchemaNormalization.fingerprint(java.lang.String, byte[]) applied to the parsing canonical form of the
supplied schema. |
static long |
SchemaNormalization.parsingFingerprint64(Schema s)
Returns
SchemaNormalization.fingerprint64(byte[]) applied to the parsing canonical form of the
supplied schema. |
static Resolver.Action |
Resolver.resolve(Schema writer,
Schema reader)
Uses GenericData.get() for the data param.
|
static Resolver.Action |
Resolver.resolve(Schema writer,
Schema reader,
GenericData data)
Returns a
Resolver.Action tree for resolving the writer schema
writer and the reader schema reader. |
static Resolver.Action |
Resolver.Promote.resolve(Schema w,
Schema r,
GenericData d)
Return a promotion.
|
static Resolver.Action |
Resolver.EnumAdjust.resolve(Schema w,
Schema r,
GenericData d)
If writer and reader don't have same name, a
Resolver.ErrorAction.ErrorType.NAMES_DONT_MATCH is returned, otherwise an
appropriate Resolver.EnumAdjust is. |
static Resolver.Action |
Resolver.WriterUnion.resolve(Schema writeSchema,
Schema readSchema,
GenericData data,
Map<Schema.SeenPair,Resolver.Action> seen) |
static Resolver.Action |
Resolver.ReaderUnion.resolve(Schema w,
Schema r,
GenericData d,
Map<Schema.SeenPair,Resolver.Action> seen)
Returns a
Resolver.ReaderUnion action for resolving w and r,
or an Resolver.ErrorAction if there is no branch in the reader that matches
the writer. |
static boolean |
SchemaCompatibility.schemaNameEquals(Schema reader,
Schema writer)
Tests the equality of two Avro named schemas.
|
Collection<?> |
Conversion.toArray(T value,
Schema schema,
LogicalType type) |
Boolean |
Conversion.toBoolean(T value,
Schema schema,
LogicalType type) |
ByteBuffer |
Conversions.DecimalConversion.toBytes(BigDecimal value,
Schema schema,
LogicalType type) |
ByteBuffer |
Conversion.toBytes(T value,
Schema schema,
LogicalType type) |
CharSequence |
Conversion.toCharSequence(T value,
Schema schema,
LogicalType type) |
CharSequence |
Conversions.UUIDConversion.toCharSequence(UUID value,
Schema schema,
LogicalType type) |
Double |
Conversion.toDouble(T value,
Schema schema,
LogicalType type) |
GenericEnumSymbol |
Conversion.toEnumSymbol(T value,
Schema schema,
LogicalType type) |
GenericFixed |
Conversions.DecimalConversion.toFixed(BigDecimal value,
Schema schema,
LogicalType type) |
GenericFixed |
Conversion.toFixed(T value,
Schema schema,
LogicalType type) |
Float |
Conversion.toFloat(T value,
Schema schema,
LogicalType type) |
Integer |
Conversion.toInt(T value,
Schema schema,
LogicalType type) |
Long |
Conversion.toLong(T value,
Schema schema,
LogicalType type) |
Map<?,?> |
Conversion.toMap(T value,
Schema schema,
LogicalType type) |
static String |
SchemaNormalization.toParsingForm(Schema s)
Returns "Parsing Canonical Form" of a schema as defined by Avro spec.
|
IndexedRecord |
Conversion.toRecord(T value,
Schema schema,
LogicalType type) |
R |
SchemaBuilder.BaseTypeBuilder.type(Schema schema)
Use the schema provided as the type.
|
SchemaBuilder.GenericDefault<R> |
SchemaBuilder.FieldBuilder.type(Schema type)
Final step in configuring this field, finalizing name, namespace, alias, and
order.
|
void |
LogicalTypes.Decimal.validate(Schema schema) |
void |
LogicalTypes.Date.validate(Schema schema) |
void |
LogicalTypes.TimeMillis.validate(Schema schema) |
void |
LogicalTypes.TimeMicros.validate(Schema schema) |
void |
LogicalTypes.TimestampMillis.validate(Schema schema) |
void |
LogicalTypes.TimestampMicros.validate(Schema schema) |
void |
LogicalType.validate(Schema schema)
Validate this logical type for the given Schema.
|
void |
ValidateLatest.validate(Schema toValidate,
Iterable<Schema> schemasInOrder) |
void |
ValidateAll.validate(Schema toValidate,
Iterable<Schema> schemasInOrder) |
void |
SchemaValidator.validate(Schema toValidate,
Iterable<Schema> existing)
Validate one schema against others.
|
void |
SchemaValidationStrategy.validate(Schema toValidate,
Schema existing)
Validates that one schema is compatible with another.
|
R |
SchemaBuilder.MapBuilder.values(Schema valueSchema)
Complete configuration of this map, setting the schema of the map values to
the schema provided.
|
Modifier and Type | Method and Description |
---|---|
Schema.Parser |
Schema.Parser.addTypes(Map<String,Schema> types)
Adds the provided types to the set of defined, named types known to this
parser.
|
static Schema |
Schema.createUnion(List<Schema> types)
Create a union schema.
|
void |
Protocol.setTypes(Collection<Schema> newTypes)
Set the types of this protocol.
|
void |
ValidateLatest.validate(Schema toValidate,
Iterable<Schema> schemasInOrder) |
void |
ValidateAll.validate(Schema toValidate,
Iterable<Schema> schemasInOrder) |
void |
SchemaValidator.validate(Schema toValidate,
Iterable<Schema> existing)
Validate one schema against others.
|
Modifier and Type | Method and Description |
---|---|
CustomDecimal |
CustomDecimalConversion.fromBytes(ByteBuffer value,
Schema schema,
LogicalType type) |
ByteBuffer |
CustomDecimalConversion.toBytes(CustomDecimal value,
Schema schema,
LogicalType type) |
Modifier and Type | Method and Description |
---|---|
Schema |
CloningVisitor.get() |
Modifier and Type | Method and Description |
---|---|
SchemaVisitorAction |
SchemaVisitor.afterVisitNonTerminal(Schema nonTerminal)
Invoked for schemas with children after its children have been visited.
|
SchemaVisitorAction |
CloningVisitor.afterVisitNonTerminal(Schema nt) |
void |
CloningVisitor.PropertyCopier.copy(Schema first,
Schema second) |
static void |
Schemas.copyAliases(Schema from,
Schema to) |
static void |
Schemas.copyLogicalTypes(Schema from,
Schema to) |
static String |
Schemas.getJavaClassName(Schema schema) |
static boolean |
Schemas.hasGeneratedJavaClass(Schema schema) |
static <T> T |
Schemas.visit(Schema start,
SchemaVisitor<T> visitor)
depth first visit.
|
SchemaVisitorAction |
SchemaVisitor.visitNonTerminal(Schema nonTerminal)
Invoked for schema with children before proceeding to visit the children.
|
SchemaVisitorAction |
CloningVisitor.visitNonTerminal(Schema nt) |
SchemaVisitorAction |
SchemaVisitor.visitTerminal(Schema terminal)
Invoked for schemas that do not have "child" schemas (like string, int ...)
or for a previously encountered schema with children, which will be treated
as a terminal.
|
SchemaVisitorAction |
CloningVisitor.visitTerminal(Schema terminal) |
Constructor and Description |
---|
CloningVisitor(CloningVisitor.PropertyCopier copyProperties,
boolean copyDocs,
Schema root) |
CloningVisitor(Schema root)
copy only serialization necessary fields.
|
Modifier and Type | Method and Description |
---|---|
protected int |
SpecificCompiler.calcAllArgConstructorParameterUnits(Schema record)
Returns the number of parameter units required by fields for the
AllArgsConstructor.
|
String |
SpecificCompiler.conversionInstance(Schema schema) |
static long |
SpecificCompiler.fingerprint64(Schema schema)
Utility for use by templates.
|
static String |
SpecificCompiler.generateClearMethod(Schema schema,
Schema.Field field)
Generates the name of a field "clear" method.
|
static String |
SpecificCompiler.generateGetBuilderMethod(Schema schema,
Schema.Field field)
Generates the name of a field Builder accessor method.
|
static String |
SpecificCompiler.generateGetMethod(Schema schema,
Schema.Field field)
Generates the name of a field accessor method.
|
static String |
SpecificCompiler.generateGetOptionalMethod(Schema schema,
Schema.Field field)
Generates the name of a field accessor method that returns a Java 8 Optional.
|
static String |
SpecificCompiler.generateHasBuilderMethod(Schema schema,
Schema.Field field)
Generates the name of a field Builder "has" method.
|
static String |
SpecificCompiler.generateHasMethod(Schema schema,
Schema.Field field)
Generates the name of a field "has" method.
|
static String |
SpecificCompiler.generateSetBuilderMethod(Schema schema,
Schema.Field field)
Generates the name of a field Builder mutator method.
|
static String |
SpecificCompiler.generateSetMethod(Schema schema,
Schema.Field field)
Generates the name of a field mutator method.
|
String |
SpecificCompiler.generateSetterCode(Schema schema,
String name,
String pname)
Utility for template use.
|
int |
SpecificCompiler.getNonNullIndex(Schema s)
Utility for template use.
|
String |
SpecificCompiler.getStringType(Schema s)
Utility for template use (and also internal use).
|
Collection<String> |
SpecificCompiler.getUsedConversionClasses(Schema schema) |
static boolean |
SpecificCompiler.hasBuilder(Schema schema)
Utility for use by templates.
|
boolean |
SpecificCompiler.hasLogicalTypeField(Schema schema) |
boolean |
SpecificCompiler.isCustomCodable(Schema schema)
Utility for template use.
|
boolean |
SpecificCompiler.isStringable(Schema schema)
Utility for template use.
|
static boolean |
SpecificCompiler.isUnboxedJavaTypeNullable(Schema schema)
Tests whether an unboxed Java type can be set to null
|
String |
SpecificCompiler.javaType(Schema schema)
Utility for template use.
|
String |
SpecificCompiler.javaUnbox(Schema schema)
Utility for template use.
|
String |
SpecificCompiler.javaUnbox(Schema schema,
boolean unboxNullToVoid)
Utility for template use.
|
protected void |
SpecificCompiler.validateRecordForCompilation(Schema record) |
Constructor and Description |
---|
SpecificCompiler(Schema schema) |
SpecificCompiler(Schema schema,
SpecificCompiler.DateTimeLogicalTypeImplementation dateTimeLogicalTypeImplementation) |
Modifier and Type | Field and Description |
---|---|
static Schema |
Json.SCHEMA
The schema for Json data.
|
Modifier and Type | Method and Description |
---|---|
Schema |
TimeConversions.DateConversion.getRecommendedSchema() |
Schema |
TimeConversions.TimeMillisConversion.getRecommendedSchema() |
Schema |
TimeConversions.TimeMicrosConversion.getRecommendedSchema() |
Schema |
TimeConversions.TimestampMillisConversion.getRecommendedSchema() |
Schema |
TimeConversions.TimestampMicrosConversion.getRecommendedSchema() |
Schema |
JodaTimeConversions.DateConversion.getRecommendedSchema() |
Schema |
JodaTimeConversions.TimeConversion.getRecommendedSchema() |
Schema |
JodaTimeConversions.TimeMicrosConversion.getRecommendedSchema() |
Schema |
JodaTimeConversions.TimestampConversion.getRecommendedSchema() |
Schema |
JodaTimeConversions.TimestampMicrosConversion.getRecommendedSchema() |
protected Schema |
RecordBuilderBase.schema() |
Modifier and Type | Method and Description |
---|---|
LocalDate |
TimeConversions.DateConversion.fromInt(Integer daysFromEpoch,
Schema schema,
LogicalType type) |
LocalTime |
TimeConversions.TimeMillisConversion.fromInt(Integer millisFromMidnight,
Schema schema,
LogicalType type) |
org.joda.time.LocalDate |
JodaTimeConversions.DateConversion.fromInt(Integer daysFromEpoch,
Schema schema,
LogicalType type) |
org.joda.time.LocalTime |
JodaTimeConversions.TimeConversion.fromInt(Integer millisFromMidnight,
Schema schema,
LogicalType type) |
LocalTime |
TimeConversions.TimeMicrosConversion.fromLong(Long microsFromMidnight,
Schema schema,
LogicalType type) |
Instant |
TimeConversions.TimestampMillisConversion.fromLong(Long millisFromEpoch,
Schema schema,
LogicalType type) |
Instant |
TimeConversions.TimestampMicrosConversion.fromLong(Long microsFromEpoch,
Schema schema,
LogicalType type) |
org.joda.time.LocalTime |
JodaTimeConversions.TimeMicrosConversion.fromLong(Long microsFromMidnight,
Schema schema,
LogicalType type) |
org.joda.time.DateTime |
JodaTimeConversions.TimestampConversion.fromLong(Long millisFromEpoch,
Schema schema,
LogicalType type) |
org.joda.time.DateTime |
JodaTimeConversions.TimestampMicrosConversion.fromLong(Long microsFromEpoch,
Schema schema,
LogicalType type) |
void |
Json.ObjectWriter.setSchema(Schema schema) |
void |
Json.ObjectReader.setSchema(Schema schema) |
Integer |
TimeConversions.DateConversion.toInt(LocalDate date,
Schema schema,
LogicalType type) |
Integer |
JodaTimeConversions.DateConversion.toInt(org.joda.time.LocalDate date,
Schema schema,
LogicalType type) |
Integer |
TimeConversions.TimeMillisConversion.toInt(LocalTime time,
Schema schema,
LogicalType type) |
Integer |
JodaTimeConversions.TimeConversion.toInt(org.joda.time.LocalTime time,
Schema schema,
LogicalType type) |
Long |
JodaTimeConversions.TimestampConversion.toLong(org.joda.time.DateTime timestamp,
Schema schema,
LogicalType type) |
Long |
JodaTimeConversions.LossyTimestampMicrosConversion.toLong(org.joda.time.DateTime timestamp,
Schema schema,
LogicalType type) |
Long |
TimeConversions.TimestampMillisConversion.toLong(Instant timestamp,
Schema schema,
LogicalType type) |
Long |
TimeConversions.TimestampMicrosConversion.toLong(Instant instant,
Schema schema,
LogicalType type) |
Long |
TimeConversions.TimeMicrosConversion.toLong(LocalTime time,
Schema schema,
LogicalType type) |
Long |
JodaTimeConversions.LossyTimeMicrosConversion.toLong(org.joda.time.LocalTime time,
Schema schema,
LogicalType type) |
Constructor and Description |
---|
RecordBuilderBase(Schema schema,
GenericData data)
Creates a RecordBuilderBase for building records of the given type.
|
Modifier and Type | Method and Description |
---|---|
Schema |
FileReader.getSchema()
Return the schema for data in this file.
|
Schema |
DataFileStream.getSchema()
Return the schema used in this file.
|
Schema |
DataFileReader12.getSchema()
Return the schema used in this file.
|
Modifier and Type | Method and Description |
---|---|
DataFileWriter<D> |
DataFileWriter.create(Schema schema,
File file)
Open a new file for data matching a schema with a random sync.
|
DataFileWriter<D> |
DataFileWriter.create(Schema schema,
OutputStream outs)
Open a new file for data matching a schema with a random sync.
|
DataFileWriter<D> |
DataFileWriter.create(Schema schema,
OutputStream outs,
byte[] sync)
Open a new file for data matching a schema with an explicit sync.
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
GenericData.getEnumSchema(Object enu)
Called to obtain the schema of a enum.
|
Schema |
GenericDatumReader.getExpected()
Get the reader's schema.
|
protected Schema |
GenericData.getFixedSchema(Object fixed)
Called to obtain the schema of a fixed.
|
protected Schema |
GenericData.getRecordSchema(Object record)
Called to obtain the schema of a record.
|
Schema |
GenericDatumReader.getSchema()
Return the writer's schema.
|
Schema |
GenericData.Record.getSchema() |
Schema |
GenericData.Array.getSchema() |
Schema |
GenericData.Fixed.getSchema() |
Schema |
GenericData.EnumSymbol.getSchema() |
Schema |
GenericContainer.getSchema()
The schema of this instance.
|
Schema |
GenericData.induce(Object datum)
Create a schema given an example datum.
|
Modifier and Type | Method and Description |
---|---|
int |
GenericData.compare(Object o1,
Object o2,
Schema s)
Compare objects according to their schema.
|
protected int |
GenericData.compare(Object o1,
Object o2,
Schema s,
boolean equals)
Comparison implementation.
|
protected Object |
GenericDatumReader.convert(Object datum,
Schema schema,
LogicalType type,
Conversion<?> conversion)
Convert a underlying representation of a logical type (such as a ByteBuffer)
to a higher level object (such as a BigDecimal).
|
protected <T> Object |
GenericDatumWriter.convert(Schema schema,
LogicalType logicalType,
Conversion<T> conversion,
Object datum)
Convert a high level representation of a logical type (such as a BigDecimal)
to the its underlying representation object (such as a ByteBuffer).
|
DatumReader |
GenericData.createDatumReader(Schema schema)
Returns a
DatumReader for this kind of data. |
DatumReader |
GenericData.createDatumReader(Schema writer,
Schema reader)
Returns a
DatumReader for this kind of data. |
DatumWriter |
GenericData.createDatumWriter(Schema schema)
Returns a
DatumWriter for this kind of data. |
protected Object |
GenericDatumReader.createEnum(String symbol,
Schema schema)
Called to create an enum value.
|
Object |
GenericData.createEnum(String symbol,
Schema schema)
Called to create an enum value.
|
protected Object |
GenericDatumReader.createFixed(Object old,
byte[] bytes,
Schema schema)
Deprecated.
As of Avro 1.6.0 this method has been moved to
GenericData.createFixed(Object, byte[], Schema) |
Object |
GenericData.createFixed(Object old,
byte[] bytes,
Schema schema)
Called to create an fixed value.
|
protected Object |
GenericDatumReader.createFixed(Object old,
Schema schema)
Deprecated.
As of Avro 1.6.0 this method has been moved to
GenericData.createFixed(Object, Schema) |
Object |
GenericData.createFixed(Object old,
Schema schema)
Called to create an fixed value.
|
<T> T |
GenericData.deepCopy(Schema schema,
T value)
Makes a deep copy of a value given its schema.
|
protected Class |
GenericDatumReader.findStringClass(Schema schema)
Determines the class to used to represent a string Schema.
|
GenericData.InstanceSupplier |
GenericData.getNewRecordSupplier(Schema schema)
create a supplier that allows to get new record instances for a given schema
in an optimized way
|
protected Object |
GenericData.getRecordState(Object record,
Schema schema)
Produce state for repeated calls to
GenericData.getField(Object,String,int,Object) and
GenericData.setField(Object,String,int,Object,Object) on the same record. |
protected ResolvingDecoder |
GenericDatumReader.getResolver(Schema actual,
Schema expected)
Gets a resolving decoder for use by this GenericDatumReader.
|
int |
GenericData.hashCode(Object o,
Schema s)
Compute a hash code according to a schema, consistent with
GenericData.compare(Object,Object,Schema) . |
protected int |
GenericData.hashCodeAdd(int hashCode,
Object o,
Schema s)
Add the hash code for an object into an accumulated hash code.
|
protected boolean |
GenericData.instanceOf(Schema schema,
Object datum)
Called by
GenericData.resolveUnion(Schema,Object) . |
protected Object |
GenericDatumReader.newArray(Object old,
int size,
Schema schema)
Called to create new array instances.
|
Object |
GenericData.newArray(Object old,
int size,
Schema schema)
Called to create new array instances.
|
Object |
GenericData.InstanceSupplier.newInstance(Object oldInstance,
Schema schema) |
protected Object |
GenericDatumReader.newRecord(Object old,
Schema schema)
Deprecated.
As of Avro 1.6.0 this method has been moved to
GenericData.newRecord(Object, Schema) |
Object |
GenericData.newRecord(Object old,
Schema schema)
Called to create new record instances.
|
protected Object |
GenericDatumReader.read(Object old,
Schema expected,
ResolvingDecoder in)
Called to read data.
|
protected Object |
GenericDatumReader.readArray(Object old,
Schema expected,
ResolvingDecoder in)
Called to read an array instance.
|
protected Object |
GenericDatumReader.readBytes(Object old,
Schema s,
Decoder in)
Called to read byte arrays.
|
protected Object |
GenericDatumReader.readEnum(Schema expected,
Decoder in)
Called to read an enum value.
|
protected Object |
GenericDatumReader.readFixed(Object old,
Schema expected,
Decoder in)
Called to read a fixed value.
|
protected Object |
GenericDatumReader.readInt(Object old,
Schema expected,
Decoder in)
Called to read integers.
|
protected Object |
GenericDatumReader.readMap(Object old,
Schema expected,
ResolvingDecoder in)
Called to read a map instance.
|
protected Object |
GenericDatumReader.readMapKey(Object old,
Schema expected,
Decoder in)
Called by the default implementation of
GenericDatumReader.readMap(java.lang.Object, org.apache.avro.Schema, org.apache.avro.io.ResolvingDecoder) to read a key value. |
protected Object |
GenericDatumReader.readRecord(Object old,
Schema expected,
ResolvingDecoder in)
Called to read a record instance.
|
protected Object |
GenericDatumReader.readString(Object old,
Schema expected,
Decoder in)
Called to read strings.
|
protected Object |
GenericDatumReader.readWithConversion(Object old,
Schema expected,
LogicalType logicalType,
Conversion<?> conversion,
ResolvingDecoder in) |
protected Object |
GenericDatumReader.readWithoutConversion(Object old,
Schema expected,
ResolvingDecoder in) |
protected int |
GenericDatumWriter.resolveUnion(Schema union,
Object datum)
Called to find the index for a datum within a union.
|
int |
GenericData.resolveUnion(Schema union,
Object datum)
Return the index for a datum within a union.
|
void |
GenericDatumReader.setExpected(Schema reader)
Set the reader's schema.
|
void |
GenericDatumWriter.setSchema(Schema root) |
void |
GenericDatumReader.setSchema(Schema writer) |
protected void |
GenericData.Fixed.setSchema(Schema schema) |
static void |
GenericData.setStringType(Schema s,
GenericData.StringType stringType)
Set the Java type to be used when reading this schema.
|
static void |
GenericDatumReader.skip(Schema schema,
Decoder in)
Skip an instance of a schema.
|
boolean |
GenericData.validate(Schema schema,
Object datum)
Returns true if a Java datum matches a schema.
|
protected void |
GenericDatumWriter.write(Schema schema,
Object datum,
Encoder out)
Called to write data.
|
protected void |
GenericDatumWriter.writeArray(Schema schema,
Object datum,
Encoder out)
Called to write a array.
|
protected void |
GenericDatumWriter.writeEnum(Schema schema,
Object datum,
Encoder out)
Called to write an enum value.
|
protected void |
GenericDatumWriter.writeFixed(Schema schema,
Object datum,
Encoder out)
Called to write a fixed value.
|
protected void |
GenericDatumWriter.writeMap(Schema schema,
Object datum,
Encoder out)
Called to write a map.
|
protected void |
GenericDatumWriter.writeRecord(Schema schema,
Object datum,
Encoder out)
Called to write a record.
|
protected void |
GenericDatumWriter.writeString(Schema schema,
Object datum,
Encoder out)
Called to write a string.
|
protected void |
GenericDatumWriter.writeWithoutConversion(Schema schema,
Object datum,
Encoder out)
Called to write data.
|
Constructor and Description |
---|
Array(int capacity,
Schema schema) |
Array(Schema schema,
Collection<T> c) |
EnumSymbol(Schema schema,
Object symbol)
Maps existing Objects into an Avro enum by calling toString(), eg for Java
Enums
|
EnumSymbol(Schema schema,
String symbol) |
Fixed(Schema schema) |
Fixed(Schema schema,
byte[] bytes) |
GenericDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
GenericDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
GenericDatumReader(Schema writer,
Schema reader,
GenericData data) |
GenericDatumWriter(Schema root) |
GenericDatumWriter(Schema root,
GenericData data) |
GenericRecordBuilder(Schema schema)
Creates a GenericRecordBuilder for building Record instances.
|
Record(Schema schema) |
Modifier and Type | Method and Description |
---|---|
Schema |
SortedKeyValueFile.Reader.Options.getKeySchema()
Gets the reader schema for the key.
|
Schema |
SortedKeyValueFile.Writer.Options.getKeySchema()
Gets the key schema.
|
Schema |
SortedKeyValueFile.Reader.Options.getValueSchema()
Gets the reader schema for the value.
|
Schema |
SortedKeyValueFile.Writer.Options.getValueSchema()
Gets the value schema.
|
Modifier and Type | Method and Description |
---|---|
SortedKeyValueFile.Reader.Options |
SortedKeyValueFile.Reader.Options.withKeySchema(Schema keySchema)
Sets the reader schema for the key.
|
SortedKeyValueFile.Writer.Options |
SortedKeyValueFile.Writer.Options.withKeySchema(Schema keySchema)
Sets the key schema.
|
SortedKeyValueFile.Reader.Options |
SortedKeyValueFile.Reader.Options.withValueSchema(Schema valueSchema)
Sets the reader schema for the value.
|
SortedKeyValueFile.Writer.Options |
SortedKeyValueFile.Writer.Options.withValueSchema(Schema valueSchema)
Sets the value schema.
|
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroSerialization.getKeyReaderSchema(org.apache.hadoop.conf.Configuration conf)
Gets the reader schema of the AvroKey datum that is being
serialized/deserialized.
|
static Schema |
AvroSerialization.getKeyWriterSchema(org.apache.hadoop.conf.Configuration conf)
Gets the writer schema of the AvroKey datum that is being
serialized/deserialized.
|
Schema |
AvroDeserializer.getReaderSchema()
Gets the reader schema used for deserializing.
|
static Schema |
AvroKeyValue.getSchema(Schema keySchema,
Schema valueSchema)
Creates a KeyValuePair generic record schema.
|
static Schema |
AvroSerialization.getValueReaderSchema(org.apache.hadoop.conf.Configuration conf)
Gets the reader schema of the AvroValue datum that is being
serialized/deserialized.
|
static Schema |
AvroSerialization.getValueWriterSchema(org.apache.hadoop.conf.Configuration conf)
Gets the writer schema of the AvroValue datum that is being
serialized/deserialized.
|
Schema |
AvroSerializer.getWriterSchema()
Gets the writer schema being used for serialization.
|
Schema |
AvroDeserializer.getWriterSchema()
Gets the writer schema used for deserializing.
|
Schema |
AvroDatumConverterFactory.AvroWrapperConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.BooleanWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.BytesWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.ByteWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.DoubleWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.FloatWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.IntWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.LongWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.NullWritableConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Schema |
AvroDatumConverterFactory.TextConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
abstract Schema |
AvroDatumConverter.getWriterSchema()
Gets the writer schema that should be used to serialize the output Avro
datum.
|
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroKeyValue.getSchema(Schema keySchema,
Schema valueSchema)
Creates a KeyValuePair generic record schema.
|
static void |
AvroSerialization.setKeyReaderSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the reader schema of the AvroKey datum that is being
serialized/deserialized.
|
static void |
AvroSerialization.setKeyWriterSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the writer schema of the AvroKey datum that is being
serialized/deserialized.
|
static void |
AvroSerialization.setValueReaderSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the reader schema of the AvroValue datum that is being
serialized/deserialized.
|
static void |
AvroSerialization.setValueWriterSchema(org.apache.hadoop.conf.Configuration conf,
Schema schema)
Sets the writer schema of the AvroValue datum that is being
serialized/deserialized.
|
AvroSequenceFile.Writer.Options |
AvroSequenceFile.Writer.Options.withKeySchema(Schema keyWriterSchema)
Sets the writer schema of the key records when using Avro data.
|
AvroSequenceFile.Reader.Options |
AvroSequenceFile.Reader.Options.withKeySchema(Schema keyReaderSchema)
Sets the reader schema of the key records when using Avro data.
|
AvroSequenceFile.Writer.Options |
AvroSequenceFile.Writer.Options.withValueSchema(Schema valueWriterSchema)
Sets the writer schema of the value records when using Avro data.
|
AvroSequenceFile.Reader.Options |
AvroSequenceFile.Reader.Options.withValueSchema(Schema valueReaderSchema)
Sets the reader schema of the value records when using Avro data.
|
Constructor and Description |
---|
AvroDeserializer(Schema writerSchema,
Schema readerSchema,
ClassLoader classLoader)
Constructor.
|
AvroDeserializer(Schema writerSchema,
Schema readerSchema,
DatumReader<D> datumReader)
Constructor.
|
AvroKeyDeserializer(Schema writerSchema,
Schema readerSchema,
ClassLoader classLoader)
Constructor.
|
AvroKeyDeserializer(Schema writerSchema,
Schema readerSchema,
DatumReader<D> datumReader)
Constructor.
|
AvroSerializer(Schema writerSchema)
Constructor.
|
AvroSerializer(Schema writerSchema,
DatumWriter<T> datumWriter)
Constructor.
|
AvroValueDeserializer(Schema writerSchema,
Schema readerSchema,
ClassLoader classLoader)
Constructor.
|
AvroValueDeserializer(Schema writerSchema,
Schema readerSchema,
DatumReader<D> datumReader)
Constructor.
|
AvroWrapperConverter(Schema schema) |
Modifier and Type | Method and Description |
---|---|
static int |
BinaryData.compare(byte[] b1,
int s1,
byte[] b2,
int s2,
Schema schema)
Compare binary encoded data.
|
static int |
BinaryData.compare(byte[] b1,
int s1,
int l1,
byte[] b2,
int s2,
int l2,
Schema schema)
Compare binary encoded data.
|
<D> DatumReader<D> |
FastReaderBuilder.createDatumReader(Schema schema) |
<D> DatumReader<D> |
FastReaderBuilder.createDatumReader(Schema writerSchema,
Schema readerSchema) |
void |
FastReaderBuilder.RecordReader.finishInitialization(FastReaderBuilder.ExecutionStep[] readSteps,
Schema schema,
GenericData.InstanceSupplier supp) |
static int |
BinaryData.hashCode(byte[] bytes,
int start,
int length,
Schema schema)
Hash binary encoded data.
|
JsonDecoder |
DecoderFactory.jsonDecoder(Schema schema,
InputStream input)
Creates a
JsonDecoder using the InputStrim provided for reading data
that conforms to the Schema provided. |
JsonDecoder |
DecoderFactory.jsonDecoder(Schema schema,
String input)
Creates a
JsonDecoder using the String provided for reading data that
conforms to the Schema provided. |
JsonEncoder |
EncoderFactory.jsonEncoder(Schema schema,
OutputStream out)
Creates a
JsonEncoder using the OutputStream provided for writing
data conforming to the Schema provided. |
JsonEncoder |
EncoderFactory.jsonEncoder(Schema schema,
OutputStream out,
boolean pretty)
Creates a
JsonEncoder using the OutputStream provided for writing
data conforming to the Schema provided with optional pretty printing. |
static Object |
ResolvingDecoder.resolve(Schema writer,
Schema reader)
Produces an opaque resolver that can be used to construct a new
ResolvingDecoder.ResolvingDecoder(Object, Decoder) . |
ResolvingDecoder |
DecoderFactory.resolvingDecoder(Schema writer,
Schema reader,
Decoder wrapped)
Creates a
ResolvingDecoder wrapping the Decoder provided. |
default void |
FastReaderBuilder.FieldReader.setSchema(Schema schema) |
void |
DatumWriter.setSchema(Schema schema)
Set the schema.
|
void |
DatumReader.setSchema(Schema schema)
Set the writer's schema.
|
ValidatingDecoder |
DecoderFactory.validatingDecoder(Schema schema,
Decoder wrapped)
Creates a
ValidatingDecoder wrapping the Decoder provided. |
ValidatingEncoder |
EncoderFactory.validatingEncoder(Schema schema,
Encoder encoder)
Creates a
ValidatingEncoder that wraps the Encoder provided. |
Modifier and Type | Method and Description |
---|---|
static void |
ResolvingGrammarGenerator.encode(Encoder e,
Schema s,
com.fasterxml.jackson.databind.JsonNode n)
Encodes the given Json node n on to the encoder e according
to the schema s.
|
Symbol |
ValidatingGrammarGenerator.generate(Schema schema)
Returns the non-terminal that is the start symbol for the grammar for the
given schema sc.
|
Symbol |
JsonGrammarGenerator.generate(Schema schema)
Returns the non-terminal that is the start symbol for the grammar for the
grammar for the given schema sc.
|
Symbol |
ValidatingGrammarGenerator.generate(Schema sc,
Map<org.apache.avro.io.parsing.ValidatingGrammarGenerator.LitS,Symbol> seen)
Returns the non-terminal that is the start symbol for the grammar for the
given schema sc.
|
Symbol |
JsonGrammarGenerator.generate(Schema sc,
Map<org.apache.avro.io.parsing.ValidatingGrammarGenerator.LitS,Symbol> seen)
Returns the non-terminal that is the start symbol for grammar of the given
schema sc.
|
Symbol |
ResolvingGrammarGenerator.generate(Schema writer,
Schema reader)
Resolves the writer schema writer and the reader schema
reader and returns the start symbol for the grammar generated.
|
Modifier and Type | Field and Description |
---|---|
static Schema |
MD5.SCHEMA$ |
static Schema |
HandshakeResponse.SCHEMA$ |
static Schema |
HandshakeRequest.SCHEMA$ |
static Schema |
HandshakeMatch.SCHEMA$ |
Modifier and Type | Method and Description |
---|---|
static Schema |
MD5.getClassSchema() |
static Schema |
HandshakeResponse.getClassSchema() |
static Schema |
HandshakeRequest.getClassSchema() |
static Schema |
HandshakeMatch.getClassSchema() |
Schema |
MD5.getSchema() |
Schema |
HandshakeResponse.getSchema() |
Schema |
HandshakeRequest.getSchema() |
Schema |
HandshakeMatch.getSchema() |
Modifier and Type | Method and Description |
---|---|
Object |
Requestor.readError(Schema schema,
Decoder in)
Deprecated.
|
abstract Exception |
Requestor.readError(Schema writer,
Schema reader,
Decoder in)
Reads an error message.
|
abstract Object |
Responder.readRequest(Schema actual,
Schema expected,
Decoder in)
Reads a request message.
|
Object |
Requestor.readResponse(Schema schema,
Decoder in)
Deprecated.
|
abstract Object |
Requestor.readResponse(Schema writer,
Schema reader,
Decoder in)
Reads a response message.
|
abstract void |
Responder.writeError(Schema schema,
Object error,
Encoder out)
Writes an error message.
|
abstract void |
Requestor.writeRequest(Schema schema,
Object request,
Encoder out)
Writes a request message.
|
abstract void |
Responder.writeResponse(Schema schema,
Object response,
Encoder out)
Writes a response message.
|
Modifier and Type | Method and Description |
---|---|
protected DatumReader<Object> |
GenericResponder.getDatumReader(Schema actual,
Schema expected) |
protected DatumWriter<Object> |
GenericResponder.getDatumWriter(Schema schema) |
Exception |
GenericRequestor.readError(Schema writer,
Schema reader,
Decoder in) |
Object |
GenericResponder.readRequest(Schema actual,
Schema expected,
Decoder in) |
Object |
GenericRequestor.readResponse(Schema writer,
Schema reader,
Decoder in) |
void |
GenericResponder.writeError(Schema schema,
Object error,
Encoder out) |
void |
GenericRequestor.writeRequest(Schema schema,
Object request,
Encoder out) |
void |
GenericResponder.writeResponse(Schema schema,
Object response,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
protected DatumReader<Object> |
ReflectResponder.getDatumReader(Schema actual,
Schema expected) |
protected DatumReader<Object> |
ReflectRequestor.getDatumReader(Schema writer,
Schema reader) |
protected DatumWriter<Object> |
ReflectResponder.getDatumWriter(Schema schema) |
protected DatumWriter<Object> |
ReflectRequestor.getDatumWriter(Schema schema) |
void |
ReflectResponder.writeError(Schema schema,
Object error,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
protected DatumReader<Object> |
SpecificRequestor.getDatumReader(Schema schema)
Deprecated.
|
protected DatumReader<Object> |
SpecificResponder.getDatumReader(Schema actual,
Schema expected) |
protected DatumReader<Object> |
SpecificRequestor.getDatumReader(Schema writer,
Schema reader) |
protected DatumWriter<Object> |
SpecificResponder.getDatumWriter(Schema schema) |
protected DatumWriter<Object> |
SpecificRequestor.getDatumWriter(Schema schema) |
Exception |
SpecificRequestor.readError(Schema writer,
Schema reader,
Decoder in) |
Object |
SpecificRequestor.readResponse(Schema writer,
Schema reader,
Decoder in) |
void |
SpecificResponder.writeError(Schema schema,
Object error,
Encoder out) |
void |
SpecificRequestor.writeRequest(Schema schema,
Object request,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroJob.getInputSchema(org.apache.hadoop.conf.Configuration job)
Return a job's map input schema.
|
static Schema |
Pair.getKeySchema(Schema pair)
Return a pair's key schema.
|
static Schema |
AvroJob.getMapOutputSchema(org.apache.hadoop.conf.Configuration job)
Return a job's map output key schema.
|
static Schema |
AvroJob.getOutputSchema(org.apache.hadoop.conf.Configuration job)
Return a job's output key schema.
|
static Schema |
Pair.getPairSchema(Schema key,
Schema value)
Get a pair schema.
|
Schema |
SequenceFileReader.getSchema() |
Schema |
Pair.getSchema() |
static Schema |
Pair.getValueSchema(Schema pair)
Return a pair's value schema.
|
Modifier and Type | Method and Description |
---|---|
static void |
AvroMultipleInputs.addInputPath(org.apache.hadoop.mapred.JobConf conf,
org.apache.hadoop.fs.Path path,
Class<? extends AvroMapper> mapperClass,
Schema inputSchema)
|
static void |
AvroMultipleOutputs.addMultiNamedOutput(org.apache.hadoop.mapred.JobConf conf,
String namedOutput,
Class<? extends org.apache.hadoop.mapred.OutputFormat> outputFormatClass,
Schema schema)
Adds a multi named output for the job.
|
static void |
AvroMultipleOutputs.addNamedOutput(org.apache.hadoop.mapred.JobConf conf,
String namedOutput,
Class<? extends org.apache.hadoop.mapred.OutputFormat> outputFormatClass,
Schema schema)
Adds a named output for the job.
|
void |
AvroMultipleOutputs.collect(String namedOutput,
org.apache.hadoop.mapred.Reporter reporter,
Schema schema,
Object datum)
OutputCollector with custom schema.
|
void |
AvroMultipleOutputs.collect(String namedOutput,
org.apache.hadoop.mapred.Reporter reporter,
Schema schema,
Object datum,
String baseOutputPath)
OutputCollector with custom schema and file name.
|
static Schema |
Pair.getKeySchema(Schema pair)
Return a pair's key schema.
|
static Schema |
Pair.getPairSchema(Schema key,
Schema value)
Get a pair schema.
|
static Schema |
Pair.getValueSchema(Schema pair)
Return a pair's value schema.
|
static void |
AvroJob.setInputSchema(org.apache.hadoop.mapred.JobConf job,
Schema s)
Configure a job's map input schema.
|
static void |
AvroJob.setMapOutputSchema(org.apache.hadoop.mapred.JobConf job,
Schema s)
Configure a job's map output schema.
|
static void |
AvroJob.setOutputSchema(org.apache.hadoop.mapred.JobConf job,
Schema s)
Configure a job's output schema.
|
Constructor and Description |
---|
Pair(K key,
Schema keySchema,
V value,
Schema valueSchema) |
Pair(Schema schema) |
Modifier and Type | Field and Description |
---|---|
static Schema |
TaskType.SCHEMA$ |
Modifier and Type | Method and Description |
---|---|
static Schema |
TaskType.getClassSchema() |
Schema |
TaskType.getSchema() |
Modifier and Type | Method and Description |
---|---|
static Schema |
AvroJob.getInputKeySchema(org.apache.hadoop.conf.Configuration conf)
Gets the job input key schema.
|
static Schema |
AvroJob.getInputValueSchema(org.apache.hadoop.conf.Configuration conf)
Gets the job input value schema.
|
static Schema |
AvroJob.getMapOutputKeySchema(org.apache.hadoop.conf.Configuration conf)
Gets the map output key schema.
|
static Schema |
AvroJob.getMapOutputValueSchema(org.apache.hadoop.conf.Configuration conf)
Gets the map output value schema.
|
static Schema |
AvroJob.getOutputKeySchema(org.apache.hadoop.conf.Configuration conf)
Gets the job output key schema.
|
static Schema |
AvroJob.getOutputValueSchema(org.apache.hadoop.conf.Configuration conf)
Gets the job output value schema.
|
Schema |
AvroKeyValueRecordWriter.getWriterSchema()
Gets the writer schema for the key/value pair generic record.
|
Modifier and Type | Method and Description |
---|---|
static void |
AvroMultipleOutputs.addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String namedOutput,
Class<? extends org.apache.hadoop.mapreduce.OutputFormat> outputFormatClass,
Schema keySchema)
Adds a named output for the job.
|
static void |
AvroMultipleOutputs.addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String namedOutput,
Class<? extends org.apache.hadoop.mapreduce.OutputFormat> outputFormatClass,
Schema keySchema,
Schema valueSchema)
Adds a named output for the job.
|
protected org.apache.hadoop.mapreduce.RecordWriter<AvroKey<T>,org.apache.hadoop.io.NullWritable> |
AvroKeyOutputFormat.RecordWriterFactory.create(Schema writerSchema,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream,
int syncInterval)
Creates a new record writer instance.
|
static void |
AvroJob.setInputKeySchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job input key schema.
|
static void |
AvroJob.setInputValueSchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job input value schema.
|
static void |
AvroJob.setMapOutputKeySchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the map output key schema.
|
static void |
AvroJob.setMapOutputValueSchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the map output value schema.
|
static void |
AvroJob.setOutputKeySchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job output key schema.
|
static void |
AvroJob.setOutputValueSchema(org.apache.hadoop.mapreduce.Job job,
Schema schema)
Sets the job output value schema.
|
void |
AvroMultipleOutputs.write(Object key,
Object value,
Schema keySchema,
Schema valSchema,
String baseOutputPath)
Write key value to an output file name.
|
Constructor and Description |
---|
AvroKeyRecordReader(Schema readerSchema)
Constructor.
|
AvroKeyRecordWriter(Schema writerSchema,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream)
Constructor.
|
AvroKeyRecordWriter(Schema writerSchema,
GenericData dataModel,
CodecFactory compressionCodec,
OutputStream outputStream,
int syncInterval)
Constructor.
|
AvroKeyValueRecordReader(Schema keyReaderSchema,
Schema valueReaderSchema)
Constructor.
|
AvroRecordReaderBase(Schema readerSchema)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
Schema |
SchemaStore.findByFingerprint(long fingerprint)
Retrieves a fingerprint by its AVRO-CRC-64 fingerprint.
|
Schema |
SchemaStore.Cache.findByFingerprint(long fingerprint) |
Modifier and Type | Method and Description |
---|---|
void |
SchemaStore.Cache.addSchema(Schema schema)
Adds a schema to this cache that can be retrieved using its AVRO-CRC-64
fingerprint.
|
void |
BinaryMessageDecoder.addSchema(Schema writeSchema)
Adds a
Schema that can be used to decode buffers. |
Constructor and Description |
---|
BinaryMessageDecoder(GenericData model,
Schema readSchema)
Creates a new
BinaryMessageEncoder that uses the given
data model to construct datum instances described by the
schema . |
BinaryMessageDecoder(GenericData model,
Schema readSchema,
SchemaStore resolver)
Creates a new
BinaryMessageEncoder that uses the given
data model to construct datum instances described by the
schema . |
BinaryMessageEncoder(GenericData model,
Schema schema)
Creates a new
BinaryMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
BinaryMessageEncoder(GenericData model,
Schema schema,
boolean shouldCopy)
Creates a new
BinaryMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
RawMessageDecoder(GenericData model,
Schema schema)
Creates a new
RawMessageDecoder that uses the given
data model to construct datum instances described by the
schema . |
RawMessageDecoder(GenericData model,
Schema writeSchema,
Schema readSchema)
Creates a new
RawMessageDecoder that uses the given
data model to construct datum instances described by the
readSchema . |
RawMessageEncoder(GenericData model,
Schema schema)
Creates a new
RawMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
RawMessageEncoder(GenericData model,
Schema schema,
boolean shouldCopy)
Creates a new
RawMessageEncoder that uses the given
data model to deconstruct datum instances described by
the schema . |
Modifier and Type | Method and Description |
---|---|
Schema |
ProtoConversions.TimestampMillisConversion.getRecommendedSchema() |
Schema |
ProtoConversions.TimestampMicrosConversion.getRecommendedSchema() |
protected Schema |
ProtobufData.getRecordSchema(Object record) |
Schema |
ProtobufData.getSchema(Class c)
Return a record schema given a protobuf message class.
|
Schema |
ProtobufData.getSchema(com.google.protobuf.Descriptors.Descriptor descriptor) |
Schema |
ProtobufData.getSchema(com.google.protobuf.Descriptors.EnumDescriptor d) |
Schema |
ProtobufData.getSchema(com.google.protobuf.Descriptors.FieldDescriptor f) |
Modifier and Type | Method and Description |
---|---|
DatumReader |
ProtobufData.createDatumReader(Schema schema) |
DatumWriter |
ProtobufData.createDatumWriter(Schema schema) |
protected Object |
ProtobufDatumReader.createEnum(String symbol,
Schema schema) |
com.google.protobuf.Timestamp |
ProtoConversions.TimestampMillisConversion.fromLong(Long millisFromEpoch,
Schema schema,
LogicalType type) |
com.google.protobuf.Timestamp |
ProtoConversions.TimestampMicrosConversion.fromLong(Long microsFromEpoch,
Schema schema,
LogicalType type) |
protected Object |
ProtobufData.getRecordState(Object r,
Schema s) |
Object |
ProtobufData.newRecord(Object old,
Schema schema) |
protected Object |
ProtobufDatumReader.readRecord(Object old,
Schema expected,
ResolvingDecoder in) |
Long |
ProtoConversions.TimestampMillisConversion.toLong(com.google.protobuf.Timestamp value,
Schema schema,
LogicalType type) |
Long |
ProtoConversions.TimestampMicrosConversion.toLong(com.google.protobuf.Timestamp value,
Schema schema,
LogicalType type) |
protected void |
ProtobufDatumWriter.writeEnum(Schema schema,
Object datum,
Encoder out) |
Constructor and Description |
---|
ProtobufDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
ProtobufDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
ProtobufDatumReader(Schema writer,
Schema reader,
ProtobufData data) |
ProtobufDatumWriter(Schema schema) |
ProtobufDatumWriter(Schema root,
ProtobufData protobufData) |
Modifier and Type | Field and Description |
---|---|
protected Schema |
CustomEncoding.schema |
Modifier and Type | Method and Description |
---|---|
protected Schema |
ReflectData.createFieldSchema(Field field,
Map<String,Schema> names)
Create a schema for a field.
|
protected Schema |
ReflectData.AllowNull.createFieldSchema(Field field,
Map<String,Schema> names) |
protected Schema |
ReflectData.createSchema(Type type,
Map<String,Schema> names) |
protected Schema |
ReflectData.getRecordSchema(Object record) |
protected Schema |
CustomEncoding.getSchema() |
static Schema |
ReflectData.makeNullable(Schema schema)
Create and return a union of the null schema and the provided schema.
|
Modifier and Type | Method and Description |
---|---|
protected int |
ReflectData.compare(Object o1,
Object o2,
Schema s,
boolean equals) |
DatumReader |
ReflectData.createDatumReader(Schema schema) |
DatumReader |
ReflectData.createDatumReader(Schema writer,
Schema reader) |
DatumWriter |
ReflectData.createDatumWriter(Schema schema) |
Object |
ReflectData.createFixed(Object old,
Schema schema) |
Class |
ReflectData.getClass(Schema schema) |
protected Object |
ReflectData.getRecordState(Object record,
Schema schema) |
static Schema |
ReflectData.makeNullable(Schema schema)
Create and return a union of the null schema and the provided schema.
|
protected Object |
ReflectDatumReader.newArray(Object old,
int size,
Schema schema) |
Object |
ReflectData.newRecord(Object old,
Schema schema) |
protected Object |
ReflectDatumReader.readArray(Object old,
Schema expected,
ResolvingDecoder in) |
protected Object |
ReflectDatumReader.readBytes(Object old,
Schema s,
Decoder in) |
protected Object |
ReflectDatumReader.readInt(Object old,
Schema expected,
Decoder in) |
boolean |
ReflectData.validate(Schema schema,
Object datum) |
protected void |
ReflectDatumWriter.write(Schema schema,
Object datum,
Encoder out) |
protected void |
ReflectDatumWriter.writeArray(Schema schema,
Object datum,
Encoder out)
Called to write a array.
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
ReflectData.createFieldSchema(Field field,
Map<String,Schema> names)
Create a schema for a field.
|
protected Schema |
ReflectData.AllowNull.createFieldSchema(Field field,
Map<String,Schema> names) |
protected Schema |
ReflectData.createSchema(Type type,
Map<String,Schema> names) |
Constructor and Description |
---|
ReflectDatumReader(Schema root)
Construct where the writer's and reader's schemas are the same.
|
ReflectDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
ReflectDatumReader(Schema writer,
Schema reader,
ReflectData data)
Construct given writer's and reader's schema and the data model.
|
ReflectDatumWriter(Schema root) |
ReflectDatumWriter(Schema root,
ReflectData reflectData) |
Modifier and Type | Method and Description |
---|---|
protected Schema |
SpecificData.createSchema(Type type,
Map<String,Schema> names)
Create the schema for a Java type.
|
protected Schema |
SpecificData.getEnumSchema(Object datum) |
abstract Schema |
SpecificRecordBase.getSchema() |
abstract Schema |
SpecificFixed.getSchema() |
abstract Schema |
SpecificExceptionBase.getSchema() |
Schema |
SpecificData.getSchema(Type type)
Find the schema for a Java type.
|
Modifier and Type | Method and Description |
---|---|
protected int |
SpecificData.compare(Object o1,
Object o2,
Schema s,
boolean eq) |
DatumReader |
SpecificData.createDatumReader(Schema schema) |
DatumReader |
SpecificData.createDatumReader(Schema writer,
Schema reader) |
DatumWriter |
SpecificData.createDatumWriter(Schema schema) |
Object |
SpecificData.createEnum(String symbol,
Schema schema) |
Object |
SpecificData.createFixed(Object old,
Schema schema) |
protected Class |
SpecificDatumReader.findStringClass(Schema schema) |
Class |
SpecificData.getClass(Schema schema)
Return the class that implements a schema, or null if none exists.
|
static String |
SpecificData.getClassName(Schema schema)
Returns the Java class name indicated by a schema's name and namespace.
|
static SpecificData |
SpecificData.getForSchema(Schema reader)
For RECORD type schemas, this method returns the SpecificData instance of the
class associated with the schema, in order to get the right conversions for
any logical types used.
|
GenericData.InstanceSupplier |
SpecificData.getNewRecordSupplier(Schema schema) |
static Object |
SpecificData.newInstance(Class c,
Schema s)
Create an instance of a class.
|
Object |
SpecificData.newRecord(Object old,
Schema schema) |
protected Object |
SpecificDatumReader.readRecord(Object old,
Schema expected,
ResolvingDecoder in) |
void |
SpecificDatumReader.setSchema(Schema actual) |
protected void |
SpecificDatumWriter.writeEnum(Schema schema,
Object datum,
Encoder out) |
protected void |
SpecificDatumWriter.writeRecord(Schema schema,
Object datum,
Encoder out) |
protected void |
SpecificDatumWriter.writeString(Schema schema,
Object datum,
Encoder out) |
Modifier and Type | Method and Description |
---|---|
protected Schema |
SpecificData.createSchema(Type type,
Map<String,Schema> names)
Create the schema for a Java type.
|
Constructor and Description |
---|
SpecificDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
SpecificDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
SpecificDatumReader(Schema writer,
Schema reader,
SpecificData data)
Construct given writer's schema, reader's schema, and a
SpecificData . |
SpecificDatumWriter(Schema schema) |
SpecificDatumWriter(Schema root,
SpecificData specificData) |
SpecificErrorBuilderBase(Schema schema)
Creates a SpecificErrorBuilderBase for building errors of the given type.
|
SpecificRecordBuilderBase(Schema schema)
Creates a SpecificRecordBuilderBase for building records of the given type.
|
Modifier and Type | Method and Description |
---|---|
protected Schema |
ThriftData.getEnumSchema(Object datum) |
protected Schema |
ThriftData.getRecordSchema(Object record) |
Schema |
ThriftData.getSchema(Class c)
Return a record schema given a thrift generated class.
|
Modifier and Type | Method and Description |
---|---|
DatumReader |
ThriftData.createDatumReader(Schema schema) |
DatumWriter |
ThriftData.createDatumWriter(Schema schema) |
protected Object |
ThriftDatumReader.createEnum(String symbol,
Schema schema) |
protected Object |
ThriftData.getRecordState(Object r,
Schema s) |
protected Object |
ThriftDatumReader.newArray(Object old,
int size,
Schema schema) |
Object |
ThriftData.newRecord(Object old,
Schema schema) |
protected Object |
ThriftDatumReader.readInt(Object old,
Schema s,
Decoder in) |
Constructor and Description |
---|
ThriftDatumReader(Schema schema)
Construct where the writer's and reader's schemas are the same.
|
ThriftDatumReader(Schema writer,
Schema reader)
Construct given writer's and reader's schema.
|
ThriftDatumReader(Schema writer,
Schema reader,
ThriftData data) |
ThriftDatumWriter(Schema schema) |
ThriftDatumWriter(Schema root,
ThriftData thriftData) |
Constructor and Description |
---|
RandomData(Schema schema,
int count) |
RandomData(Schema schema,
int count,
boolean utf8ForString) |
RandomData(Schema schema,
int count,
long seed) |
RandomData(Schema schema,
int count,
long seed,
boolean utf8ForString) |
Modifier and Type | Method and Description |
---|---|
Schema |
AvroColumnReader.getFileSchema()
Return the schema for data in this file.
|
Modifier and Type | Method and Description |
---|---|
AvroColumnReader.Params |
AvroColumnReader.Params.setSchema(Schema schema)
Set subset schema to project data down to.
|
Constructor and Description |
---|
AvroColumnWriter(Schema s,
ColumnFileMetaData meta) |
AvroColumnWriter(Schema s,
ColumnFileMetaData meta,
GenericData model) |
Modifier and Type | Field and Description |
---|---|
protected Schema |
AvroTrevniRecordWriterBase.schema
Provided avro schema from the context
|
Modifier and Type | Method and Description |
---|---|
protected abstract Schema |
AvroTrevniRecordWriterBase.initSchema(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Use the task context to construct a schema for writing
|
protected Schema |
AvroTrevniKeyValueRecordWriter.initSchema(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Use the task context to construct a schema for writing
|
protected Schema |
AvroTrevniKeyRecordWriter.initSchema(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Use the task context to construct a schema for writing
|
Copyright © 2009–2020 The Apache Software Foundation. All rights reserved.