org.apache.avro.hadoop.io

Class AvroSerialization<T>

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.avro.hadoop.io.AvroSerialization<T>

Type Parameters:

T - The Java type of the Avro data to serialize.

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.serializer.Serialization<AvroWrapper<T>>

public class AvroSerialization<T>
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.io.serializer.Serialization<AvroWrapper<T>>

The Serialization used by jobs configured with AvroJob.

Constructor Summary

Constructors

Constructor and Description
AvroSerialization()

Method Summary

Modifier and Type	Method and Description
boolean	accept(Class<?> c)
static void	addToConfiguration(org.apache.hadoop.conf.Configuration conf) Adds the AvroSerialization scheme to the configuration, so SerializationFactory instances constructed from the given configuration will be aware of it.
static GenericData	createDataModel(org.apache.hadoop.conf.Configuration conf) Gets an instance of data model implementation, defaulting to ReflectData if not explicitly specified.
static Class<? extends GenericData>	getDataModelClass(org.apache.hadoop.conf.Configuration conf) Gets the data model class for de/serialization.
org.apache.hadoop.io.serializer.Deserializer<AvroWrapper<T>>	getDeserializer(Class<AvroWrapper<T>> c) Gets an object capable of deserializing the output from a Mapper.
static Schema	getKeyReaderSchema(org.apache.hadoop.conf.Configuration conf) Gets the reader schema of the AvroKey datum that is being serialized/deserialized.
static Schema	getKeyWriterSchema(org.apache.hadoop.conf.Configuration conf) Gets the writer schema of the AvroKey datum that is being serialized/deserialized.
org.apache.hadoop.io.serializer.Serializer<AvroWrapper<T>>	getSerializer(Class<AvroWrapper<T>> c) Gets an object capable of serializing output from a Mapper.
static Schema	getValueReaderSchema(org.apache.hadoop.conf.Configuration conf) Gets the reader schema of the AvroValue datum that is being serialized/deserialized.
static Schema	getValueWriterSchema(org.apache.hadoop.conf.Configuration conf) Gets the writer schema of the AvroValue datum that is being serialized/deserialized.
static void	setDataModelClass(org.apache.hadoop.conf.Configuration conf, Class<? extends GenericData> modelClass) Sets the data model class for de/serialization.
static void	setKeyReaderSchema(org.apache.hadoop.conf.Configuration conf, Schema schema) Sets the reader schema of the AvroKey datum that is being serialized/deserialized.
static void	setKeyWriterSchema(org.apache.hadoop.conf.Configuration conf, Schema schema) Sets the writer schema of the AvroKey datum that is being serialized/deserialized.
static void	setValueReaderSchema(org.apache.hadoop.conf.Configuration conf, Schema schema) Sets the reader schema of the AvroValue datum that is being serialized/deserialized.
static void	setValueWriterSchema(org.apache.hadoop.conf.Configuration conf, Schema schema) Sets the writer schema of the AvroValue datum that is being serialized/deserialized.

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroSerialization

public AvroSerialization()

Method Detail

accept

public boolean accept(Class<?> c)

Specified by:

accept in interface org.apache.hadoop.io.serializer.Serialization<AvroWrapper<T>>

getDeserializer

public org.apache.hadoop.io.serializer.Deserializer<AvroWrapper<T>> getDeserializer(Class<AvroWrapper<T>> c)

Gets an object capable of deserializing the output from a Mapper.

Specified by:

getDeserializer in interface org.apache.hadoop.io.serializer.Serialization<AvroWrapper<T>>

Parameters:

c - The class to get a deserializer for.

Returns:

A deserializer for objects of class c.

getSerializer

public org.apache.hadoop.io.serializer.Serializer<AvroWrapper<T>> getSerializer(Class<AvroWrapper<T>> c)

Gets an object capable of serializing output from a Mapper.

Specified by:

getSerializer in interface org.apache.hadoop.io.serializer.Serialization<AvroWrapper<T>>

Parameters:

c - The class to get a serializer for.

Returns:

A serializer for objects of class c.

addToConfiguration

public static void addToConfiguration(org.apache.hadoop.conf.Configuration conf)

Adds the AvroSerialization scheme to the configuration, so SerializationFactory instances constructed from the given configuration will be aware of it.

Parameters:

conf - The configuration to add AvroSerialization to.

setKeyWriterSchema

public static void setKeyWriterSchema(org.apache.hadoop.conf.Configuration conf,
                                      Schema schema)

Sets the writer schema of the AvroKey datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

schema - The Avro key schema.

setKeyReaderSchema

public static void setKeyReaderSchema(org.apache.hadoop.conf.Configuration conf,
                                      Schema schema)

Sets the reader schema of the AvroKey datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

schema - The Avro key schema.

setValueWriterSchema

public static void setValueWriterSchema(org.apache.hadoop.conf.Configuration conf,
                                        Schema schema)

Sets the writer schema of the AvroValue datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

schema - The Avro value schema.

setValueReaderSchema

public static void setValueReaderSchema(org.apache.hadoop.conf.Configuration conf,
                                        Schema schema)

Sets the reader schema of the AvroValue datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

schema - The Avro value schema.

setDataModelClass

public static void setDataModelClass(org.apache.hadoop.conf.Configuration conf,
                                     Class<? extends GenericData> modelClass)

Sets the data model class for de/serialization.

Parameters:

conf - The configuration.

modelClass - The data model class.

getKeyWriterSchema

public static Schema getKeyWriterSchema(org.apache.hadoop.conf.Configuration conf)

Gets the writer schema of the AvroKey datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

Returns:

The Avro key writer schema, or null if none was set.

getKeyReaderSchema

public static Schema getKeyReaderSchema(org.apache.hadoop.conf.Configuration conf)

Gets the reader schema of the AvroKey datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

Returns:

The Avro key reader schema, or null if none was set.

getValueWriterSchema

public static Schema getValueWriterSchema(org.apache.hadoop.conf.Configuration conf)

Gets the writer schema of the AvroValue datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

Returns:

The Avro value writer schema, or null if none was set.

getValueReaderSchema

public static Schema getValueReaderSchema(org.apache.hadoop.conf.Configuration conf)

Gets the reader schema of the AvroValue datum that is being serialized/deserialized.

Parameters:

conf - The configuration.

Returns:

The Avro value reader schema, or null if none was set.

getDataModelClass

public static Class<? extends GenericData> getDataModelClass(org.apache.hadoop.conf.Configuration conf)

Gets the data model class for de/serialization.

Parameters:

conf - The configuration.

createDataModel

public static GenericData createDataModel(org.apache.hadoop.conf.Configuration conf)

Gets an instance of data model implementation, defaulting to ReflectData if not explicitly specified.

Parameters:

conf - The job configuration.

Returns:

Instance of the job data model implementation.