Stores in a file a sequence of data conforming to a schema. The schema is stored in the file with the data. Each datum in a file is of the same schema. Data is written with a DatumWriter<T>. Data is grouped into blocks. A synchronization marker is written between blocks, so that files may be split. Blocks may be compressed. Extensible metadata is stored at the end of the file. Files may be appended to.
More...
|
bool | IsReservedMeta (string key) |
| Returns true if parameter is a reserved Avro metadata value.
|
|
void | SetMeta (string key, byte[] value) |
| Set metadata pair.
|
|
void | SetMeta (string key, long value) |
| Set metadata pair (long value).
|
|
void | SetMeta (string key, string value) |
| Set metadata pair (string value).
|
|
void | SetSyncInterval (int syncInterval) |
| Set the synchronization interval for this file or stream, in bytes. Valid values range from 32 to 2^30. Suggested values are between 2K and 2M.
|
|
void | Append (T datum) |
| Append datum to a file or stream.
|
|
void | Flush () |
| Flush out any buffered data.
|
|
long | Sync () |
| Forces the end of the current block, emitting a synchronization marker.
|
|
void | Close () |
| Closes the file or stream.
|
|
void | Dispose () |
|
|
virtual void | Dispose (bool disposing) |
| Releases resources associated with this DataFileWriter<T>. More...
|
|
Stores in a file a sequence of data conforming to a schema. The schema is stored in the file with the data. Each datum in a file is of the same schema. Data is written with a DatumWriter<T>. Data is grouped into blocks. A synchronization marker is written between blocks, so that files may be split. Blocks may be compressed. Extensible metadata is stored at the end of the file. Files may be appended to.
- Template Parameters
-
T | Type of datum to write to the file. |
◆ Dispose()
Releases resources associated with this DataFileWriter<T>.
- Parameters
-
disposing | True if called from Dispose(); false otherwise. |
◆ OpenWriter() [1/4]
Open a new writer instance to write to a file path, using a Null codec
- Parameters
-
writer | Datum writer to use. |
path | Path to the file. |
- Returns
- A new file writer.
◆ OpenWriter() [2/4]
Open a new writer instance to write to an output stream, using a Null codec
- Parameters
-
writer | Datum writer to use. |
outStream | Stream to write to. |
- Returns
- A new file writer.
◆ OpenWriter() [3/4]
Open a new writer instance to write to a file path with a specified codec
- Parameters
-
writer | Datum writer to use. |
path | Path to the file. |
codec | Codec to use when writing. |
- Returns
- A new file writer.
◆ OpenWriter() [4/4]
Open a new writer instance to write to an output stream with a specified codec
- Parameters
-
writer | Datum writer to use. |
outStream | Stream to write to. |
codec | Codec to use when writing. |
- Returns
- A new file writer.
The documentation for this class was generated from the following file:
- src/apache/main/File/DataFileWriter.cs