OrcSerDe class

A serializer to use for converting data to the ORC format before storing it in Amazon S3. For more information, see Apache ORC.

Constructors

OrcSerDe({int? blockSizeBytes, List<String>? bloomFilterColumns, double? bloomFilterFalsePositiveProbability, OrcCompression? compression, double? dictionaryKeyThreshold, bool? enablePadding, OrcFormatVersion? formatVersion, double? paddingTolerance, int? rowIndexStride, int? stripeSizeBytes})
OrcSerDe.fromJson(Map<String, dynamic> json)
factory

Properties

blockSizeBytes → int?
The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.
final
bloomFilterColumns → List<String>?
The column names for which you want Kinesis Data Firehose to create bloom filters. The default is null.
final
bloomFilterFalsePositiveProbability → double?
The Bloom filter false positive probability (FPP). The lower the FPP, the bigger the Bloom filter. The default value is 0.05, the minimum is 0, and the maximum is 1.
final
compression → OrcCompression?
The compression code to use over data blocks. The default is SNAPPY.
final
dictionaryKeyThreshold → double?
Represents the fraction of the total number of non-null rows. To turn off dictionary encoding, set this fraction to a number that is less than the number of distinct keys in a dictionary. To always use dictionary encoding, set this threshold to 1.
final
enablePadding → bool?
Set this to true to indicate that you want stripes to be padded to the HDFS block boundaries. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is false.
final
formatVersion → OrcFormatVersion?
The version of the file to write. The possible values are V0_11 and V0_12. The default is V0_12.
final
hashCode → int
The hash code for this object.
no setterinherited
paddingTolerance → double?
A number between 0 and 1 that defines the tolerance for block padding as a decimal fraction of stripe size. The default value is 0.05, which means 5 percent of stripe size.
final
rowIndexStride → int?
The number of rows between index entries. The default is 10,000 and the minimum is 1,000.
final
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
stripeSizeBytes → int?
The number of bytes in each stripe. The default is 64 MiB and the minimum is 8 MiB.
final

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toJson() → Map<String, dynamic>
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited