dtype

Utilities and type definitions for working with dataset fields and column types.

Classes:

DatasetHeader

Encoded dataset file description.

class DatasetHeader

Encoded dataset file description.

Attributes:

compressed_fields	Field names that require decompression.
compression	Compression library used for in the dataset
dtype	Column description
length	Number of rows in the dataset

compressed_fields: List[str]

Field names that require decompression.

compression: Literal['lz4', None]

Compression library used for in the dataset

dtype: List[Tuple[str, str] | Tuple[str, str, Tuple[int, ...]]]

Column description

length: int

Number of rows in the dataset