Transforms event stream to a Parquet byte stream.
write_parquet [compression_level=int, compression_type=str]Description
Section titled “Description”Apache Parquet is a columnar storage format that a variety of data tools support.
compression_level = int (optional)
Section titled “compression_level = int (optional)”An optional compression level for the corresponding compression type. This option is ignored if no compression type is specified.
Defaults to the compression type’s default compression level.
compression_type = str (optional)
Section titled “compression_type = str (optional)”Specifies an optional compression type. Supported options are zstd for
Zstandard compression, brotli for brotli
compression, gzip for gzip compression, and snappy for
snappy compression.
Examples
Section titled “Examples”Write a Parquet file:
load_file "/tmp/data.json"read_jsonwrite_parquet