parquet-viewer

Views Apache Parquet files as JSON.

Features

When opening a Parquet file, a JSON presentation of the file will open automatically:

automatic

After closing the JSON view, it is possible to reopen it by clicking on the link in the parquet view.

command

Backends

The extension supports three different backends for parsing the files:

arrow

This is the default backend. This backend is a thin wrapper around the Apache Arrow C++ implementation and so should support latest and greatest parquet features.

It is currently in an experimental state. To use, set parquet-viewer.backend setting to arrow.

parquets

This backend uses the parquets TypeScript library, which is a fork of the unmaintained kbajalc/parquets library with some bug fixes.

It only supports parquet version 1.0.0 with snappy compression.

parquet-tools

This is a legacy Java backend, using parquet-tools. To use that, you should set parquet-viewer.backend to parquet-tools and paruqet-tools should be in your PATH, or pointed by the parquet-viewer.parquetToolsPath setting.

settings

Settings

The following setting options are available:

name	default	description
`parquet-viewer.backend`	`parquets`	Which backend to use for reading the files
`parquet-viewer.logging.panel`	`false`	Whether to write diagnostic logs to an output panel
`parquet-viewer.logging.folder`	empty	Write diagnostic logs under the given directory
`parquet-viewer.logging.level`	info	Diagnostic log level. Choose between: `off`, `fatal`, `error`, `warn`, `info`, `debug` or `trace`
`parquet-viewer.jsonSpace`	0	JSON indentation space, passed to `JSON.stringify` as is, see mdn for details. Doesn't apply when `parquet-viewer.backend` is `parquet-tools`.
`parquet-viewer.parquetToolsPath`	`parquet-tools`	The name of the parquet-tools executable or a path to the parquet-tools jar

What's new

See CHANGELOG.md

parquet-viewer

Dvir Yitzchaki

parquet-viewer

Features

Backends

arrow

parquets

parquet-tools

Settings

What's new