lance-format/lance

[DuckDB] Support export table from DuckDB to lance

Open

#654 opened on Mar 4, 2023

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Rust (695 forks)github user discovery
duckdbenhancementhelp wantedrust

Repository metrics

Stars
 (6,582 stars)
PR merge metrics
 (Avg merge 6d 1h) (219 merged PRs in 30d)

Description

Problem Statement

Duckdb allows to export a table via COPY/EXPORT command.

https://duckdb.org/docs/sql/statements/export.html

-- export the table contents with the given options
EXPORT DATABASE 'target_directory' (FORMAT CSV, DELIMITER '|');
-- export the table contents as parquet
EXPORT DATABASE 'target_directory' (FORMAT PARQUET);

Desired Behavior

In Lance duckdb extension, we could support COPY statement

COPY (SELECT * FROM tbl) TO 'output.lance' (FORMAT LANCE);

Contributor guide