Skip to content

Add a HybridReader for use in write constrained databases #423

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jimhester wants to merge 8 commits into
base: main
Choose a base branch
from
+413 −0
Open

Add a HybridReader for use in write constrained databases #423

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
d111b71
feat(reader): add HybridReader (primary + DuckDB staging composition)
jimhester May 1, 2026
80f2770
test(reader): tighten hybrid dialect/cross-side tests to discriminate
jimhester May 1, 2026
27a4b8b
feat(reader): export HybridReader behind 'duckdb' feature
jimhester May 1, 2026
4df07d2
style(hybrid): apply cargo fmt + clippy fixes
jimhester May 1, 2026
138ddee
docs(changelog): announce HybridReader
jimhester May 1, 2026
a30cda2
fix(reader): register builtin datasets without DuckDB parquet extension
jimhester May 4, 2026
7aa76ae
Merge remote-tracking branch 'upstream/main' into pr2-hybrid-reader
jimhester May 4, 2026
d32e11a
Merge upstream/main into pr2-hybrid-reader
jimhester May 28, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
## [Unreleased]

### Added

- New `HybridReader` that composes any primary `Reader` with an in-process `DuckDBReader` for staging. `register()` writes to staging; `execute_sql` routes queries that reference registered names to staging and everything else to the primary. Available behind the existing `duckdb` feature.
- New `AdbcReader<D: Driver>` for connecting to data sources via
[ADBC](https://arrow.apache.org/adbc/) (Arrow Database Connectivity), behind
a new off-by-default `adbc` feature flag. Generic over any concrete
Expand Down
Loading
Loading