Skip to content

Opteryx: pin 0.9.164, add opteryx-parquet-rewritten, retire opteryx-skene - #2496

Open
joocer wants to merge 1 commit into
ClickHouse:mainfrom
joocer:opteryx-0.9.164
Open

joocer wants to merge 1 commit into
ClickHouse:mainfrom
joocer:opteryx-0.9.164

Conversation

@joocer

@joocer joocer commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Refresh Opteryx

Notes:

  • opteryx/: install pins opteryx-core==0.9.164 - Includes a fix for a bug that refused local Parquet scans on >=66 vCPU hosts (seen as 41/43 nulls on the 192-vCPU metal machines in the previous submission).
  • opteryx-parquet-rewritten/: new entry. load rewrites the partitioned hits with Opteryx's own Parquet writer (zstd, 64k-row groups, blocks of 4) and reports that as load time. Same server and queries as opteryx/.
  • opteryx-skene/: superseded by rewritten parquet.
  • Results: one compliant c6a.4xlarge run of each entry (2026-10-09).

This includes an entry that is running against parquet files written by Opteryx's engine as (parquet, rewritten) with the full rewrite counted as load time. I’ve classed it as Parquet under the “converted on load” definition in index.html, as with entries like pg_ducklake that write their own Parquet on load. If you’d prefer a different annotation, let me know, and I’ll adjust it.

…kene

- opteryx/: install pins opteryx-core==0.9.164. 0.9.155 is no longer on PyPI,
  and it refused local Parquet scans on >=66 vCPU hosts (41/43 nulls on the
  192-vCPU metal machines).
- opteryx-parquet-rewritten/: new entry. load rewrites the partitioned hits
  with Opteryx's own Parquet writer (zstd, 64k-row groups, blocks of 4) and
  reports that as load time. Same server and queries as opteryx/.
- opteryx-skene/: removed.
- Results: one compliant c6a.4xlarge run of each entry (2026-10-09).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@joocer
joocer requested a deployment to benchmark-approval October 9, 2026 21:46 — with GitHub Actions Waiting
@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

This branch is waiting to be deployed

1 waiting deployment
benchmark-approval — aa7df75d Waiting Oct 9, 2026 by joocer via launch #732
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant