Skip to content

Deep1b dataset support.#13

Open
shaharuk-yb wants to merge 7 commits into
yb-rm-alter-tablefrom
deep1b
Open

Deep1b dataset support.#13
shaharuk-yb wants to merge 7 commits into
yb-rm-alter-tablefrom
deep1b

Conversation

@shaharuk-yb

Copy link
Copy Markdown
  • download source dataset file
  • convert source dataset hdf5 file to vectordbbench supported .parquet format.
  • create train.parquet and test.parquet file from source dataset
  • integrate support for loading
  • increased load batch size for this dataset to 1mil

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant