Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .github/workflows/pr-workflow.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -101,6 +101,8 @@ jobs:
AWS_DYNAMODB_VECTOR_INDEX: ${{ secrets.AWS_DYNAMODB_VECTOR_INDEX }}
AZURE_SEARCH_ENDPOINT: ${{ secrets.AZURE_SEARCH_ENDPOINT }}
AZURE_SEARCH_API_KEY: ${{ secrets.AZURE_SEARCH_API_KEY }}
TURBOPUFFER_API_KEY: ${{ secrets.TURBOPUFFER_API_KEY }}
TURBOPUFFER_REGION: ${{ secrets.TURBOPUFFER_REGION }}
run: |
make test_unit
Expand Down
46 changes: 43 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,9 @@ CLI tool for migrating data to [Qdrant](http://qdrant.tech) with support for res
* Elasticsearch
* Azure AI Search
* Postgres (pgvector)
* S3 Vectors
* Amazon S3 Vectors
* Amazon DynamoDB
* Turbopuffer
* FAISS
* Apache Solr
* Another Qdrant instance
Expand Down Expand Up @@ -515,9 +516,9 @@ docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration
</details>

<details>
<summary><h3>From S3 Vectors</h3></summary>
<summary><h3>From Amazon S3 Vectors</h3></summary>

Migrate data from an **S3 Vectors** index to **Qdrant**:
Migrate data from an **Amazon S3 Vectors** index to **Qdrant**:

### 📥 Example

Expand Down Expand Up @@ -611,6 +612,45 @@ docker run --net=host --rm -it \

</details>

<details>
<summary><h3>From Turbopuffer</h3></summary>

Migrate vectors and attributes from a **Turbopuffer** namespace to **Qdrant**:

### 📥 Example

```bash
docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration turbopuffer \
--turbopuffer.namespace 'your-namespace' \
--turbopuffer.api-key 'your-turbopuffer-api-key' \
--turbopuffer.region 'gcp-us-central1' \
--qdrant.url 'http://target-hostname:6334' \
--qdrant.api-key 'optional-qdrant-api-key' \
--qdrant.collection 'target-collection' \
--migration.batch-size 64
```

#### Turbopuffer Options

| Flag | Description |
| ------------------------- | -------------------------------------------------------------- |
| `--turbopuffer.namespace` | Turbopuffer namespace to migrate (required) |
| `--turbopuffer.api-key` | Turbopuffer API key (required) |
| `--turbopuffer.region` | Turbopuffer region, e.g. `gcp-us-central1` (required) |

#### Qdrant Options

| Flag | Description |
| --------------------- | ------------------------------------------------------------------ |
| `--qdrant.url` | Qdrant gRPC URL. Default: `"http://localhost:6334"` |
| `--qdrant.collection` | Target collection name |
| `--qdrant.api-key` | Qdrant API key (optional) |
| `--qdrant.id-field` | Payload field storing the Turbopuffer document ID. Default: `"__id__"` |

* See [Shared Migration Options](#shared-migration-options) for common migration parameters.

</details>

<details>
<summary><h3>From FAISS</h3></summary>

Expand Down
Loading
Loading