Skip to content

[python] Speed up video keyframe index deserialization - #10794

Merged
JingsongLi merged 3 commits into
apache:masterfrom
XiaoHongbo-Hope:python-video-index-batch-parse
Oct 25, 2026
Merged

JingsongLi merged 3 commits into
apache:masterfrom
XiaoHongbo-Hope:python-video-index-batch-parse

Conversation

@XiaoHongbo-Hope

@XiaoHongbo-Hope XiaoHongbo-Hope commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

Purpose

Speed up video seek-index deserialization with batch validation and a single tuple construction, avoiding repeated per-entry Python processing.

Preserve the wire format, tuple API and validation rules. Decompression remains bounded by the existing entry limit; writer-side validation remains streaming.

Tests

Added regression coverage for validation parity and bounded decompression. Related video and LeRobot tests pass.

@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as draft October 24, 2026 12:56
@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as ready for review October 24, 2026 14:17
@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit e20de7d into apache:master Oct 25, 2026
19 of 21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants