Skip to content

fix(provider): deliver Omni images as lossless WebP - #33

Merged
1rubbishyuan merged 2 commits into
Open-RUA:mainfrom
1rubbishyuan:fix/omni-lossless-webp
Nov 10, 2026
Merged

1rubbishyuan merged 2 commits into
Open-RUA:mainfrom
1rubbishyuan:fix/omni-lossless-webp

Conversation

@1rubbishyuan

Copy link
Copy Markdown
Contributor

Omni image-heavy sessions can exceed request body limits as PNG observations accumulate. Both Omni profiles now encode inline PNGs as lossless WebP after context selection, preserving pixels, dimensions, tool receipts, and the original history. Existing batched sliding_window remains the mechanism for bounding image history.

Also accept an empty streamed tool-argument delta when the Messages content block already contains {}. Previously, a valid no-argument tool call failed JSON parsing before dispatch; malformed nonempty arguments and incomplete streams still fail validation.

Validation:

  • Seven CPU checks cover pixel fidelity, original-history preservation, tool/image delivery through both adapters, batched eviction, and streamed argument handling.
  • Built and installed the wheel into isolated planner and simulator environments; both experiment CLI configurations validate.
  • Live Codex tool-calling sessions through Opus medium and Gemini Flash high both read a random image and returned its exact digits plus a random nonce. Each session exercised eviction of 20 older tool images and subsequent WebP delivery. This verifies provider compatibility, not benchmark performance.

@1rubbishyuan
1rubbishyuan merged commit 4817efc into Open-RUA:main Nov 10, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant