Skip to content

feat(minimal): add scene capture, compact results and observation windows - #32

Merged
1rubbishyuan merged 9 commits into
Open-RUA:mainfrom
telxt:feat/minimal-token-window
Nov 10, 2026
Merged

1rubbishyuan merged 9 commits into
Open-RUA:mainfrom
telxt:feat/minimal-token-window

Conversation

@telxt

@telxt telxt commented Nov 10, 2026

Copy link
Copy Markdown
Contributor

Minimal manipulation needs fresh observations without dummy motion, readable robot geometry, and smaller model-facing feedback. This change makes its tool set move, hold, capture_scene, and finish, supporting calibrated RGB or RGB-only observations with depth disabled.

  • Publish robot reference resources and immutable snapshot/image paths through the shared artifact pipeline. Keep full stored observations and original calibration available for later reads.
  • Present compact minimal results with six-value poses, rounded physical values and reduced duplicate feedback, while preserving errors and diagnostic evidence. Clarify gripper sequencing, observation access and completion guidance.
  • Add opt-in --context-policy observation_window --context-observation-horizon 2. It ages recognized observation images and calibration together while preserving file references, action/state/feedback history, assistant text, reasoning and continuation summaries. Initial/reference images and images with unknown ownership remain protected; this is not a total-context token cap. Existing context policies remain available.
  • Honor Qwen --reasoning-effort none by sending enable_thinking=false. The adapter's non-thinking output limit is 8192 tokens, compared with 65536 with thinking enabled.

Validation: package build/install and CLI configuration checks completed. RoboDojo RGB-only and calibrated 42-episode runs exercised the compact results and observation window; saved requests confirmed readable image references, calibration delivery and image eviction. Qwen requests also confirmed thinking disabled with zero reported reasoning tokens. These runs establish execution and observation behavior, not an improvement in task success or billed cost. Native coverage of other environments remains limited.

telxt added 9 commits November 9, 2026 14:00
Project model-facing state, feedback and calibration without changing execution, image attachments or stored evidence. Preserve recovery diagnostics and share the result view across all minimal integrations.
Bound historical tool images and paired calibration while preserving text, reasoning, action history and native compaction input. Keep the existing identity and sliding-window policies independent.
Keep per-camera image paths in compact results and aged history. Align snapshot access guidance, age already-windowed metadata, and handle nullable hold IK statistics without invalidating completed motion.
# Conflicts:
#	CHANGELOG.md
#	uni_robot_agent/tools/scene/provider.py
@1rubbishyuan
1rubbishyuan merged commit 562c4c7 into Open-RUA:main Nov 10, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants