Robonix Webots CI Report

Provider: deepseek · Model: deepseek-chat · Generated On: 2026-08-15T05:23:37+00:00 · Stage: success · Confidence: high

This run tested the merged PR #231 'fix(scene): reuse unchanged VLM inference' on commit e3d99d1. The change adds perceptual frame fingerprinting and bounded exponential backoff to the Scene VLM object detector and image-relation inferer, plus a new CI job and unit tests. All 16 Webots scenario tests passed, and the new pytest suite for VLM cache suppression passed. No failures were observed.

PR Changes

• Added CI job 'scene-vlm-cache' to run pytest on system/scene/tests/test_vlm_inference_cache.py
• Added vision_cache.py with FrameFingerprint, InferenceCounters, fingerprint_jpeg, fingerprint_bgr, frames_equivalent
• Modified perception_vlm.py to add frame change threshold, failure backoff, and caching of last successful detections
• Modified image_relations.py to add input signature caching, failure backoff, and reuse of cached edges
• Modified service.py to pass source timestamp with JPEG frame
• Updated README.md with new env vars for thresholds and backoff
• Added test_vlm_inference_cache.py with 8 regression tests

Test Result

• Webots CI ran 16 scenario tests covering navigation, exploration, mapping, memory, speech, and scene object listing; all passed (16/16). The scene service logged repeated VLM JSONDecodeError failures but the new backoff logic suppressed retries as designed, keeping the scene graph functional. The new pytest suite for VLM cache suppression passed.

Suggested Fix

• No fix needed. Watch for the fake-vlm JSONDecodeError in CI; it is expected and the backoff handles it. Consider adding a test that the backoff does not starve the scene graph when VLM is down.

Risks Or Watchouts

• The fake-vlm endpoint returns non-JSON, causing repeated VLM failures; the backoff prevents excessive retries but the scene graph never gets semantic edges in this environment.
• The new cache uses a 32x32 perceptual hash; very small object changes might be missed, but tests cover meaningful changes.
• The CI job installs pytest and dependencies but does not run the full scene test suite; only the new cache tests are run.

Evidence