Skip to main content
SYS.ONLINE

3 posts tagged with "vision"

View All Tags

Reachy Mini x Strands Agent on Jetson Thor - Part 10: Real-Time Face Tracking with a Single Camera Owner

· 9 min read
Chiwai Chan
Tinkerer

A single camera-owner thread publishes the latest frame to the face tracker and Cosmos Reason 2

This is Part 10 of the series. The robot can already look on demand with Cosmos vision and notice who's around while idle. Now I want it to feel present: its head should follow your face in real time — and it has to do that while Cosmos vision and the idle watcher are also using the camera.

Reachy Mini x Strands Agent on Jetson Thor - Part 9: Idle Presence — Noticing Who's Around (Humans vs Cats)

· 9 min read
Chiwai Chan
Tinkerer

Idle presence watcher: a single frame goes to Cosmos Reason 2, and a minimal agent routes the observation to report_human_presence and report_cat_presence

This is Part 9 of the series. So far the robot only acts when triggered — a wake word or an MQTT message. Now I want it to show a little life between interactions: while resting, it should quietly notice who's in the room and have a place to hang future reactions — greet a person, perk up at a cat.

Reachy Mini x Strands Agent on Jetson Thor - Part 4: Local Vision with NVIDIA Cosmos Reason 2

· 11 min read
Chiwai Chan
Tinkerer

Local vision pipeline: look_and_describe posts the latest camera frame as image_b64 to the warm cosmos_server, which runs NVIDIA Cosmos Reason 2 on the Thor GPU and returns the answer

This is Part 4 of the series. In Part 3 the robot learned to listen. Now I want to give it eyes: the ability to look through its camera and answer a question about the room — identify an object, read visible text, count things, or describe what a person is doing — entirely on-device.