Skip to main content
SYS.ONLINE

One post tagged with "vlm"

View All Tags

Reachy Mini x Strands Agent on Jetson Thor - Part 4: Local Vision with NVIDIA Cosmos Reason 2

· 11 min read
Chiwai Chan
Tinkerer

Local vision pipeline: look_and_describe posts the latest camera frame as image_b64 to the warm cosmos_server, which runs NVIDIA Cosmos Reason 2 on the Thor GPU and returns the answer

This is Part 4 of the series. In Part 3 the robot learned to listen. Now I want to give it eyes: the ability to look through its camera and answer a question about the room — identify an object, read visible text, count things, or describe what a person is doing — entirely on-device.