Skip to main content
SYS.ONLINE

2 posts tagged with "VLA"

Vision-Language-Action models

View All Tags

Augment Stage: NVIDIA Cosmos3 Transfer on an NVIDIA Jetson AGX Thor for the Seeed Studio reBot Arm B601-RS

· 10 min read
Chiwai Chan
Tinkerer

For the GR00T N1.7 fine-tune I borrowed someone else's dataset, prateeks-iu/rebot_b601_rs_sugar: 103 episodes of a robot arm picking up a sugar cube. All of them were recorded in the same room, on the same white table, under the same light.

A model trained on that learns the table as much as it learns the task.

The usual fix is to record more data somewhere else. The other fix is to repaint the data you already have — keep the arm's motion exactly as it was, and change everything behind it. That is what Cosmos3 Transfer does.

I had a Jetson AGX Thor on my desk and wanted to know whether it could run Cosmos3 Transfer on that dataset. Six days later: 309 episodes.

Fine-Tuning NVIDIA Isaac GR00T N1.7 on a Jetson AGX Thor for the Seeed Studio reBot Arm B601-RS

· 9 min read
Chiwai Chan
Tinkerer

Seeed Studio reBot Arm B601-RS on a desk: a six-axis arm in black and lime green with machined aluminium joints, a gripper at one end and a camera mounted above the wrist

I always assumed any form of model tuning meant a big hardware investment, or renting a huge compute instance in the cloud.

Then, in a separate project with nothing to do with this arm, I used supervised fine-tuning and distillation on Amazon Bedrock to build custom Amazon Nova models. It cost far less than I expected. First assumption gone.

NVIDIA Jetson AGX Thor Developer Kit: a compact dark grey unit with a ribbed black panel on top

The second one lasted longer: I was sure my Jetson AGX Thor couldn't train GR00T. Not enough hardware.

So I wanted one question answered: can this hardware train the model at all?

That's why I borrowed someone else's dataset rather than recording my own — it keeps my arm, my calibration and my teleoperation out of the experiment, so the only thing being tested is the Thor.

It worked.