Follow-up: VSArena now has a proper VLA track (camera + language, no privileged state) — repo and docs are public
Follow-up: VSArena now has a proper VLA track (camera + language, no privileged state) — repo and docs are public

Follow-up: VSArena now has a proper VLA track (camera + language, no privileged state) — repo and docs are public

Follow-up: VSArena now has a proper VLA track (camera + language, no privileged state) — repo and docs are public

Posted about this project a little while ago — quick update since a few things changed that address feedback from that thread.

Biggest change: split the observation space properly. There's now a VLA track where the policy only gets a 128x128 RGB camera + a language stacking instruction — cube poses are never sent to the policy. Scoring still uses real poses internally to grade spatial accuracy and completion, but that's judge-only, not policy-visible. State-based (privileged poses) is kept as a separate debug track and doesn't write public ELO either — wanted the "VLA vs state" distinction to be explicit rather than something people had to dig for.

On the client-side physics concern from before:Studio (the in-browser demo) is spectator/dev-only, clearly labeled, and does not post to the public leaderboard. Public ELO only comes from a hosted harness that scores server-side. That harness isn't live yetit's the one piece standing between this and actually being open for submissions.

Repo + docs are public now:https://github.com/NovaCoding-G/VSArena
-docs/harness.md — scoring writeup (spatial accuracy + task completion)
-docs/sdk.md — submission protocol
-Studio itself:https://vsarena.vercel.app/simulation
(client-side, Rapier/WASM, 60fps)

Still solo, still early, still not oversell-ready — but wanted to share since the VLA/state separation was directly a response to feedback here. Open to more of that, especially on what the scoring protocol might be missing.

submitted by /u/NovaCoding
[link] [comments]