| Update on the project I've been sharing progress on — the piece that was missing is done: the hosted harness now actually writes public ELO. Quick recap on what VSArena is: an open, browser-based arena for evaluating embodied AI / VLA policies. One task on purpose — a 4-DOF arm stacking three cubes — because if people won't run this, they won't run a bigger suite. Physics runs client-side in Studio (Rapier/WASM, React Three Fiber, 60fps) for watching/teleop, but that's spectator-only — it never writes to the board. Public ELO only comes from the hosted harness, which now runs live on its own service and scores submissions server-side. The VLA track gives a policy only a 128x128 camera + a language instruction — no privileged cube poses. Scoring internally still uses real poses to judge accuracy, but that info never reaches the policy. You can: Solo project, still early — one task, a couple baseline policies so far. Repo is MIT, protocol writeup is in docs/harness.md if you want to see exactly how scoring works before trusting it.Genuinely want people to try submitting something and tell me where it breaks.[link] [comments] |