← Sinan Lab › Public benchmark scores

Public benchmark scores

Scores as printed in each model’s paper, official README or model card; third-party reproductions are labelled. Grouped by benchmark, never aggregated across benchmarks. Protocols differ between papers (fine-tuning, trials, checkpoints), so read the notes before comparing rows.

340 scores39 models with at least one score10 benchmarks

LIBERO sim

Franka single-arm simulated manipulation; four suites (Spatial / Object / Goal / Long), usually fine-tuned per suite and evaluated over 500 trials. · metric:success rate % · libero-project.github.io/

ModelspatialobjectgoallongavgSource
Galaxea G0.5
Galaxea
98.410098.698.698.9 paper Table 3, row 'G0.5 (Ours)', column 'Spatial'
Table 3 'Results on LIBERO'. Fine-tuned 100K steps (lr 1e-5) on the four suites; 10 tasks/suite, 50 demos/task; evaluated 50 rollout trials per task with benchmark initial states. Baselines: pi0.5 98.8/98.2/98.0/92.4/96.9, GR00T-N1.7 97.7/98.5/97.5/94.4/97.0, Xiaomi-Robotics-0 98.8/100.0/98.8/97.2/98.7.
InternVLA-A1.5
Shanghai AI Laboratory InternRobotics
98.699.898.698.498.9 paper Table 5, row 'InternVLA-A1.5 (Ours)', column 'Spatial'
Table 5 'Results on LIBERO'. Backbone Qwen-3.5 2B + 460M unified expert. Trials per task not stated in the extracted text (standard LIBERO protocol implied). Baselines: pi0.5 98.8/98.2/98.0/92.4/96.9, OpenVLA-OFT 97.6/98.4/97.9/94.5/97.1, Xiaomi-Robotics-0 98.8/100.0/98.8/97.2/98.7.
VLA-AdapterVLA-Adapter-Pro
OpenHelix team
99.699.698.296.498.5 paper Table 5, row 'VLA-Adapter-Pro (Ours)', column Spatial
Qwen2.5-0.5B backbone, no robotic pre-training; trained per suite; each subtask repeated 50 times (500 trials per suite). Pro = updated policy implementation (Appendix); marked best (Bold*).
EO-1
IPEC-COMMUNITY (Shanghai AI Laboratory affiliated)
99.799.899.294.898.2 paper Table 3, row 'EO-1 (Ours)', LIBERO-Spatial SR
Fine-tuned per suite; printed with standard error and rank 1 in every column. Printed as 99.7 ± 0.2%.
X-VLAX-VLA-0.9B
Tsinghua University AIR (2toINF)
98.298.697.897.698.1 paper Table 2, row 'X-VLA (Ours)', LIBERO Spatial (also Table 13)
Phase-II domain adaptation fine-tune on LIBERO (appendix config: Abs EEF, batch 128, 60K steps); trial count not stated in fetched text
VLA-AdapterVLA-Adapter
OpenHelix team
97.899.297.29597.3 paper Table 5, row 'VLA-Adapter (Ours)', column Spatial
Qwen2.5-0.5B backbone, no robotic pre-training; trained per suite; each subtask repeated 50 times (500 trials per suite).
DexVLA
Midea AI Research et al. (DexVLA team)
97.299.195.697.3 paper Table 3, row 'DexVLA', column 'Spatial'
Table 3 'Evaluations results on LIBERO. We compare our DexVLA with DP and OpenVLA' (Appendix). Columns are Spatial | Object | Goal | Average only - NO LIBERO-Long/LIBERO-10 column; 'Average' is over the three suites as printed. Baseline rows: DP 78.3/92.5/68.3/79.7, OpenVLA 84.7/88.4/79.2/84.1, pi0-FAST 96.4/96.8/88.6/93.9, pi0 96.8/98.8/95.8/97.1. DexVLA = Qwen2-VL 2B + 1B diffusion expert. Trials per task not stated in extracted text.
OpenVLAOpenVLA-OFT
Stanford / UC Berkeley / TRI et al. (OpenVLA team)
97.698.497.994.597.1 paper Table I, row 'OpenVLA-OFT' (multi-input setup, modified dataset), Spatial
OpenVLA-OFT fine-tuned per suite; multi-input (third-person + wrist image + proprio); 500 trials per suite (10 tasks x 50 episodes); OFT paper by the OpenVLA authors
π0.5π0.5 fine-tuned (pi05_libero checkpoint, @30k steps)
Physical Intelligence
98.898.29892.496.9 official openpi examples/libero README results table, row 'π0.5 @ 30k (finetuned)', Libero Spatial
Checkpoint gs://openpi-assets/checkpoints/pi05_libero trained with the pi05_libero config; number of trials not stated. README undated; fetched 2026-09-18. The π0.5 paper (arXiv 2504.16054) prints no numeric benchmark tables
InternVLA-M1
Shanghai AI Laboratory InternRobotics
989993.892.695.9 paper Table 4, row 'InternVLA-M1', column Spatial
Fine-tuned per suite following OpenVLA-OFT protocol (failed demos and pause frames filtered; wrist + third-person views).
UniVLAUniVLA (Full)
OpenDriveLab (HKU et al.)
96.596.895.69295.2 paper Table I, row 'UniVLA (Ours)' / 'Full', column Spatial
Fine-tuned per suite; 500 trials per suite (50 per task) averaged over three seeds. 'Full' = pretrained on the full latent-action pretraining mixture.
VLA-0
NVIDIA Research
9797.896.287.694.7 paper Table I, row 'VLA-0 (Ours)', column 'Spatial'
Table I 'Performance on Libero. We report the success rate for four LIBERO suites, for two category of models, with and without large scale action pretraining.' VLA-0 is in the 'without large-scale action pretraining' category. Base model Qwen2.5-VL-3B-Instruct; actions emitted as text (no vocabulary/architecture change); 50 episodes per task x 10 tasks per suite; eval uses action horizon 1 with ensemble of 8 predictions (README). Same-category baselines: pi0.5-KI 96.6/97.2/94.6/85.8/93.3, OpenVLA-OFT 94.3/95.2/91.7/86.5/91.9, SmolVLA 93.0/94.0/91.0/77.0/88.8. Numbers also on project page https://vla0.github.io/.
π0 (pi-zero)π0 (fine-tuned per suite)
Physical Intelligence
96.898.895.885.294.2 third-party OpenVLA-OFT paper, Table I, row 'π0 (fine-tuned)' (multi-input setup, modified dataset), Spatial
Fine-tuned by the OFT authors per suite; 500 trials per suite (10 tasks x 50 episodes). The π0 paper itself (arXiv 2410.24164) reports only bar-chart figures with no printed benchmark values
UniVLAUniVLA (Bridge)
OpenDriveLab (HKU et al.)
92.5 paper Table I, row 'UniVLA (Ours)' / 'Bridge', Average
Pretrained only on Bridge-V2. Subsets: 95.2 / 95.4 / 91.9 / 87.5.
SmolVLASmolVLA 2.25B
Hugging Face (LeRobot)
88.8 paper Table 2, row 'SmolVLA (2.25B)', LIBERO Avg (Spatial 93 / Object 94 / Goal 91 / Long 77)
Larger VLM-backbone variant; X-VLA paper Table 2 reprints this row as 93.0/94.0/91.0/77.0/88.8
UniVLAUniVLA (Human)
OpenDriveLab (HKU et al.)
88.7 paper Table I, row 'UniVLA (Ours)' / 'Human', Average
Pretrained only on action-free human video. Subsets: 91.2 / 94.2 / 90.2 / 79.4.
NORANORA-Long-fine-tuned
Declare Lab (SUTD)
92.295.489.474.687.9 paper Table 2, row 'NORA-Long-fine-tuned (Ours)', LIBERO-Spatial
Fine-tuned per suite; 500 trials per suite. NORA-Long = action-horizon-5 variant.
SmolVLASmolVLA 0.45B (main)
Hugging Face (LeRobot)
9096927187.3 paper Table 2, row 'SmolVLA (0.45B)', LIBERO Spatial
Simulation fine-tuning 100k steps, batch 64; 10 trials per task, binary success; whether one multitask checkpoint or one per suite was not confirmed from the fetched text
MolmoActMolmoAct-7B-D
Allen Institute for AI(Ai2)
8795.487.677.286.6 paper Table 2, row 'MolmoAct-7B-D', column Spatial
Fine-tuned per suite by LoRA post-training on MolmoAct-7B-D (Table 7 hyperparameters).
π0 (pi-zero)π0-FAST (π0 + FAST tokenizer, fine-tuned)
Physical Intelligence
85.5 third-party OpenVLA-OFT paper, Table I, row 'π0 + FAST (fine-tuned)', Average (Spatial 96.4 / Object 96.8 / Goal 88.6 / Long 60.2)
Same protocol as π0 row
SmolVLASmolVLA 0.24B
Hugging Face (LeRobot)
82.8 paper Table 2, row 'SmolVLA (0.24B)', LIBERO Avg (87 / 93 / 88 / 63)
Smaller variant
NORANORA-fine-tuned-AC
Declare Lab (SUTD)
79.5 paper Table 2, row 'NORA-fine-tuned-AC (Ours)', Average
AC = action chunking. Subsets: 85.6 / 89.4 / 80 / 63.
SpatialVLA
Shanghai AI Laboratory et al.
88.289.978.655.578.1 paper Table III, row 'SpatialVLA fine-tuned', LIBERO-Spatial
Fine-tuned per LIBERO suite (LoRA + spatial embedding adaption); success rate averaged over 3 random seeds with 500 trials per suite; printed with standard error. Printed as 88.2 ± 0.5%.
OpenVLA
Stanford / UC Berkeley / TRI et al. (OpenVLA team)
84.788.479.253.776.5 paper Table 12 (Appendix E.2), row 'OpenVLA fine-tuned (ours)', LIBERO-Spatial SR (84.7 ± 0.9%)
Fine-tuned separately per suite via LoRA r=32 on modified LIBERO data (no-op actions filtered, failed demos removed, 256px re-render, third-person camera only); 500 trials per suite averaged over 3 seeds (1500 trials); ± is std err
OctoOcto-Base
UC Berkeley RAIL et al.
78.985.784.651.175.1 third-party OpenVLA paper, Table 12, row 'Octo fine-tuned', LIBERO-Spatial (78.9 ± 1.0%)
Octo fine-tuned per suite by OpenVLA authors on their modified LIBERO data; 500 trials x 3 seeds
NORANORA-fine-tuned
Declare Lab (SUTD)
73.9 paper Table 2, row 'NORA-fine-tuned (Ours)', Average
Subsets: 85.6 / 87.8 / 77 / 45. 500 trials per suite.
X-VLAX-VLA-0.9B PEFT (LoRA adapters, ~9M params)
Tsinghua University AIR (2toINF)
96.283.2 official README results table, row 'X-VLA-libero-spatial-peft'
Parameter-efficient adapters; README also lists Object 96%, Goal 94.4%, Long 83.2%, Simpler WidowX PEFT 66.7%; paper text (Sec. 5.2) quotes '93%' LIBERO and '54%' Simpler-WidowX for PEFT with 1% tunable params
Isaac GR00T N1.7GR00T N1.7-3B fine-tuned (single checkpoint, 4 suites)
NVIDIA
97.798.597.594.4 official examples/LIBERO README results, N1.7-3B, Spatial 97.65% (195/200)
Single checkpoint fine-tuned on all four suites with identical hyperparameters (max 20,000 steps, global batch 640, state dropout 0.2); 10 episodes per task (200 per suite); no average printed. README undated; fetched 2026-09-18
GraspVLAGraspVLA (zero-shot, grasp-only LIBERO)
Peking University EPIC Lab / Galbot
94.191.282 paper Table 2, row 'Ours (zero-shot)', column Object
ZERO-SHOT and NON-STANDARD: LIBERO tasks rewritten as grasp-only 'pick up {object}' instructions (modifications in Tables 10-12); Spatial suite excluded; grasping any object of the target category counts as success; 50 randomized initial configurations per task. Baselines (fine-tuned): OpenVLA 33.7/56.6/65.4, pi0 62.7/79.4/93.8.

SimplerEnv · Google Robot sim

Real-to-sim evaluation on Google Robot tasks (pick coke can, move near, open/close drawer); reported as visual matching and variant aggregation. · metric:success rate % · simpler-env.github.io/

Modelvisual_matchingvariant_aggregationreadme_fractal_6_task_avgpick_coke_can_avgmove_nearopen_close_drawer_avgopen_top_drawer_and_place_appleaggregate_setting_unlabelledSource
X-VLAX-VLA-Google-Robot checkpoint
Tsinghua University AIR (2toINF)
83.576.4 official README results table, row 'X-VLA-Google-Robot', Google Robot (VM)
README value differs from paper Table 2 (80.4); VA in README = 76.4%. README undated; fetched 2026-09-18
InternVLA-M1
Shanghai AI Laboratory InternRobotics
80.776 paper Table 1, row 'InternVLA-M1', Visual Matching Avg
Per-task: Pick Coke Can 95.3, Move Near 90.0, Open/Close Drawer 75.5, Open Top Drawer and Place Apple 62.0. Trained with spatial prompting (checkmark column).
X-VLAX-VLA-0.9B
Tsinghua University AIR (2toINF)
80.475.7 paper Table 2, row 'X-VLA (Ours)', Simpler VM; Table 12 per task Coke 98.3 / Near 97.1 / Open 69.5 / Put 56.5, Average 80.4
Adapted to Simpler-Fractal (Google Robot). NOTE: the GitHub README reports 83.5% VM for checkpoint X-VLA-Google-Robot (different from paper)
CogACTCogACT-Large (DiT-Large, 308M)
Microsoft Research
76.759.3 paper Table 7 (action model scaling), row 'DiT-Large', Google VM
Same eval protocol as Table 1
EO-1
IPEC-COMMUNITY (Shanghai AI Laboratory affiliated)
76.563 paper Table 4, Google Robot Benchmark (Matching), row 'EO-1 (Ours)', Average
Per-task: Pick Coke Can 98.0, Move Near 83.8, Open/Close Drawer 71.3, Drawer Apple 52.8.
SpatialVLASpatialVLA (fine-tuning)
Shanghai AI Laboratory et al.
75.170.7 paper Table I, row 'SpatialVLA (fine-tuning)', Visual Matching #Average
Fine-tuned on Google Fractal dataset. Per-task: 86.0 / 77.9 / 57.4.
CogACTCogACT-Base (DiT-Base action module)
Microsoft Research
74.861.3 paper Table 1 (Visual Matching), row 'CogACT', Average
Trained on OXE subsets, evaluated zero-shot in SIMPLER; per task Pick Coke Can 91.3, Move Near 85.0, Open/Close Drawer 71.8, Open Top Drawer & Place Apple 50.9; Table 7 confirms the default is DiT-Base (89M)
CogACTCogACT-Small (DiT-Small, 13M)
Microsoft Research
73.3 paper Table 7, row 'DiT-Small', Google VM
VA 51.3, WidowX VM 51.0 in same row
SpatialVLASpatialVLA (zero-shot)
Shanghai AI Laboratory et al.
71.968.8 paper Table I, row 'SpatialVLA (zero-shot)', Visual Matching #Average
Zero-shot OXE-pretrained checkpoint. Per-task: Pick Coke Can 81.0, Move Near 69.6, Open/Close Drawer 59.3.
MolmoActMolmoAct (fine-tuned)
Allen Institute for AI(Ai2)
71.672.1 paper Table 1, row 'MolmoAct (fine-tuned)', Visual Matching Avg
Fine-tuned on RT-1 dataset (MolmoAct-7B-D-Pretrain-RT-1). Per-task: 77.7 / 77.1 / 60.0.
MolmoActMolmoAct (zero-shot)
Allen Institute for AI(Ai2)
70.559.3 paper Table 1, row 'MolmoAct (zero-shot)', Visual Matching Avg
Zero-shot OXE pre-trained checkpoint (MolmoAct-7B-D-Pretrain). Per-task: Pick Coke Can 71.3, Move Near 73.8, Open/Close Drawer 66.5.
π0 (pi-zero)
Physical Intelligence
58.856.8 third-party X-VLA paper, Table 2, row 'π0 (Black et al., 2024a)', Simpler VM
As reprinted by X-VLA; VA 56.8, WidowX 27.8 in same row; X-VLA text says π0 achieves 55.7% on Simpler-WidowX in their own fine-tune (Table 3 area)
OpenVLA
Stanford / UC Berkeley / TRI et al. (OpenVLA team)
34.339.3 third-party CogACT paper, Table 1 (Visual Matching), row 'OpenVLA', Average
Zero-shot SIMPLER eval of the released OpenVLA checkpoint by the CogACT authors; 4-task average (Pick Coke Can 18.0, Move Near 56.3, Open/Close Drawer 63.0, Open Top Drawer & Place Apple 0.0)
OctoOcto-Base
UC Berkeley RAIL et al.
111.2 third-party CogACT paper, Table 1 (Visual Matching), row 'Octo-Base', Average
4-task average (17.0 / 4.2 / 22.7 / 0.0). The SimplerEnv paper itself (arXiv 2405.05941, Table IV) prints only per-task fractions for Octo-Base VM (Pick Coke Can 0.170, Move Near 0.042, Open/Close Drawer 0.227, Open Top Drawer & Place Apple 0.000) with no average column. X-VLA paper Table 2 prints 16.8 for Octo VM (likely 3-task average)
Isaac GR00T N1.7GR00T N1.7 fine-tuned on Fractal
NVIDIA
72.5 official examples/SimplerEnv README, Fractal (Google Robot) table, column N1.7, 'Average'
NON-STANDARD task set: 6 Fractal tasks (pick_coke_can 100.0, pick_object 94.0, move_near 100.0, open_drawer 65.0, close_drawer 69.0, place_in_closed_drawer 7.0); visual-matching vs variant-aggregation not specified; fine-tuned 20,000 steps batch 1024; 10 episodes per task
GR00T N1.6 3BGR00T N1.6 fine-tuned on Fractal
NVIDIA
52 official examples/SimplerEnv README, Fractal (Google Robot) table, column N1.6, 'Average'
Same non-standard 6-task Fractal set as N1.7 entry (95.0 / 87.0 / 81.0 / 0.0 / 44.0 / 5.0)
RoboVLMs(KosMos P.H.)KosMos P.H. (KosMos-2 backbone, policy-head, history)
Tsinghua University / ByteDance Research / CASIA et al.
1 fraction0.9 fraction0.6 fraction0.3 fraction paper Extended Table 3(d), row 'RoboVLMs (Ours)', column 'Pick Coke Can / Average'
Extended Table 3(d) 'Simulation performance on SimplerEnv-Google Robot environments'. Values printed as fractions. Column structure: Pick Coke Can {Horizontal Laying, Vertical Laying, Standing, Average}, Move Near {Average}, Open/Close Drawer {Open, Close, Average}, Open Top Drawer and Place Apple {Average}. RoboVLMs row as printed: 1.000 | 0.910 | 1.000 | 0.970 | 0.888 | 0.565 | 0.537 | 0.551 | 0.325. No overall average printed. Row is identical to the 'In-domain Full Finetune' row of Extended Table 3(f) (fine-tuned on full RT-1/fractal data; tested tasks included). Caption does not name visual matching vs variant aggregation; the baseline rows (e.g. RT-1 Converged 0.857 / 0.442 / 0.730) coincide with SimplerEnv's published visual-matching values.
Magma-8B
Microsoft Research
52.3 paper Table 2 'Zero-shot evaluation on agentic intelligence', row 'Magma-8B (Ours)', column 'SE-Google Robot'
Zero-shot: pretrained Magma-8B 'without any domain-specific finetuning'. Caption: SE = SimplerEnv. Text: 8 tasks with 172 visual matching and variant aggregation scenarios; Table 2 does not label which setting; Fig. 8 caption says per-task results are averaged across visual matching and variant aggregation. Same column: OpenVLA 31.7, RT-1-X 34.2, Octo 6.0. Also confirmed on HF model card https://huggingface.co/microsoft/Magma-8B. No per-task table in the HTML; LIBERO (Fig. 10, 10 trajectories/task few-shot) and real WidowX (Fig. 9) results are figure-only.

SimplerEnv · WidowX (Bridge) sim

SimplerEnv WidowX / BridgeData suite, four tabletop tasks. · metric:success rate % · simpler-env.github.io/

Modelavgvisual_matchingreadme_bridge_7_task_avgoverallput_spoon_on_towelput_carrot_on_platestack_green_block_on_yellow_blockput_eggplant_in_yellow_basketaggregate_setting_unlabelledSource
Galaxea G0.5
Galaxea
87.3 paper Table 1 'Results on Bridge-SimplerEnv. All numbers are success rates (%)', row 'G0.5 (Ours)', column Average
Post-trained on BridgeData V2 for 80K steps (lr 3e-5), state-free policy input, then evaluated in SimplerEnv WidowX+Bridge without simulation-domain training. Per-task: Put Spoon on Towel 97.5, Put Carrot on Plate 75.0, Stack Green Block on Yellow Block 83.3, Put Eggplant in Yellow Basket 93.3. Baseline numbers compiled by the authors from prior studies (pi0.5 57.1, Xiaomi-Robotics-0 79.2). Trials per task not stated.
InternVLA-A1.5
Shanghai AI Laboratory InternRobotics
80.8 paper Table 2 'Results on SimplerEnv (WidowX). All numbers are success rates (%)', row 'InternVLA-A1.5 (Ours)', column Average
Per-task: Put Spoon on Towel 92.4, Put Carrot on Plate 85.4, Stack Green Block on Yellow Block 69.5, Put Eggplant in Yellow Basket 75.7. Baseline numbers compiled from prior studies (pi0.5 57.1, GR00T-N1.5 61.9, Xiaomi-Robotics-0 79.2). No Google Robot table in the paper. Training data / trials for this eval not stated in extracted text.
OpenVLA
Stanford / UC Berkeley / TRI et al. (OpenVLA team)
4.2 third-party CogACT paper, Table 2 (WidowX), row 'OpenVLA', Average
Per task: Spoon 4.2, Carrot 0.0, Stack 0.0, Eggplant 12.5. NOTE: X-VLA paper Table 2 prints 8.30 for OpenVLA on Simpler-WidowX (different eval run)
OctoOcto-Base
UC Berkeley RAIL et al.
17.5 third-party CogACT paper, Table 2 (WidowX), row 'Octo-Base', Average
Per task 15.8 / 12.5 / 0.0 / 41.7; SimplerEnv paper Table V prints per-task success fractions 0.125 / 0.083 / 0.000 / 0.431 with no average. X-VLA Table 2 prints 23.4 for Octo WidowX
OctoOcto-Small
UC Berkeley RAIL et al.
26.7 third-party CogACT paper, Table 2 (WidowX), row 'Octo-Small', Average
Per task 41.7 / 8.2 / 0.0 / 56.7; SimplerEnv paper Table V per-task fractions 0.472 / 0.097 / 0.042 / 0.569
CogACTCogACT-Base (DiT-Base action module)
Microsoft Research
51.3 paper Table 2 (WidowX robot), row 'CogACT', Average
Per task Put Spoon on Towel 71.7, Put Carrot on Plate 50.8, Stack Green Block 15.0, Put Eggplant in Basket 67.5
CogACTCogACT-Large (DiT-Large, 308M)
Microsoft Research
58.3 paper Table 7, row 'DiT-Large', WidowX VM
Same eval protocol as Table 2
X-VLAX-VLA-0.9B
Tsinghua University AIR (2toINF)
95.8 paper Table 2, row 'X-VLA (Ours)', Simpler WidowX; Table 12 per task Spoon 100 / Carrot 91.7 / Blocks 95.8 / Eggplant 95.8, Average 95.8
Adapted on BridgeData; README lists the same 95.8% for X-VLA-WidowX; the paper text rounds to '96%'
X-VLAX-VLA-0.9B PEFT (LoRA adapters, ~9M params)
Tsinghua University AIR (2toINF)
66.7 official README results table, row 'X-VLA-simpler-widowx-peft'
As above
π0 (pi-zero)
Physical Intelligence
27.8 third-party X-VLA paper, Table 2, row 'π0', Simpler WidowX
As above
Isaac GR00T N1.7GR00T N1.7 fine-tuned on Bridge
NVIDIA
62.3 official examples/SimplerEnv README, Bridge (WidowX) table, column N1.7, 'Average'
NON-STANDARD task set: 7 Bridge tasks (spoon_on_towel 78.0, carrot_on_plate 58.0, put_eggplant_in_basket 53.0, stack_cube 48.0, put_eggplant_in_sink 2.0, close_drawer 97.0, open_drawer 100.0), not the standard 4-task WidowX suite; fine-tuned 20,000 steps batch 1024; 10 episodes per task, 300-step max; not directly comparable to other WidowX averages here
GR00T N1.6 3BGR00T N1.6 fine-tuned on Bridge
NVIDIA
56.6 official examples/SimplerEnv README, Bridge (WidowX) table, column N1.6, 'Average'
Same non-standard 7-task Bridge set as N1.7 entry (55.4 / 46.0 / 89.0 / 5.0 / 33.0 / 73.0 / 95.0); 10 episodes per task; N1.6 released 2025-12 (research page dated 15 Dec 2025); HF card and research page print no benchmark numbers
SpatialVLASpatialVLA (zero-shot)
Shanghai AI Laboratory et al.
34.4 paper Table II, row 'SpatialVLA (zero-shot)', #Overall
Zero-shot OXE-pretrained. Task success: Spoon on Towel 20.8, Carrot on Plate 20.8, Stack Green Block 25.0, Eggplant 70.8 (grasp rates also printed).
SpatialVLASpatialVLA (fine-tuning)
Shanghai AI Laboratory et al.
42.7 paper Table II, row 'SpatialVLA (fine-tuning)', #Overall
Fine-tuned on BridgeData V2. Task success: 16.7 / 25.0 / 29.2 / 100.0.
UniVLA
OpenDriveLab (HKU et al.)
47.9 paper Table A-III, row 'UniVLA', #Overall
SimplerEnv WidowX (Bridge) tasks; overall task success. BridgeData is in the pretraining mix.
UniVLAUniVLA (Decoder-only)
OpenDriveLab (HKU et al.)
35.4 paper Table A-III, row 'UniVLA (Decoder-only)', #Overall
Only the action decoder trained for adaptation.
InternVLA-M1
Shanghai AI Laboratory InternRobotics
71.7 paper Table 2, row 'InternVLA-M1', Avg
Per-task: Put Spoon on Towel 87.5, Put Carrot on Plate 67.9, Stack Green Block on Yellow Block 31.3, Put Eggplant in Yellow Basket 100.0.
EO-1
IPEC-COMMUNITY (Shanghai AI Laboratory affiliated)
72.7 paper Table 4, WidowX Benchmark, row 'EO-1 (Ours)', Overall
Per-task: Put Spoon on Towel 63.6, Put Carrot on Plate 54.5, Stack Blocks 81.8, Put Eggplant in Basket 90.9.
LAPALAPA (BridgeV2 pretrain)
KAIST / University of Washington et al. (Latent Action Pretraining)
57.3 paper Table 11, 'Success Rate' block, row 'AVG', column 'LAPA'
NON-STANDARD protocol: pretrained on BridgeV2 without action labels, then fine-tuned on 100 SIMPLER trajectories; 24 rollouts per task over 4 Bridge tasks (stack G2Y 54.2, carrot2plate 45.8, spoon2towel 70.8, eggplant2basket 58.3). ActionVLA 63.5, OpenVLA 36.4.
LAPALAPA (Sthv2 human video pretrain)
KAIST / University of Washington et al. (Latent Action Pretraining)
52.1 paper Table 12, 'Success Rate' block, row 'AVG', column 'LAPA'
NON-STANDARD protocol as Table 11 but pretrained on Something-Something V2 human video; 100 fine-tuning trajectories; 24 rollouts per task.
RoboVLMs(KosMos P.H.)KosMos P.H. (KosMos-2 backbone, policy-head, history)
Tsinghua University / ByteDance Research / CASIA et al.
0.5 fraction0.4 fraction0.2 fraction1 fraction paper Extended Table 3(c), row 'RoboVLMs (Ours)', task 'put spoon on towel', column 'final'
Extended Table 3(c) 'Simulation performance on SimplerEnv-WidowX+Bridge environments'. Values printed as fractions (0-1). Table reports both 'Grasp' sub-task rate and 'final' success per task; this entry is the 'final' column. No average column is printed. RoboVLMs row equals the 'Post Train' recipe in Extended Table 3(e) (OXE co-train, then post-train on Bridge V2; tested tasks excluded). Setting not labelled; SimplerEnv WidowX+Bridge tasks are visual-matching only. Grasp sub-task rates: spoon 0.583, carrot 0.458, block 0.375, eggplant 0.958.
Magma-8B
Microsoft Research
35.4 paper Table 2, row 'Magma-8B (Ours)', column 'SE-Bridge'
Zero-shot pretrained Magma-8B, no fine-tuning. SimplerEnv Bridge/WidowX aggregate; setting not labelled in table (see Fig. 8 caption: averaged across visual matching and variant aggregation). Same column: OpenVLA 14.5, RT-1-X 1.1, Octo 15.9.
MiniVLAMiniVLA + VQ h8 (Bridge V2)
Stanford ILIAD
68447014 official Blog table 'Model (Final Action Accuracy) | Place carrot | Place spoon | Block stack | Pick eggplant', row 'MiniVLA + VQ h8 (action chunks) (80%)', column 'Place spoon'
Blog table for SimplerEnv ('a few Simpler Env tasks'): MiniVLA + VQ h8 trained on BridgeData V2 (80% final action accuracy) vs OpenVLA (95%). Task labels as printed: Place carrot, Place spoon, Block stack, Pick eggplant (correspond to the SimplerEnv WidowX+Bridge tasks). OpenVLA row: 46 / 44 / 62 / 66. No average printed; rollout counts and visual-matching setting not stated. Blog notes MiniVLA 'performs worse' on eggplant.

CALVIN sim

Long-horizon language-conditioned manipulation in simulation; ABC→D = train on A/B/C, test on D; metric is average completed chain length out of 5. · metric:avg. length of completed task chains · github.com/mees/calvin

Modelabc_dabcd_dabcd_d_10pct_dataSource
VLA-AdapterVLA-Adapter-Pro
OpenHelix team
4.5 avg_len paper Table 6, row 'VLA-Adapter-Pro (Ours)', Avg. len
Chain success 98.5 / 95.0 / 90.5 / 85.3 / 80.0 (%).
X-VLAX-VLA-0.9B
Tsinghua University AIR (2toINF)
4.4 avg_len paper Table 2, row 'X-VLA (Ours)', Calvin ABC -> D; Table 14 chain success 97.1 / 92.6 / 88.5 / 84.4 / 78.8, Average 4.43
Adapted on CALVIN-ABC (Abs EEF, batch 128, 60K steps, ColorJitter); prior SOTA in table FLOWER 4.53; README lists 4.43 for X-VLA-Calvin-ABC_D
VLA-AdapterVLA-Adapter
OpenHelix team
4.4 avg_len paper Table 6, row 'VLA-Adapter (Ours)', Avg. len
Chain success 99.1 / 94.6 / 88.8 / 82.8 / 76.5 (%).
RoboVLMs(KosMos P.H.)KosMos P.H. (KosMos-2 backbone, policy-head, history)
Tsinghua University / ByteDance Research / CASIA et al.
4.3 avg_len4.5 avg_len paper CALVIN results table (paper Extended Table 2; identical in README), row 'KosMos P.H.' train ABC test D, column Avg. Len.
Zero-shot to scene D. Per-step success (fractions): 0.980 / 0.936 / 0.854 / 0.778 / 0.704.
RynnVLA-001
Alibaba DAMO Academy
4.2 avg_len paper Table 5, row 'Full Model', Task ABC -> D, Avg. Len.
Ablation-study table; caption: 'All models are trained with reduced epochs for efficiency; scores are for relative comparison.' Chain success 95.4 / 88.2 / 82.2 / 78.2 / 72.1 (%).
UniVLA
OpenDriveLab (HKU et al.)
3.8 avg_len paper Table A-II, row 'UniVLA (Ours)', Avg. Len.
CALVIN ABC->D; consecutive-task success 95.5 / 85.8 / 75.4 / 66.9 / 56.5 (%); third-view RGB only.
LLaVA-VLALLaVA-VLA-7B
OpenHelix team
3.8 avg_len paper Table I 'Comparison among different versions of LLaVA-VLA in terms of success rates and average length on RoboTwin', row 'LLaVA-VLA (ours) 7B', column Avg. Len.
AMBIGUOUS CAPTION: caption says 'on RoboTwin' but the table header reads 'ABC -> D' with CALVIN-style 1/5..5/5 chain columns and Avg. Len., and Sec. IV-B discusses it alongside RoboFlamingo/OpenVLA CALVIN rows; treated here as CALVIN ABC->D. Per-step success (%): 97.4 / 86.2 / 73.4 / 64.6 / 53.4. The 0.5B row in the same table is 96.2 / 84.8 / 72.6 / 60.8 / 50.6, Avg. Len. 3.65 (a different configuration than Table VI's 3.68).
LLaVA-VLA
OpenHelix team
3.7 avg_len paper Table VI 'Comparison with various manipulation baselines on CALVIN', row 'LLaVA-VLA (Ours) 500M', column Avg. Len.
CALVIN ABC->D (unseen scene D). 1000 evaluation chains ('we test each method 1000 times'). Per-step success rates (%) as printed: 94.8 / 84.5 / 71.3 / 62.5 / 53.8. Backbone LLaVA-OneVision-0.5B; no large-scale robot-dataset pre-training; action chunk size 5; discrete action tokens (256 bins). Same table lists GR-1 3.06, OpenVLA 3.27, RoboFlamingo 2.47.
GR-1
ByteDance Research
3.1 avg_len4.2 avg_len2 avg_len paper Table 1, row 'GR-1 (Ours) ABC->D', column Avg. Len.
Zero-shot to scene D. Per-step success: 0.854 / 0.712 / 0.596 / 0.497 / 0.401. Baselines: HULC 0.67, RT-1 0.90.

RoboCasa sim

Large-scale kitchen-scene simulation benchmark. · metric:success rate % · robocasa.ai/

Model30_demos_per_taskSource
GR00T N1.5 3BGR00T N1.5 post-trained (30 demos/task)
NVIDIA
47.5 official GR00T N1.5 research page, 'Data-Limited Post-Training' table, row 'RoboCasa, 30 Demos per Task', column GR00T N1.5 (GR00T N1 = 17.4)
RoboCasa 24-task kitchen suite, post-training with 30 demos per task; trial count not stated; page dated 11 June 2025

VLABench sim

Simulation benchmark for language-conditioned long-horizon manipulation. · metric:success rate % · vlabench.github.io/

Modelavg_progress_scoreSource
X-VLAX-VLA-0.9B
Tsinghua University AIR (2toINF)
51.1 Avg. PS paper Table 2, row 'X-VLA (Ours)', VLABench Avg. PS; Table 15: In Distribution 67.8 / Cross Category 25.1 / Common Sense 48.2 / Semantic Instruction 63.1 / Average 51.1
Baselines in Table 2: GR00T-N1 39.7, π0 37.8, π0+FAST 34.1
π0 (pi-zero)
Physical Intelligence
37.8 Avg. PS third-party X-VLA paper, Table 2, row 'π0', VLABench Avg. PS
As reprinted by X-VLA

RoboTwin 2.0 sim

Dual-arm simulation benchmark with easy / hard domain-randomisation settings. · metric:success rate % · robotwin-platform.github.io/

Modeleasyhardavgcleanrandomizedseen_8task_avgdomain_randomization_8task_avgSource
Galaxea G0.5
Galaxea
93.393.792.8 paper Table 2, row 'G0.5 (Ours)', column 'Average'
Table 2 'Results on RoboTwin 2.0. We report success rates under clean and randomized evaluation settings, together with their average.' Fine-tuned 4 epochs (lr 4e-5, batch 1024) on 2,500 clean + 25,000 randomized demos; success averaged over 100 trials per task per setting. Baselines: pi0.5 82.7/76.8/79.8, Fast-WAM 91.9/91.8/91.8, LingBot-VA 92.9/91.5/92.2. Per-task G0.5 rates in Table 7.
InternVLA-A1.5
Shanghai AI Laboratory InternRobotics
93.293.393 paper Table 3, row 'InternVLA-A1.5 (Ours)', column 'Avg.'
Table 3 'Results on RoboTwin. We report success rates under clean and randomized evaluation settings, together with their average.' (Main text calls the benchmark RoboTwin 2.0 and refers to this table as 'Table 4' - numbering inconsistency in the paper.) Baselines: pi0.5 82.7/76.8/79.8, InternVLA-A1 89.4/89.6/89.5, LingBot-VA 92.9/91.5/92.2, Fast-WAM 91.9/91.8/91.8. Trials per task not stated in extracted text.
RDT-1B
Tsinghua University TSAIL (thu-ml)
34.513.7 third-party X-VLA paper, Table 2, row 'RDT (Liu et al., 2025b)', RoboTwin-2.0 Easy
Number as reprinted in X-VLA's comparison table; Hard = 13.7
X-VLAX-VLA-0.9B
Tsinghua University AIR (2toINF)
7039 paper Table 2, row 'X-VLA (Ours)', RoboTwin-2.0 Easy (Table 16 'Average' over 50 tasks)
Adapted on RoboTwin-2.0 (Abs EEF, batch 128, 60K steps, ColorJitter); README lists '70%' for X-VLA-RoboTwin2
π0 (pi-zero)
Physical Intelligence
46.4 third-party X-VLA paper, Table 2, row 'π0', RoboTwin-2.0 Easy (Hard 16.4)
As reprinted by X-VLA
π0.5
Physical Intelligence
82.776.8 third-party LingBot-VLA paper, RoboTwin 2.0 table, column 'π0.5', Clean Scenes
Randomized Scenes 76.76%; average over 5 RoboTwin 2.0 tasks per LingBot README
LingBot-VLA 4BLingBot-VLA-4B-Depth (w/ depth distillation)
Robbyant (Ant Group)
88.686.7 paper RoboTwin 2.0 table, column 'Ours w/ depth', Clean Scenes
Average success over 5 RoboTwin 2.0 tasks (per README); w/o depth 86.50; π0.5 82.74; same numbers in GitHub README
LingBot-VLA 4BLingBot-VLA-4B (w/o depth)
Robbyant (Ant Group)
86.5 paper RoboTwin 2.0 table, column 'Ours w/o depth', Clean Scenes (Randomized 85.34)
As above
LingBot-VLA 2.0
Robbyant (Ant Group)
93.592.8 official README, RoboTwin 2.0 simulation benchmark, Clean setting (vs LingBot-VLA 1.0 88.56%)
Released 2026-07-08 per README; no paper on arXiv located; HF card and project page show charts without printed numbers
LLaVA-VLA
OpenHelix team
40.328.6 paper Table VII 'Evaluation on RoboTwin benchmark. Success rates for 8 tasks on the Seen and DR settings', row 'Average success', column LLaVA-VLA (Ours) / Seen
Paper labels the benchmark 'RoboTwin'; it cites RoboTwin 2.0 (ref [20]) and uses RoboTwin 2.0 task names. 8 tasks: Click Bell 81.0, Click Alarmclock 73.0, Lift Pot 39.0, Move Can Pot 28.0, Open Laptop 38.0, Pick Dual Bottles 26.0, Place Dual Shoes 8.0, Rotate Qrcode 29.0 (%). Baselines in same table: ACT 7.1, DP 34.5, RDT 48.9 (Seen). Trials per task not stated in extracted text. 'Seen' = clean setting; 'DR' = domain randomization.

Meta-World sim

Sawyer single-arm multi-task simulation benchmark. · metric:success rate % · meta-world.github.io/

Modelavgeasymediumhardvery_hardSource
SmolVLASmolVLA 0.45B (main)
Hugging Face (LeRobot)
57.382.541.84560 paper Table 2, row 'SmolVLA (0.45B)', Meta-World Avg
2.25B variant avg 68.24; 0.24B variant avg 56.95

Real-robot evaluation (self-reported) real

Success rates each paper reports on its own robots and task sets. Setups differ; not comparable across papers, recorded for reference only. · metric:success rate %

Modelbridgedata_v2_widowx_17_tasksgoogle_robot_12_tasksfranka_tabletop_finetuned_avgfranka_droid_finetuned_avgfinetuning_6_domains_avgaloha_wash_cup_unseen_cup2_totalaloha_pour_water_unseen_room3_totalaloha_pour_water_L_1/3_totalaloha_fold_shorts_1shot_totalaloha_handover_5shot_totalaloha_robot_dog_totalagibot_g1_5_tasks_avg_completion_scorerealman_arm_pick_stack_place_overall_avgfranka_4_tasks_avgso100_multitask_3_tasks_avgso101_pick_place_lego_in_distributiongm100_4_platforms_avg_success_rategm100_4_platforms_avg_progress_scoregm100_3_platforms_avg_success_rategm100_agilex_cobot_magic_success_rategm100_galaxea_r1pro_success_ratelong_horizon_astribot_s1_refrigerator_in_domain_success_ratelong_horizon_cobot_magic_arx_x5_stove_in_domain_success_ratereal_gr1_language_following_task_overall_successunitree_g1_place_1_of_2_fruitsClose the microwaveLift the red chili pepperPut eggplant in the basketPut purple cup on white platePut green cup on the pink cloth (cup on stove)Put purple cup on pink cloth (cup in sink)Put the carrot in the plateavggeneralizability_avgPick up and place green blocksPick up and place strawberriesGrab pen and put it into holderSingle-Target ManipulationMulti-Target ManipulationInstruction-following with DistractorsCollect-Waste (in-distribution)zero-shot pick-and-place, seen-object instructionsSynthetic Categories / basicSynthetic Categories / lightSynthetic Categories / b.g.Synthetic Categories / dis.Synthetic Categories / heightWeb Categories / basicWeb Categories / lightWeb Categories / b.g.Web Categories / dis.Web Categories / heightPick-Place-Toy / SeenPick-Place-Toy / UnseenPick-Place-Toy / ClutterClose-ToolboxClose-LidPour-CupUnfold-Clothesdiverse manipulation, all platforms avgAgiBot G-1 long-horizon avg completionSweep Leftoverbimanual_6task_avg_seenbimanual_6task_avg_domain_randomizationreachgrasp_cupgrasp_boxreach_with_object_cupreach_with_object_boxpick_and_place_cuppick_and_place_boxshirt_folding_scorelaundry_folding_scoreobject_transportation_seen_objectsobject_transportation_unseen_instancesobject_transportation_unseen_categoriesarticulated_object_manipulationdroid_zero_shot_unseen_env_objects_avgr1_lite_r1_pro_finetune_avgcloth_folding_successunzipping_successtable_bussing_progressmof_long_horizon_successagibot_g1_end_to_end_successagibot_g1_stepwise_successSource
RynnVLA-001
Alibaba DAMO Academy
90.69091.79093.386.791.7 paper Table 1, row 'RynnVLA-001 (Ours)', Average (%)
LeRobot SO100 arms; 60 trials per task (two arms x three evaluation settings x 10 trials); each number is the average SR across the three evaluation settings in Table 2. Baselines: GR00T N1.5 55.6, Pi0 70.4 (avg). SR@1 (first-attempt) 56.7.
UniVLAUniVLA (Full)
OpenDriveLab (HKU et al.)
81.7 paper Table A-V, row 'UniVLA (Full)', Average Succ.
AgileX Piper arm (7-DoF). Four tasks: Store screwdriver 93.3, Clean cutting board 100.0, Fold towel twice 46.7, Stack tower of hanoi 86.7; average score 2.63 (max 3). Trials per task not captured from the HTML.
NORA
Declare Lab (SUTD)
56.7 paper Table 1, row 'Average', column 'NORA (Ours)'
Real WidowX-250, 9 tasks x 10 trials (multiple-object, OOD object, spatial categories); baselines RT-1 4.4, OpenVLA 40, SpatialVLA 11.1.
LAPALAPA (Open-X)
KAIST / University of Washington et al. (Latent Action Pretraining)
50.1 paper Table 2, row 'LAPA (Open-X)', AVG
Real Franka Emika Panda; 3 tasks (knocking, covering, pick&place sink); 54 rollouts per model (18 per task) split across seen-obj/unseen-combo, unseen-obj, unseen-instruction. Columns: Seen Obj. Unseen Combo / Unseen Obj. / Seen Obj. Unseen Instr. Row: 57.8 / 43.9 / 48.5. Table 16 total success rate 50.09% (strict 35.19%). Headline variant.
LAPALAPA (Bridge)
KAIST / University of Washington et al. (Latent Action Pretraining)
36.8 paper Table 2, row 'LAPA (Bridge)', AVG
Real Franka Emika Panda; 3 tasks (knocking, covering, pick&place sink); 54 rollouts per model (18 per task) split across seen-obj/unseen-combo, unseen-obj, unseen-instruction. Columns: Seen Obj. Unseen Combo / Unseen Obj. / Seen Obj. Unseen Instr. Row: 43.4 / 31.4 / 35.6.
LAPALAPA (Human Videos)
KAIST / University of Washington et al. (Latent Action Pretraining)
34 paper Table 2, row 'LAPA (Human Videos)', AVG
Real Franka Emika Panda; 3 tasks (knocking, covering, pick&place sink); 54 rollouts per model (18 per task) split across seen-obj/unseen-combo, unseen-obj, unseen-instruction. Columns: Seen Obj. Unseen Combo / Unseen Obj. / Seen Obj. Unseen Instr. Row: 36.5 / 37.4 / 28.1. Pretrained on Something-Something V2 human video only.
OpenVLA
Stanford / UC Berkeley / TRI et al. (OpenVLA team)
70.68567.258.3 paper Table 4 (Appendix B.1.3), bottom row 'Mean Success Rate', column 'OpenVLA (ours)' (70.6±3.2%)
Zero-shot (pretrained OpenVLA, no fine-tuning) on WidowX / BridgeData V2 setup; 17 tasks x 10 trials = 170 rollouts; partial success 0.5 allowed on some tasks; baselines in same table: RT-1-X 18.5±2.7%, Octo 20.0±2.6%, RT-2-X 50.6±3.5%
OctoOcto-Base
UC Berkeley RAIL et al.
72 paper Table I (fine-tuning results), row 'Octo', Average
Octo fine-tuned with ~100 target demos per domain (Berkeley Insertion 70, Stanford Coffee 75, CMU Baking 50, Berkeley Pick-Up 60, Berkeley Coke 100, Berkeley Bimanual 80); ~20 trials per domain; baselines ResNet+Transformer scratch 20%, VC-1 15%. Zero-shot results (Fig. 4) are bar charts with no printed values
RDT-1B
Tsinghua University TSAIL (thu-ml)
5062.51006840760.5 score 0-1 paper Table 3 'Quantitative results', row 'RDT (ours)', Wash Cup 'Total' sub-column for unseen cup 2 (also used as 'Unseen Object' in Table 2)
ALOHA dual-arm; RDT pre-trained then fine-tuned on self-collected ALOHA data; 8 trials per cup (24 total); Total for seen cup 1 = 50, unseen cup 1 = 75; ACT/OpenVLA/Octo Total = 0 for all cups; RDT (scratch) Total = 0
CogACT
Microsoft Research
71.261.4 paper Table 3 (real robot, Realman), row 'CogACT', Overall Avg
Fine-tuned on real-robot data; Pick 70.8 / Stack 82.3 / Place 60.4; Octo-Base 4.9, OpenVLA 12.1
SmolVLASmolVLA 0.45B (main)
Hugging Face (LeRobot)
78.390 paper Table 3 (real-world SO-100), row 'SmolVLA (0.45B)', Avg (Pick-Place 75 / Stacking 90 / Sorting 70)
Multi-task fine-tuning, 50 demos per task, 200k steps; baselines ACT (single-task) 48.3, π0 (multi-task) 61.7
π0 (pi-zero)
Physical Intelligence
0.6 score 0-1 third-party GO-1 paper, Fig. 5(b) 'Average' bar label for π0
π0 fine-tuned per task by the GO-1 authors on AgiBot G1; 5 tasks, 30 trials per task; bar labels verified from the rendered figure
π0 (pi-zero)π0 (3.5B), multi-task fine-tuned
Physical Intelligence
61.7 third-party SmolVLA paper, Table 3, row 'π0 (3.5B)', Avg (Pick-Place 100 / Stacking 40 / Sorting 45)
Run by SmolVLA authors on SO-100 arm
π0.5
Physical Intelligence
13 third-party LingBot-VLA paper, GM-100 multi-platform table, column 'π0.5', Average SR (Progress Score 27.32%)
Post-trained by LingBot authors with 130 episodes per task; 100 tasks, 4 platforms (Agibot G1, AgileX, Galaxea R1Pro, Leju KUAVO 4 Pro), 15 trials per task-robot pair; per-platform SR 7.77 / 17.20 / 14.10 / 12.91
GO-1 (Genie Operator-1)
AgiBot
0.8 score 0-1 paper Fig. 5(b) 'Real-world Experiment Results', 'Average' group, bar label for GO-1 (per task: Restock Bag 0.98, Table Bussing 1.00, Pour Water 0.67, Restock Beverage 0.60, Fold Shorts 0.66)
AgiBot G1; 5 tasks; 30 trials per task (10 seen setup + 20 with variations/distractors); GO-1 pre-trained on AgiBot World beta then fine-tuned per task (lr 2e-5, batch 768, 30k steps); score = normalized completion averaged over rollouts (1.0 full success, fractional partial). Values are bar labels printed in the figure (no numeric table); attribution verified from the rendered PDF page. Baselines: RDT-1B 0.46, π0 0.58, GO-1 w/o Latent Planner 0.66; Fig. 1 teaser prints 78 / 66 / 46 and '32% gain'
GO-1 (Genie Operator-1)GO-1 w/o Latent Planner
AgiBot
0.7 score 0-1 paper Fig. 5(b) 'Average' bar label for 'GO-1 w/o Latent Planner' (per task 0.93 / 0.87 / 0.42 / 0.49 / 0.60)
Same protocol; text: latent planner yields 'an average improvement of 0.12 task completion score'
LingBot-VLA 4BLingBot-VLA-4B-Depth (w/ depth distillation)
Robbyant (Ant Group)
16.935.2 % progress17.3 paper GM-100 multi-platform table, column 'Ours w/ depth', Average SR (Progress Score 35.16%)
GM-100: 100 tasks, 4 platforms (Agibot G1, AgileX, Galaxea R1Pro, Leju KUAVO 4 Pro), 130 post-training episodes per task, 15 trials per task-robot pair; per-platform SR 11.98 / 18.93 / 20.98 / 15.60; baselines WALL-OSS 3.85, GR00T N1.6 7.31, π0.5 13.00
LingBot-VLA 4BLingBot-VLA-4B (w/o depth)
Robbyant (Ant Group)
16.2 paper GM-100 table, column 'Ours w/o depth', Average SR (PS 34.32%)
Per-platform SR 12.82 / 15.50 / 18.89 / 17.59
LingBot-VLA 2.0
Robbyant (Ant Group)
34.415.66066.7 official README, GM-100 bimanual manipulation, AgileX Cobot Magic: progress score / success rate = 66.2 / 34.4
GM-100 tabletop bimanual benchmark; trial counts not stated in README
GR00T N1.6 3B
NVIDIA
7.3 third-party LingBot-VLA paper, GM-100 multi-platform table, column 'GR00T N1.6', Average SR (Progress Score 16.66%)
Post-trained by LingBot authors with 130 episodes per task; 100 tasks, 4 platforms, 15 trials per task-robot pair; per-platform SR 5.23 / 3.26 / 14.29 / 6.45
GR00T N1.5 3B
NVIDIA
83 official 'Real GR-1 Language Following Task' table, 'Overall success rate', GR00T N1.5 (N1 = 43.3%); 'Language following rate' 93.3% (N1 = 46.6%)
Real Fourier GR-1 humanoid; pick one of two fruits and place on plate, target side randomized; trial count not stated
GR00T N1.5 3BGR00T N1.5 post-trained (1K demos)
NVIDIA
98.8 official 'Unitree G1 Post-training (1K demos)' table, row 'GR00T N1.5, 1K Demos', 'Place 1 of 2 fruits (4 total)' (N1 = 44.0%); 'Place 1 of 2 objects (5 novel)' = 84.2%
Real Unitree G1 humanoid, 1K post-training demos
SpatialVLA
Shanghai AI Laboratory et al.
10072.772.745.581.890.945.5 paper Table XI, row 'SpatialVLA', column 'Close the microwave' (Success)
Real-world WidowX zero-shot (out-of-the-box, no fine-tuning), 7 BridgeV2-style tasks, 11 trials each (77 rollouts total, Fig. 5). No average printed in the paper; per-task 'Success' column copied.
UniVLA
OpenDriveLab (HKU et al.)
68.9 paper Table II, row 'UniVLA (Ours)', Average Succ.
Generalizability suite: Lightning Variation 66.7, Visual Distractor 53.3, Novel Object 86.7; average score 2.49.
WALL-OSS
X Square Robot
10085 % progress paper Section 5.2.3 text (Figure 7 bars): 'the pre-trained models—WALL-OSS and pi0—achieve a 100% success rate on the in-distribution (ID) task'
Text statement, not a table; 1000 demonstrations; Pick-Place-Cup (500 demos) reported only as 'above 90%' and OOD Collect-Waste as 'above 80%'. Robot/trial counts not printed in text.
GraspVLA
Peking University EPIC Lab / Galbot
93.396.693.393.39093.39093.386.686.6 paper Table 1, row 'Ours', Synthetic Categories, column 'basic'
Zero-shot real-world grasping on Franka Panda (no real-world action data); 15 objects x 2 trials per condition per category group, 300 trials total. Conditions: basic / light / background (b.g.) / distractor (dis.) / height. SPL 87.2.
Being-H0
BeingBeyond (Beijing)
0.8 fraction0.7 fraction0.6 fraction0.9 fraction0.6 fraction1 fraction0.8 fraction paper Table 7, row 'Being-H0', column 'Pick-Place-Toy / Seen'
7-DoF Franka Research 3 + 6-DoF Inspire hand, RealSense L515; 20 randomized trials per task; post-training on 50-100 teleop trajectories per task. Caption says 'Success rates (%)' but values are printed as fractions (0-1); copied as printed. Model size not given in the row label. Baselines GR00T N1.5 and InternVL3 (same architecture without physical instruction tuning).
EO-1
IPEC-COMMUNITY (Shanghai AI Laboratory affiliated)
8681 paper Section 4.5 text describing Figure 6: 'achieving a performance of 86.0%, compared with 43.0% for Fast, 71.0% for GR00T-N1.5, and 68.0% for pi0'
Number stated in text/bar chart, not a table. Averaged across robot platforms (Franka Panda, WidowX, AgiBot G-1, etc.) and task categories; Franka pick-and-place 94.0%.
HPT(Heterogeneous Pre-trained Transformers)HPT-XL Finetuned
MIT (Lirui Wang, Kaiming He et al.)
76.7 paper Table 3 'Comparison on the Sweep Leftover', row 'HPT-XL Finetuned'
Real-world 'Sweep Leftover' task ablation; ~100 demos per task, 15 trials per evaluation per protocol text; printed with std. Baselines: From Scratch 43.3±3.8, VC-1 53.3±2.6, No Prop. Finetuned 63.3±2.6. Printed as 76.7±3.3.
HPT(Heterogeneous Pre-trained Transformers)HPT-B Finetuned
MIT (Lirui Wang, Kaiming He et al.)
70 paper Table 3 'Comparison on the Sweep Leftover', row 'HPT-B Finetuned'
Real-world 'Sweep Leftover' task ablation; ~100 demos per task, 15 trials per evaluation per protocol text; printed with std. Baselines: From Scratch 43.3±3.8, VC-1 53.3±2.6, No Prop. Finetuned 63.3±2.6. Printed as 70.0±3.0.
LLaVA-VLA
OpenHelix team
44.230.7 paper Table XI 'Comparison of success rates on real-world bimanual tasks', row 'LLaVA-VLA (Ours)', column Avg. Success / Seen
Real robot: Cobot-Magic dual-arm mobile robot with Piper arms (fixed-base bimanual setting). 6 tasks: Stack Bowls 58, Restore Bottle 38, Click Bell 66, Place Vegetable 50, Pack Bottles 28, Lift Pot 25 (%). 100 episodes per task per setting. Baselines: ACT 18.6, TinyVLA 17.5.
V-JEPA 2-AC
Meta FAIR
100652575758065 paper Table 2, row 'V-JEPA 2-AC (ours) / Avg', column 'reach'
Table 2 'Zero-Shot Robot Manipulation': deployed zero-shot on two Franka arms with Robotiq grippers in two different labs; image-goal, closed-loop MPC (CEM) planning with the V-JEPA 2-AC world model; success out of 10 trials per lab with permutations (object location, starting pose); 'Avg' row is the printed average of Lab 1 and Lab 2. Action-conditioned model trained on 62 h of unlabeled DROID data. Octo baseline Avg: Reach 100, Grasp Cup 15, Grasp Box 0, Reach w/ Obj Cup 15, Box 70, Pick-&-Place Cup 15, Box 10.
DexVLA
Midea AI Research et al. (DexVLA team)
0.9 score 0-10.4 score 0-1 paper Table 1 'Ablation study of three stage training', row Stage1+Stage2+Stage3 (all checked), column 'Shirt Folding'; also text Sec. 4: 'DexVLA achieves a 0.92 point on shirt folding without any task-specific adaptation'
Metric is a normalized task score (0-1), not binary success; averaged over 10 trials (Fig. 7 protocol). Bimanual AgileX robot. The same 0.92 is obtained with Stage 1+2 only (no task-specific Stage 3). Baselines Octo/OpenVLA/DP scored ~0 (figure-only).
GR-1
ByteDance Research
0.8 fraction0.7 fraction0.3 fraction0.8 fraction paper Table 2, row 'GR-1 (Ours)', column 'Object Transportation / Seen Objects'
Table 2 'Real Robot Experiment Results'. 7-DoF Kinova Gen2 with wrist RealSense + Kinect Azure. Values printed as fractions. Baselines: RT-1 0.27/0.13/0.00/0.35, MT-R3M 0.15/0.13/0.10/0.30. Number of rollouts per setting not stated in the table.
Galaxea G0.5
Galaxea
82.576.7 paper Abstract / Sec. 5.1.2 text: 'DROID post-training followed by zero-shot transfer to an unseen environment and objects (82.5%)'
Franka Research 3 with Robotiq gripper; post-trained on DROID, evaluated zero-shot in a held-out environment with held-out objects; each task evaluated over 10 trials (binary success except one sequential task with partial credit). Average over the DROID zero-shot task set as stated in text.
RDT2-VQRDT2-UltraFast (fine-tuned RDT2-FM + one-step consistency distillation; NOT the VQ head)
Tsinghua University TSAIL (thu-ml)
77450.6 score 0-1 paper Table 2, row 'Cloth Folding / Success Rate(%)', column RDT2
ATTRIBUTION CAVEAT: Table 2 'Fine-tuning performance of RDT2 and baseline models on challenging real-world tasks' reports the RDT2-UltraFast variant (Sec. 6.3: 'We use the RDT2-UltraFast variant in this experiment'; Appendix: obtained from the fine-tuned RDT2-FM via consistency distillation). It is a sibling of RDT2-VQ, not RDT2-VQ itself; recorded under this id only because the batch id covers the RDT2 family. RDT2-VQ's own zero-shot results (Pick, Pick&Place, Wiping, Shaking, Button Pressing; 256 trials per task) appear only in Figure 3 (bar chart with standard-error bars) and are not printed as numbers. Fine-tuning: from Stage-1 UMI-pretrained checkpoint, frozen VL backbone, 50K steps + 20K distillation steps. Baselines pi0.5 and pi0-FAST fine-tuned on the same data. Trial counts for Table 2 not stated in text. Same row: pi0.5 36, pi0-FAST 29. Sub-tasks: left sleeve 97, right sleeve 95, final fold 81; unseen object 51.
InternVLA-A1.5
Shanghai AI Laboratory InternRobotics
76.4 paper Sec. 5 real-world results text: 'On the long-horizon MOF task, InternVLA-A1.5 reaches 76.4% while pi0.5 succeeds in only 29.3% of the trials and Motus fails to complete the procedure in any trial'
Real-world long-horizon chemistry procedure (MOF) on the authors' bimanual platform; all methods fine-tuned on the same demonstrations; 'multiple trials with randomized object placement' (exact count not stated for MOF; 15 trials per binding for the instruction-following tasks). Per-task numbers for Sort/Insert/Move Tubes are in Figure 8 (figure-only).
Genie Envisioner(GE-Act)GE-Act
AgiBot
0.9 fraction0.8 fraction paper Table 1, row 'VidAW ✓ / VidAda ✓', column 'E2E / w/ S'
Table 1 'Analysis of Pre-training' (Sec. 3.4, GE-Act on AgiBot G1): row VidAW ✓ (init from GE-Base) + VidAda ✓ (task-specific video adaptation), 'w/ S' (robot state as input) column. Text: 'in-domain pretraining achieves 64 SR and 81 E2E, which further improve to 76% and 89% when combined with general video pretraining.' Values printed as fractions. Metrics: E2E = end-to-end success of the complete task (retries of sub-steps allowed); SR = step-wise success (completed sub-steps / total). The table does not name the task(s) or trial counts for this ablation; without-state ('w/o S') values are E2E 0.37 / SR 0.37. GE-Act vs UniVLA / GR00T N1 / pi0 on the five AgiBot G1 tasks, the Agilex Cobot Magic / Dual Franka cross-embodiment tasks and the four RoboTwin tasks are figure-only (Fig. 8, Fig. 11) - no numbers in text. No CALVIN or LIBERO results in the paper (v1-v3) despite the Dec-2025 release of 'GE-Act trained on Calvin' weights.

Other benchmarks mixed

Public benchmarks outside the list above, named per row. · metric:as printed

Modelpdms0_shotsuccess_rateObject GroundingScene CaptioningAction PlanningLetterNumberSort into DrawersMake SandwichesDesktop SortingMath calculationGoods PurchaseLanguage-Conditioned overallRoboVQAERQAEO-Bench @ SpatialEO-Bench @ TemporalOverallIn-domain / SeenIn-domain / Unseentask_success_scoretotalzero_shot_success_ratetest_success_ratelibero_90_successSource
X-VLAX-VLA-0.9B
Tsinghua University AIR (2toINF) · NAVSIM (autonomous driving)
87.3 PDMS paper Table 2, row 'X-VLA (Ours)', NAVSIM PDMS; Table 11 NC 97.5 / DAC 96.5 / EP 82.2 / TTC 92.9 / C 100.0 / PDMS 87.3
Cross-domain (driving) adaptation; UniVLA 81.7 in same table
GR00T N1.5 3B
NVIDIA · Sim GR-1 tabletop (0-shot)
43.938.3 official 'Data-Limited Post-Training' table, row 'Sim GR-1, 0-shot', GR00T N1.5 (N1 = 39.6); row 'Sim GR-1, 30 Demos per Task' = 47.4 (N1 = 43.2)
Simulated GR-1 humanoid tabletop tasks
WALL-OSS
X Square Robot · Embodied VQA (in-house)
91.687.669 paper Table 2, row 'WALL-OSS', column 'Object Grounding'
In-house embodied VQA benchmark; baseline Qwen2.5-VL-3B scores 46.1 / 57.7 / 59.8.
WALL-OSSWALL-OSS (Co-training)
X Square Robot · Block-spell instruction following
8795 paper Table 3, row 'Letter', column 'WALL-OSS (Co-training)'
Block-spell instruction-following accuracy; WALL-OSS action-only 26 / 80, pi0 action-only 9 / 35. Trial counts not printed.
InternVLA-M1InternVLA-M1 (3B)
Shanghai AI Laboratory InternRobotics · Real-world long-horizon task planning (VLM planner)
9091919392 paper Table 5 / Figure 12, row 'Ours-3B', column 'Sort into Drawers'
Task-scheduling success of the VLM planner in real-world long-horizon/reasoning scenarios (not end-to-end manipulation success); compared with Gemini-2.5 Pro, GPT-5, GPT-4o, Qwen2.5-VL.
GraspVLA
Peking University EPIC Lab / Galbot · Language-conditioned grasping vs AnyGrasp
93.3 paper Table 3, row 'Ours', Language-Conditioned overall
Comparison with AnyGrasp (91.6); arbitrary grasping common 93.3, transparent 86.6; 5 Hz.
EO-1EO-1 (3B)
IPEC-COMMUNITY (Shanghai AI Laboratory affiliated) · Embodied reasoning (RoboVQA / ERQA / EO-Bench)
58.5 score45.5 score36.4 score38.9 score44.8 score paper Table 2, row 'EO-1 (3B)', column 'RoboVQA'
Embodied reasoning benchmarks vs standard VLMs (GPT-4o overall 40.5, Gemini 1.5 Flash 44.1).
LAPA
KAIST / University of Washington et al. (Latent Action Pretraining) · Language Table
6249.6 paper Table 1, row 'LAPA', In-domain (1k) Seen
Language Table simulation; printed 62.0±8.7 (StdErr). Other columns: In-domain Unseen 49.6±9.5, Cross-task Seen 73.2±6.8 / Unseen 54.8±9.1, Cross-env Seen 33.6±12.7 / Unseen 29.6±12.0.
Galaxea G0.5
Galaxea · 2025 BEHAVIOR Challenge (OmniGibson)
31.4 paper Abstract text: '2025 BEHAVIOR Challenge on 50 long-horizon household mobile manipulation tasks using a generalist policy (31.4% vs. 26.3% for pi0.5 and 26.1% for the challenge winner)'; detailed in Table 4/6
OmniGibson simulator, R1-Pro embodiment; 50 tasks x 10 instances; 'Task Success Score' is the challenge ranking metric (task progress). Single generalist policy (Table 4 lists 4-epoch checkpoint; 1-epoch checkpoint scores lower).
InternVLA-A1.5
Shanghai AI Laboratory InternRobotics · LIBERO-Plus
84.827.735.2 paper Table 6 'Results on LIBERO-Plus', row 'InternVLA-A1.5 (Ours)', column Total
Zero-shot robustness test: model trained on LIBERO evaluated directly under LIBERO-Plus perturbations. Per-category: Camera 83.1, Robot 55.1, Language 86.9, Light 96.4, Background 98.2, Noise 95.6, Layout 85.2. Baselines: pi0.5 84.4, Cosmos-Policy 82.2.
MiniVLA
Stanford ILIAD · LIBERO-90
61.4 official Blog table 'Trained to 95% Action Accuracy', row 'MiniVLA', column 'Libero 90'
Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). Base MiniVLA without VQ or multi-image inputs.
MiniVLAMiniVLA + VQ h8 (action chunks)
Stanford ILIAD · LIBERO-90
77 official Blog table 'Model (Final Action Accuracy) | Libero 90', row '+ VQ h8 (action chunks) (85%)'
Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). VQ action chunking (Residual VQ, horizon 8). Same table: '+ VQ h1 (single action)' 62.4%.
MiniVLAMiniVLA + VQ h8 + history=2
Stanford ILIAD · LIBERO-90
82 official Blog table 'Model | Libero 90', row '+ VQ h8 + history=2'
Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). Adds 2-frame image history on top of VQ h8.
MiniVLAMiniVLA + VQ h8 + wrist images
Stanford ILIAD · LIBERO-90
82.1 official Blog table 'Model | Libero 90', row '+ VQ h8 + wrist images'
Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). Adds wrist-camera image on top of VQ h8. Blog: 'quite close to the state-of-the-art performance on Libero 90, from Baku'.

Sorted by the avg column (or the first subset) within a benchmark; not a ranking across benchmarks. Missing cells mean the source did not print that number.

SinanLab · Sinan LabClear direction, grounded judgement.