公开基准分数表
分数照抄各模型论文、官方 README 或模型卡;第三方复现单独标注。按基准分组,绝不跨基准合成。各论文的评测协议不同(是否微调、试验次数、检查点),比较前先看备注。
LIBERO sim
Franka 单臂仿真操作基准,四个任务套(空间 / 物体 / 目标 / 长程),通常按套微调后各测 500 次。 · 指标:成功率 % · libero-project.github.io/
| 模型 | spatial | object | goal | long | avg | 来源 |
|---|---|---|---|---|---|---|
| Galaxea G0.5 星海图(Galaxea) | 98.4 | 100 | 98.6 | 98.6 | 98.9 | 论文 Table 3, row 'G0.5 (Ours)', column 'Spatial' Table 3 'Results on LIBERO'. Fine-tuned 100K steps (lr 1e-5) on the four suites; 10 tasks/suite, 50 demos/task; evaluated 50 rollout trials per task with benchmark initial states. Baselines: pi0.5 98.8/98.2/98.0/92.4/96.9, GR00T-N1.7 97.7/98.5/97.5/94.4/97.0, Xiaomi-Robotics-0 98.8/100.0/98.8/97.2/98.7. |
| InternVLA-A1.5 上海人工智能实验室 InternRobotics | 98.6 | 99.8 | 98.6 | 98.4 | 98.9 | 论文 Table 5, row 'InternVLA-A1.5 (Ours)', column 'Spatial' Table 5 'Results on LIBERO'. Backbone Qwen-3.5 2B + 460M unified expert. Trials per task not stated in the extracted text (standard LIBERO protocol implied). Baselines: pi0.5 98.8/98.2/98.0/92.4/96.9, OpenVLA-OFT 97.6/98.4/97.9/94.5/97.1, Xiaomi-Robotics-0 98.8/100.0/98.8/97.2/98.7. |
| VLA-AdapterVLA-Adapter-Pro OpenHelix 团队 | 99.6 | 99.6 | 98.2 | 96.4 | 98.5 | 论文 Table 5, row 'VLA-Adapter-Pro (Ours)', column Spatial Qwen2.5-0.5B backbone, no robotic pre-training; trained per suite; each subtask repeated 50 times (500 trials per suite). Pro = updated policy implementation (Appendix); marked best (Bold*). |
| EO-1 IPEC-COMMUNITY(上海人工智能实验室 系) | 99.7 | 99.8 | 99.2 | 94.8 | 98.2 | 论文 Table 3, row 'EO-1 (Ours)', LIBERO-Spatial SR Fine-tuned per suite; printed with standard error and rank 1 in every column. Printed as 99.7 ± 0.2%. |
| X-VLAX-VLA-0.9B 清华大学 AIR(2toINF) | 98.2 | 98.6 | 97.8 | 97.6 | 98.1 | 论文 Table 2, row 'X-VLA (Ours)', LIBERO Spatial (also Table 13) Phase-II domain adaptation fine-tune on LIBERO (appendix config: Abs EEF, batch 128, 60K steps); trial count not stated in fetched text |
| VLA-AdapterVLA-Adapter OpenHelix 团队 | 97.8 | 99.2 | 97.2 | 95 | 97.3 | 论文 Table 5, row 'VLA-Adapter (Ours)', column Spatial Qwen2.5-0.5B backbone, no robotic pre-training; trained per suite; each subtask repeated 50 times (500 trials per suite). |
| DexVLA 美的 AI 研究院 等(DexVLA 团队) | 97.2 | 99.1 | 95.6 | 97.3 | 论文 Table 3, row 'DexVLA', column 'Spatial' Table 3 'Evaluations results on LIBERO. We compare our DexVLA with DP and OpenVLA' (Appendix). Columns are Spatial | Object | Goal | Average only - NO LIBERO-Long/LIBERO-10 column; 'Average' is over the three suites as printed. Baseline rows: DP 78.3/92.5/68.3/79.7, OpenVLA 84.7/88.4/79.2/84.1, pi0-FAST 96.4/96.8/88.6/93.9, pi0 96.8/98.8/95.8/97.1. DexVLA = Qwen2-VL 2B + 1B diffusion expert. Trials per task not stated in extracted text. | |
| OpenVLAOpenVLA-OFT Stanford / UC Berkeley / TRI 等(OpenVLA 团队) | 97.6 | 98.4 | 97.9 | 94.5 | 97.1 | 论文 Table I, row 'OpenVLA-OFT' (multi-input setup, modified dataset), Spatial OpenVLA-OFT fine-tuned per suite; multi-input (third-person + wrist image + proprio); 500 trials per suite (10 tasks x 50 episodes); OFT paper by the OpenVLA authors |
| π0.5π0.5 fine-tuned (pi05_libero checkpoint, @30k steps) Physical Intelligence | 98.8 | 98.2 | 98 | 92.4 | 96.9 | 官方 openpi examples/libero README results table, row 'π0.5 @ 30k (finetuned)', Libero Spatial Checkpoint gs://openpi-assets/checkpoints/pi05_libero trained with the pi05_libero config; number of trials not stated. README undated; fetched 2026-09-18. The π0.5 paper (arXiv 2504.16054) prints no numeric benchmark tables |
| InternVLA-M1 上海人工智能实验室 InternRobotics | 98 | 99 | 93.8 | 92.6 | 95.9 | 论文 Table 4, row 'InternVLA-M1', column Spatial Fine-tuned per suite following OpenVLA-OFT protocol (failed demos and pause frames filtered; wrist + third-person views). |
| UniVLAUniVLA (Full) OpenDriveLab(香港大学 等) | 96.5 | 96.8 | 95.6 | 92 | 95.2 | 论文 Table I, row 'UniVLA (Ours)' / 'Full', column Spatial Fine-tuned per suite; 500 trials per suite (50 per task) averaged over three seeds. 'Full' = pretrained on the full latent-action pretraining mixture. |
| VLA-0 NVIDIA Research | 97 | 97.8 | 96.2 | 87.6 | 94.7 | 论文 Table I, row 'VLA-0 (Ours)', column 'Spatial' Table I 'Performance on Libero. We report the success rate for four LIBERO suites, for two category of models, with and without large scale action pretraining.' VLA-0 is in the 'without large-scale action pretraining' category. Base model Qwen2.5-VL-3B-Instruct; actions emitted as text (no vocabulary/architecture change); 50 episodes per task x 10 tasks per suite; eval uses action horizon 1 with ensemble of 8 predictions (README). Same-category baselines: pi0.5-KI 96.6/97.2/94.6/85.8/93.3, OpenVLA-OFT 94.3/95.2/91.7/86.5/91.9, SmolVLA 93.0/94.0/91.0/77.0/88.8. Numbers also on project page https://vla0.github.io/. |
| π0 (pi-zero)π0 (fine-tuned per suite) Physical Intelligence | 96.8 | 98.8 | 95.8 | 85.2 | 94.2 | 第三方 OpenVLA-OFT paper, Table I, row 'π0 (fine-tuned)' (multi-input setup, modified dataset), Spatial Fine-tuned by the OFT authors per suite; 500 trials per suite (10 tasks x 50 episodes). The π0 paper itself (arXiv 2410.24164) reports only bar-chart figures with no printed benchmark values |
| UniVLAUniVLA (Bridge) OpenDriveLab(香港大学 等) | 92.5 | 论文 Table I, row 'UniVLA (Ours)' / 'Bridge', Average Pretrained only on Bridge-V2. Subsets: 95.2 / 95.4 / 91.9 / 87.5. | ||||
| SmolVLASmolVLA 2.25B Hugging Face (LeRobot) | 88.8 | 论文 Table 2, row 'SmolVLA (2.25B)', LIBERO Avg (Spatial 93 / Object 94 / Goal 91 / Long 77) Larger VLM-backbone variant; X-VLA paper Table 2 reprints this row as 93.0/94.0/91.0/77.0/88.8 | ||||
| UniVLAUniVLA (Human) OpenDriveLab(香港大学 等) | 88.7 | 论文 Table I, row 'UniVLA (Ours)' / 'Human', Average Pretrained only on action-free human video. Subsets: 91.2 / 94.2 / 90.2 / 79.4. | ||||
| NORANORA-Long-fine-tuned Declare Lab(新加坡科技设计大学) | 92.2 | 95.4 | 89.4 | 74.6 | 87.9 | 论文 Table 2, row 'NORA-Long-fine-tuned (Ours)', LIBERO-Spatial Fine-tuned per suite; 500 trials per suite. NORA-Long = action-horizon-5 variant. |
| SmolVLASmolVLA 0.45B (main) Hugging Face (LeRobot) | 90 | 96 | 92 | 71 | 87.3 | 论文 Table 2, row 'SmolVLA (0.45B)', LIBERO Spatial Simulation fine-tuning 100k steps, batch 64; 10 trials per task, binary success; whether one multitask checkpoint or one per suite was not confirmed from the fetched text |
| MolmoActMolmoAct-7B-D Allen Institute for AI(Ai2) | 87 | 95.4 | 87.6 | 77.2 | 86.6 | 论文 Table 2, row 'MolmoAct-7B-D', column Spatial Fine-tuned per suite by LoRA post-training on MolmoAct-7B-D (Table 7 hyperparameters). |
| π0 (pi-zero)π0-FAST (π0 + FAST tokenizer, fine-tuned) Physical Intelligence | 85.5 | 第三方 OpenVLA-OFT paper, Table I, row 'π0 + FAST (fine-tuned)', Average (Spatial 96.4 / Object 96.8 / Goal 88.6 / Long 60.2) Same protocol as π0 row | ||||
| SmolVLASmolVLA 0.24B Hugging Face (LeRobot) | 82.8 | 论文 Table 2, row 'SmolVLA (0.24B)', LIBERO Avg (87 / 93 / 88 / 63) Smaller variant | ||||
| NORANORA-fine-tuned-AC Declare Lab(新加坡科技设计大学) | 79.5 | 论文 Table 2, row 'NORA-fine-tuned-AC (Ours)', Average AC = action chunking. Subsets: 85.6 / 89.4 / 80 / 63. | ||||
| SpatialVLA 上海人工智能实验室 等 | 88.2 | 89.9 | 78.6 | 55.5 | 78.1 | 论文 Table III, row 'SpatialVLA fine-tuned', LIBERO-Spatial Fine-tuned per LIBERO suite (LoRA + spatial embedding adaption); success rate averaged over 3 random seeds with 500 trials per suite; printed with standard error. Printed as 88.2 ± 0.5%. |
| OpenVLA Stanford / UC Berkeley / TRI 等(OpenVLA 团队) | 84.7 | 88.4 | 79.2 | 53.7 | 76.5 | 论文 Table 12 (Appendix E.2), row 'OpenVLA fine-tuned (ours)', LIBERO-Spatial SR (84.7 ± 0.9%) Fine-tuned separately per suite via LoRA r=32 on modified LIBERO data (no-op actions filtered, failed demos removed, 256px re-render, third-person camera only); 500 trials per suite averaged over 3 seeds (1500 trials); ± is std err |
| OctoOcto-Base UC Berkeley RAIL 等 | 78.9 | 85.7 | 84.6 | 51.1 | 75.1 | 第三方 OpenVLA paper, Table 12, row 'Octo fine-tuned', LIBERO-Spatial (78.9 ± 1.0%) Octo fine-tuned per suite by OpenVLA authors on their modified LIBERO data; 500 trials x 3 seeds |
| NORANORA-fine-tuned Declare Lab(新加坡科技设计大学) | 73.9 | 论文 Table 2, row 'NORA-fine-tuned (Ours)', Average Subsets: 85.6 / 87.8 / 77 / 45. 500 trials per suite. | ||||
| X-VLAX-VLA-0.9B PEFT (LoRA adapters, ~9M params) 清华大学 AIR(2toINF) | 96.2 | 83.2 | 官方 README results table, row 'X-VLA-libero-spatial-peft' Parameter-efficient adapters; README also lists Object 96%, Goal 94.4%, Long 83.2%, Simpler WidowX PEFT 66.7%; paper text (Sec. 5.2) quotes '93%' LIBERO and '54%' Simpler-WidowX for PEFT with 1% tunable params | |||
| Isaac GR00T N1.7GR00T N1.7-3B fine-tuned (single checkpoint, 4 suites) NVIDIA | 97.7 | 98.5 | 97.5 | 94.4 | 官方 examples/LIBERO README results, N1.7-3B, Spatial 97.65% (195/200) Single checkpoint fine-tuned on all four suites with identical hyperparameters (max 20,000 steps, global batch 640, state dropout 0.2); 10 episodes per task (200 per suite); no average printed. README undated; fetched 2026-09-18 | |
| GraspVLAGraspVLA (zero-shot, grasp-only LIBERO) 北京大学 EPIC 实验室 / 银河通用 | 94.1 | 91.2 | 82 | 论文 Table 2, row 'Ours (zero-shot)', column Object ZERO-SHOT and NON-STANDARD: LIBERO tasks rewritten as grasp-only 'pick up {object}' instructions (modifications in Tables 10-12); Spatial suite excluded; grasping any object of the target category counts as success; 50 randomized initial configurations per task. Baselines (fine-tuned): OpenVLA 33.7/56.6/65.4, pi0 62.7/79.4/93.8. |
SimplerEnv · Google Robot sim
真实-仿真对齐评测,Google Robot 任务(拾取可乐罐、移近、开关抽屉等);分视觉匹配与变体聚合两种口径。 · 指标:成功率 % · simpler-env.github.io/
| 模型 | visual_matching | variant_aggregation | readme_fractal_6_task_avg | pick_coke_can_avg | move_near | open_close_drawer_avg | open_top_drawer_and_place_apple | aggregate_setting_unlabelled | 来源 |
|---|---|---|---|---|---|---|---|---|---|
| X-VLAX-VLA-Google-Robot checkpoint 清华大学 AIR(2toINF) | 83.5 | 76.4 | 官方 README results table, row 'X-VLA-Google-Robot', Google Robot (VM) README value differs from paper Table 2 (80.4); VA in README = 76.4%. README undated; fetched 2026-09-18 | ||||||
| InternVLA-M1 上海人工智能实验室 InternRobotics | 80.7 | 76 | 论文 Table 1, row 'InternVLA-M1', Visual Matching Avg Per-task: Pick Coke Can 95.3, Move Near 90.0, Open/Close Drawer 75.5, Open Top Drawer and Place Apple 62.0. Trained with spatial prompting (checkmark column). | ||||||
| X-VLAX-VLA-0.9B 清华大学 AIR(2toINF) | 80.4 | 75.7 | 论文 Table 2, row 'X-VLA (Ours)', Simpler VM; Table 12 per task Coke 98.3 / Near 97.1 / Open 69.5 / Put 56.5, Average 80.4 Adapted to Simpler-Fractal (Google Robot). NOTE: the GitHub README reports 83.5% VM for checkpoint X-VLA-Google-Robot (different from paper) | ||||||
| CogACTCogACT-Large (DiT-Large, 308M) Microsoft Research | 76.7 | 59.3 | 论文 Table 7 (action model scaling), row 'DiT-Large', Google VM Same eval protocol as Table 1 | ||||||
| EO-1 IPEC-COMMUNITY(上海人工智能实验室 系) | 76.5 | 63 | 论文 Table 4, Google Robot Benchmark (Matching), row 'EO-1 (Ours)', Average Per-task: Pick Coke Can 98.0, Move Near 83.8, Open/Close Drawer 71.3, Drawer Apple 52.8. | ||||||
| SpatialVLASpatialVLA (fine-tuning) 上海人工智能实验室 等 | 75.1 | 70.7 | 论文 Table I, row 'SpatialVLA (fine-tuning)', Visual Matching #Average Fine-tuned on Google Fractal dataset. Per-task: 86.0 / 77.9 / 57.4. | ||||||
| CogACTCogACT-Base (DiT-Base action module) Microsoft Research | 74.8 | 61.3 | 论文 Table 1 (Visual Matching), row 'CogACT', Average Trained on OXE subsets, evaluated zero-shot in SIMPLER; per task Pick Coke Can 91.3, Move Near 85.0, Open/Close Drawer 71.8, Open Top Drawer & Place Apple 50.9; Table 7 confirms the default is DiT-Base (89M) | ||||||
| CogACTCogACT-Small (DiT-Small, 13M) Microsoft Research | 73.3 | 论文 Table 7, row 'DiT-Small', Google VM VA 51.3, WidowX VM 51.0 in same row | |||||||
| SpatialVLASpatialVLA (zero-shot) 上海人工智能实验室 等 | 71.9 | 68.8 | 论文 Table I, row 'SpatialVLA (zero-shot)', Visual Matching #Average Zero-shot OXE-pretrained checkpoint. Per-task: Pick Coke Can 81.0, Move Near 69.6, Open/Close Drawer 59.3. | ||||||
| MolmoActMolmoAct (fine-tuned) Allen Institute for AI(Ai2) | 71.6 | 72.1 | 论文 Table 1, row 'MolmoAct (fine-tuned)', Visual Matching Avg Fine-tuned on RT-1 dataset (MolmoAct-7B-D-Pretrain-RT-1). Per-task: 77.7 / 77.1 / 60.0. | ||||||
| MolmoActMolmoAct (zero-shot) Allen Institute for AI(Ai2) | 70.5 | 59.3 | 论文 Table 1, row 'MolmoAct (zero-shot)', Visual Matching Avg Zero-shot OXE pre-trained checkpoint (MolmoAct-7B-D-Pretrain). Per-task: Pick Coke Can 71.3, Move Near 73.8, Open/Close Drawer 66.5. | ||||||
| π0 (pi-zero) Physical Intelligence | 58.8 | 56.8 | 第三方 X-VLA paper, Table 2, row 'π0 (Black et al., 2024a)', Simpler VM As reprinted by X-VLA; VA 56.8, WidowX 27.8 in same row; X-VLA text says π0 achieves 55.7% on Simpler-WidowX in their own fine-tune (Table 3 area) | ||||||
| OpenVLA Stanford / UC Berkeley / TRI 等(OpenVLA 团队) | 34.3 | 39.3 | 第三方 CogACT paper, Table 1 (Visual Matching), row 'OpenVLA', Average Zero-shot SIMPLER eval of the released OpenVLA checkpoint by the CogACT authors; 4-task average (Pick Coke Can 18.0, Move Near 56.3, Open/Close Drawer 63.0, Open Top Drawer & Place Apple 0.0) | ||||||
| OctoOcto-Base UC Berkeley RAIL 等 | 11 | 1.2 | 第三方 CogACT paper, Table 1 (Visual Matching), row 'Octo-Base', Average 4-task average (17.0 / 4.2 / 22.7 / 0.0). The SimplerEnv paper itself (arXiv 2405.05941, Table IV) prints only per-task fractions for Octo-Base VM (Pick Coke Can 0.170, Move Near 0.042, Open/Close Drawer 0.227, Open Top Drawer & Place Apple 0.000) with no average column. X-VLA paper Table 2 prints 16.8 for Octo VM (likely 3-task average) | ||||||
| Isaac GR00T N1.7GR00T N1.7 fine-tuned on Fractal NVIDIA | 72.5 | 官方 examples/SimplerEnv README, Fractal (Google Robot) table, column N1.7, 'Average' NON-STANDARD task set: 6 Fractal tasks (pick_coke_can 100.0, pick_object 94.0, move_near 100.0, open_drawer 65.0, close_drawer 69.0, place_in_closed_drawer 7.0); visual-matching vs variant-aggregation not specified; fine-tuned 20,000 steps batch 1024; 10 episodes per task | |||||||
| GR00T N1.6 3BGR00T N1.6 fine-tuned on Fractal NVIDIA | 52 | 官方 examples/SimplerEnv README, Fractal (Google Robot) table, column N1.6, 'Average' Same non-standard 6-task Fractal set as N1.7 entry (95.0 / 87.0 / 81.0 / 0.0 / 44.0 / 5.0) | |||||||
| RoboVLMs(KosMos P.H.)KosMos P.H. (KosMos-2 backbone, policy-head, history) 清华大学 / 字节跳动 Research / 中科院自动化所 等 | 1 fraction | 0.9 fraction | 0.6 fraction | 0.3 fraction | 论文 Extended Table 3(d), row 'RoboVLMs (Ours)', column 'Pick Coke Can / Average' Extended Table 3(d) 'Simulation performance on SimplerEnv-Google Robot environments'. Values printed as fractions. Column structure: Pick Coke Can {Horizontal Laying, Vertical Laying, Standing, Average}, Move Near {Average}, Open/Close Drawer {Open, Close, Average}, Open Top Drawer and Place Apple {Average}. RoboVLMs row as printed: 1.000 | 0.910 | 1.000 | 0.970 | 0.888 | 0.565 | 0.537 | 0.551 | 0.325. No overall average printed. Row is identical to the 'In-domain Full Finetune' row of Extended Table 3(f) (fine-tuned on full RT-1/fractal data; tested tasks included). Caption does not name visual matching vs variant aggregation; the baseline rows (e.g. RT-1 Converged 0.857 / 0.442 / 0.730) coincide with SimplerEnv's published visual-matching values. | ||||
| Magma-8B Microsoft Research | 52.3 | 论文 Table 2 'Zero-shot evaluation on agentic intelligence', row 'Magma-8B (Ours)', column 'SE-Google Robot' Zero-shot: pretrained Magma-8B 'without any domain-specific finetuning'. Caption: SE = SimplerEnv. Text: 8 tasks with 172 visual matching and variant aggregation scenarios; Table 2 does not label which setting; Fig. 8 caption says per-task results are averaged across visual matching and variant aggregation. Same column: OpenVLA 31.7, RT-1-X 34.2, Octo 6.0. Also confirmed on HF model card https://huggingface.co/microsoft/Magma-8B. No per-task table in the HTML; LIBERO (Fig. 10, 10 trajectories/task few-shot) and real WidowX (Fig. 9) results are figure-only. |
SimplerEnv · WidowX (Bridge) sim
SimplerEnv 的 WidowX / BridgeData 任务组,四个桌面任务。 · 指标:成功率 % · simpler-env.github.io/
| 模型 | avg | visual_matching | readme_bridge_7_task_avg | overall | put_spoon_on_towel | put_carrot_on_plate | stack_green_block_on_yellow_block | put_eggplant_in_yellow_basket | aggregate_setting_unlabelled | 来源 |
|---|---|---|---|---|---|---|---|---|---|---|
| Galaxea G0.5 星海图(Galaxea) | 87.3 | 论文 Table 1 'Results on Bridge-SimplerEnv. All numbers are success rates (%)', row 'G0.5 (Ours)', column Average Post-trained on BridgeData V2 for 80K steps (lr 3e-5), state-free policy input, then evaluated in SimplerEnv WidowX+Bridge without simulation-domain training. Per-task: Put Spoon on Towel 97.5, Put Carrot on Plate 75.0, Stack Green Block on Yellow Block 83.3, Put Eggplant in Yellow Basket 93.3. Baseline numbers compiled by the authors from prior studies (pi0.5 57.1, Xiaomi-Robotics-0 79.2). Trials per task not stated. | ||||||||
| InternVLA-A1.5 上海人工智能实验室 InternRobotics | 80.8 | 论文 Table 2 'Results on SimplerEnv (WidowX). All numbers are success rates (%)', row 'InternVLA-A1.5 (Ours)', column Average Per-task: Put Spoon on Towel 92.4, Put Carrot on Plate 85.4, Stack Green Block on Yellow Block 69.5, Put Eggplant in Yellow Basket 75.7. Baseline numbers compiled from prior studies (pi0.5 57.1, GR00T-N1.5 61.9, Xiaomi-Robotics-0 79.2). No Google Robot table in the paper. Training data / trials for this eval not stated in extracted text. | ||||||||
| OpenVLA Stanford / UC Berkeley / TRI 等(OpenVLA 团队) | 4.2 | 第三方 CogACT paper, Table 2 (WidowX), row 'OpenVLA', Average Per task: Spoon 4.2, Carrot 0.0, Stack 0.0, Eggplant 12.5. NOTE: X-VLA paper Table 2 prints 8.30 for OpenVLA on Simpler-WidowX (different eval run) | ||||||||
| OctoOcto-Base UC Berkeley RAIL 等 | 17.5 | 第三方 CogACT paper, Table 2 (WidowX), row 'Octo-Base', Average Per task 15.8 / 12.5 / 0.0 / 41.7; SimplerEnv paper Table V prints per-task success fractions 0.125 / 0.083 / 0.000 / 0.431 with no average. X-VLA Table 2 prints 23.4 for Octo WidowX | ||||||||
| OctoOcto-Small UC Berkeley RAIL 等 | 26.7 | 第三方 CogACT paper, Table 2 (WidowX), row 'Octo-Small', Average Per task 41.7 / 8.2 / 0.0 / 56.7; SimplerEnv paper Table V per-task fractions 0.472 / 0.097 / 0.042 / 0.569 | ||||||||
| CogACTCogACT-Base (DiT-Base action module) Microsoft Research | 51.3 | 论文 Table 2 (WidowX robot), row 'CogACT', Average Per task Put Spoon on Towel 71.7, Put Carrot on Plate 50.8, Stack Green Block 15.0, Put Eggplant in Basket 67.5 | ||||||||
| CogACTCogACT-Large (DiT-Large, 308M) Microsoft Research | 58.3 | 论文 Table 7, row 'DiT-Large', WidowX VM Same eval protocol as Table 2 | ||||||||
| X-VLAX-VLA-0.9B 清华大学 AIR(2toINF) | 95.8 | 论文 Table 2, row 'X-VLA (Ours)', Simpler WidowX; Table 12 per task Spoon 100 / Carrot 91.7 / Blocks 95.8 / Eggplant 95.8, Average 95.8 Adapted on BridgeData; README lists the same 95.8% for X-VLA-WidowX; the paper text rounds to '96%' | ||||||||
| X-VLAX-VLA-0.9B PEFT (LoRA adapters, ~9M params) 清华大学 AIR(2toINF) | 66.7 | 官方 README results table, row 'X-VLA-simpler-widowx-peft' As above | ||||||||
| π0 (pi-zero) Physical Intelligence | 27.8 | 第三方 X-VLA paper, Table 2, row 'π0', Simpler WidowX As above | ||||||||
| Isaac GR00T N1.7GR00T N1.7 fine-tuned on Bridge NVIDIA | 62.3 | 官方 examples/SimplerEnv README, Bridge (WidowX) table, column N1.7, 'Average' NON-STANDARD task set: 7 Bridge tasks (spoon_on_towel 78.0, carrot_on_plate 58.0, put_eggplant_in_basket 53.0, stack_cube 48.0, put_eggplant_in_sink 2.0, close_drawer 97.0, open_drawer 100.0), not the standard 4-task WidowX suite; fine-tuned 20,000 steps batch 1024; 10 episodes per task, 300-step max; not directly comparable to other WidowX averages here | ||||||||
| GR00T N1.6 3BGR00T N1.6 fine-tuned on Bridge NVIDIA | 56.6 | 官方 examples/SimplerEnv README, Bridge (WidowX) table, column N1.6, 'Average' Same non-standard 7-task Bridge set as N1.7 entry (55.4 / 46.0 / 89.0 / 5.0 / 33.0 / 73.0 / 95.0); 10 episodes per task; N1.6 released 2025-12 (research page dated 15 Dec 2025); HF card and research page print no benchmark numbers | ||||||||
| SpatialVLASpatialVLA (zero-shot) 上海人工智能实验室 等 | 34.4 | 论文 Table II, row 'SpatialVLA (zero-shot)', #Overall Zero-shot OXE-pretrained. Task success: Spoon on Towel 20.8, Carrot on Plate 20.8, Stack Green Block 25.0, Eggplant 70.8 (grasp rates also printed). | ||||||||
| SpatialVLASpatialVLA (fine-tuning) 上海人工智能实验室 等 | 42.7 | 论文 Table II, row 'SpatialVLA (fine-tuning)', #Overall Fine-tuned on BridgeData V2. Task success: 16.7 / 25.0 / 29.2 / 100.0. | ||||||||
| UniVLA OpenDriveLab(香港大学 等) | 47.9 | 论文 Table A-III, row 'UniVLA', #Overall SimplerEnv WidowX (Bridge) tasks; overall task success. BridgeData is in the pretraining mix. | ||||||||
| UniVLAUniVLA (Decoder-only) OpenDriveLab(香港大学 等) | 35.4 | 论文 Table A-III, row 'UniVLA (Decoder-only)', #Overall Only the action decoder trained for adaptation. | ||||||||
| InternVLA-M1 上海人工智能实验室 InternRobotics | 71.7 | 论文 Table 2, row 'InternVLA-M1', Avg Per-task: Put Spoon on Towel 87.5, Put Carrot on Plate 67.9, Stack Green Block on Yellow Block 31.3, Put Eggplant in Yellow Basket 100.0. | ||||||||
| EO-1 IPEC-COMMUNITY(上海人工智能实验室 系) | 72.7 | 论文 Table 4, WidowX Benchmark, row 'EO-1 (Ours)', Overall Per-task: Put Spoon on Towel 63.6, Put Carrot on Plate 54.5, Stack Blocks 81.8, Put Eggplant in Basket 90.9. | ||||||||
| LAPALAPA (BridgeV2 pretrain) KAIST / 华盛顿大学 等(Latent Action Pretraining) | 57.3 | 论文 Table 11, 'Success Rate' block, row 'AVG', column 'LAPA' NON-STANDARD protocol: pretrained on BridgeV2 without action labels, then fine-tuned on 100 SIMPLER trajectories; 24 rollouts per task over 4 Bridge tasks (stack G2Y 54.2, carrot2plate 45.8, spoon2towel 70.8, eggplant2basket 58.3). ActionVLA 63.5, OpenVLA 36.4. | ||||||||
| LAPALAPA (Sthv2 human video pretrain) KAIST / 华盛顿大学 等(Latent Action Pretraining) | 52.1 | 论文 Table 12, 'Success Rate' block, row 'AVG', column 'LAPA' NON-STANDARD protocol as Table 11 but pretrained on Something-Something V2 human video; 100 fine-tuning trajectories; 24 rollouts per task. | ||||||||
| RoboVLMs(KosMos P.H.)KosMos P.H. (KosMos-2 backbone, policy-head, history) 清华大学 / 字节跳动 Research / 中科院自动化所 等 | 0.5 fraction | 0.4 fraction | 0.2 fraction | 1 fraction | 论文 Extended Table 3(c), row 'RoboVLMs (Ours)', task 'put spoon on towel', column 'final' Extended Table 3(c) 'Simulation performance on SimplerEnv-WidowX+Bridge environments'. Values printed as fractions (0-1). Table reports both 'Grasp' sub-task rate and 'final' success per task; this entry is the 'final' column. No average column is printed. RoboVLMs row equals the 'Post Train' recipe in Extended Table 3(e) (OXE co-train, then post-train on Bridge V2; tested tasks excluded). Setting not labelled; SimplerEnv WidowX+Bridge tasks are visual-matching only. Grasp sub-task rates: spoon 0.583, carrot 0.458, block 0.375, eggplant 0.958. | |||||
| Magma-8B Microsoft Research | 35.4 | 论文 Table 2, row 'Magma-8B (Ours)', column 'SE-Bridge' Zero-shot pretrained Magma-8B, no fine-tuning. SimplerEnv Bridge/WidowX aggregate; setting not labelled in table (see Fig. 8 caption: averaged across visual matching and variant aggregation). Same column: OpenVLA 14.5, RT-1-X 1.1, Octo 15.9. | ||||||||
| MiniVLAMiniVLA + VQ h8 (Bridge V2) Stanford ILIAD | 68 | 44 | 70 | 14 | 官方 Blog table 'Model (Final Action Accuracy) | Place carrot | Place spoon | Block stack | Pick eggplant', row 'MiniVLA + VQ h8 (action chunks) (80%)', column 'Place spoon' Blog table for SimplerEnv ('a few Simpler Env tasks'): MiniVLA + VQ h8 trained on BridgeData V2 (80% final action accuracy) vs OpenVLA (95%). Task labels as printed: Place carrot, Place spoon, Block stack, Pick eggplant (correspond to the SimplerEnv WidowX+Bridge tasks). OpenVLA row: 46 / 44 / 62 / 66. No average printed; rollout counts and visual-matching setting not stated. Blog notes MiniVLA 'performs worse' on eggplant. |
CALVIN sim
Franka 长程语言条件操作仿真;ABC→D 表示在 A/B/C 环境训练、D 环境测试,指标为连续完成 5 个任务链的平均长度(满分 5)。 · 指标:连续完成任务数(平均长度) · github.com/mees/calvin
| 模型 | abc_d | abcd_d | abcd_d_10pct_data | 来源 |
|---|---|---|---|---|
| VLA-AdapterVLA-Adapter-Pro OpenHelix 团队 | 4.5 avg_len | 论文 Table 6, row 'VLA-Adapter-Pro (Ours)', Avg. len Chain success 98.5 / 95.0 / 90.5 / 85.3 / 80.0 (%). | ||
| X-VLAX-VLA-0.9B 清华大学 AIR(2toINF) | 4.4 avg_len | 论文 Table 2, row 'X-VLA (Ours)', Calvin ABC -> D; Table 14 chain success 97.1 / 92.6 / 88.5 / 84.4 / 78.8, Average 4.43 Adapted on CALVIN-ABC (Abs EEF, batch 128, 60K steps, ColorJitter); prior SOTA in table FLOWER 4.53; README lists 4.43 for X-VLA-Calvin-ABC_D | ||
| VLA-AdapterVLA-Adapter OpenHelix 团队 | 4.4 avg_len | 论文 Table 6, row 'VLA-Adapter (Ours)', Avg. len Chain success 99.1 / 94.6 / 88.8 / 82.8 / 76.5 (%). | ||
| RoboVLMs(KosMos P.H.)KosMos P.H. (KosMos-2 backbone, policy-head, history) 清华大学 / 字节跳动 Research / 中科院自动化所 等 | 4.3 avg_len | 4.5 avg_len | 论文 CALVIN results table (paper Extended Table 2; identical in README), row 'KosMos P.H.' train ABC test D, column Avg. Len. Zero-shot to scene D. Per-step success (fractions): 0.980 / 0.936 / 0.854 / 0.778 / 0.704. | |
| RynnVLA-001 阿里巴巴达摩院 | 4.2 avg_len | 论文 Table 5, row 'Full Model', Task ABC -> D, Avg. Len. Ablation-study table; caption: 'All models are trained with reduced epochs for efficiency; scores are for relative comparison.' Chain success 95.4 / 88.2 / 82.2 / 78.2 / 72.1 (%). | ||
| UniVLA OpenDriveLab(香港大学 等) | 3.8 avg_len | 论文 Table A-II, row 'UniVLA (Ours)', Avg. Len. CALVIN ABC->D; consecutive-task success 95.5 / 85.8 / 75.4 / 66.9 / 56.5 (%); third-view RGB only. | ||
| LLaVA-VLALLaVA-VLA-7B OpenHelix 团队 | 3.8 avg_len | 论文 Table I 'Comparison among different versions of LLaVA-VLA in terms of success rates and average length on RoboTwin', row 'LLaVA-VLA (ours) 7B', column Avg. Len. AMBIGUOUS CAPTION: caption says 'on RoboTwin' but the table header reads 'ABC -> D' with CALVIN-style 1/5..5/5 chain columns and Avg. Len., and Sec. IV-B discusses it alongside RoboFlamingo/OpenVLA CALVIN rows; treated here as CALVIN ABC->D. Per-step success (%): 97.4 / 86.2 / 73.4 / 64.6 / 53.4. The 0.5B row in the same table is 96.2 / 84.8 / 72.6 / 60.8 / 50.6, Avg. Len. 3.65 (a different configuration than Table VI's 3.68). | ||
| LLaVA-VLA OpenHelix 团队 | 3.7 avg_len | 论文 Table VI 'Comparison with various manipulation baselines on CALVIN', row 'LLaVA-VLA (Ours) 500M', column Avg. Len. CALVIN ABC->D (unseen scene D). 1000 evaluation chains ('we test each method 1000 times'). Per-step success rates (%) as printed: 94.8 / 84.5 / 71.3 / 62.5 / 53.8. Backbone LLaVA-OneVision-0.5B; no large-scale robot-dataset pre-training; action chunk size 5; discrete action tokens (256 bins). Same table lists GR-1 3.06, OpenVLA 3.27, RoboFlamingo 2.47. | ||
| GR-1 字节跳动 Research | 3.1 avg_len | 4.2 avg_len | 2 avg_len | 论文 Table 1, row 'GR-1 (Ours) ABC->D', column Avg. Len. Zero-shot to scene D. Per-step success: 0.854 / 0.712 / 0.596 / 0.497 / 0.401. Baselines: HULC 0.67, RT-1 0.90. |
RoboCasa sim
厨房场景大规模仿真基准。 · 指标:成功率 % · robocasa.ai/
| 模型 | 30_demos_per_task | 来源 |
|---|---|---|
| GR00T N1.5 3BGR00T N1.5 post-trained (30 demos/task) NVIDIA | 47.5 | 官方 GR00T N1.5 research page, 'Data-Limited Post-Training' table, row 'RoboCasa, 30 Demos per Task', column GR00T N1.5 (GR00T N1 = 17.4) RoboCasa 24-task kitchen suite, post-training with 30 demos per task; trial count not stated; page dated 11 June 2025 |
VLABench sim
面向语言条件长程操作的仿真基准。 · 指标:成功率 % · vlabench.github.io/
| 模型 | avg_progress_score | 来源 |
|---|---|---|
| X-VLAX-VLA-0.9B 清华大学 AIR(2toINF) | 51.1 Avg. PS | 论文 Table 2, row 'X-VLA (Ours)', VLABench Avg. PS; Table 15: In Distribution 67.8 / Cross Category 25.1 / Common Sense 48.2 / Semantic Instruction 63.1 / Average 51.1 Baselines in Table 2: GR00T-N1 39.7, π0 37.8, π0+FAST 34.1 |
| π0 (pi-zero) Physical Intelligence | 37.8 Avg. PS | 第三方 X-VLA paper, Table 2, row 'π0', VLABench Avg. PS As reprinted by X-VLA |
RoboTwin 2.0 sim
双臂仿真基准,含域随机化的 easy / hard 两档。 · 指标:成功率 % · robotwin-platform.github.io/
| 模型 | easy | hard | avg | clean | randomized | seen_8task_avg | domain_randomization_8task_avg | 来源 |
|---|---|---|---|---|---|---|---|---|
| Galaxea G0.5 星海图(Galaxea) | 93.3 | 93.7 | 92.8 | 论文 Table 2, row 'G0.5 (Ours)', column 'Average' Table 2 'Results on RoboTwin 2.0. We report success rates under clean and randomized evaluation settings, together with their average.' Fine-tuned 4 epochs (lr 4e-5, batch 1024) on 2,500 clean + 25,000 randomized demos; success averaged over 100 trials per task per setting. Baselines: pi0.5 82.7/76.8/79.8, Fast-WAM 91.9/91.8/91.8, LingBot-VA 92.9/91.5/92.2. Per-task G0.5 rates in Table 7. | ||||
| InternVLA-A1.5 上海人工智能实验室 InternRobotics | 93.2 | 93.3 | 93 | 论文 Table 3, row 'InternVLA-A1.5 (Ours)', column 'Avg.' Table 3 'Results on RoboTwin. We report success rates under clean and randomized evaluation settings, together with their average.' (Main text calls the benchmark RoboTwin 2.0 and refers to this table as 'Table 4' - numbering inconsistency in the paper.) Baselines: pi0.5 82.7/76.8/79.8, InternVLA-A1 89.4/89.6/89.5, LingBot-VA 92.9/91.5/92.2, Fast-WAM 91.9/91.8/91.8. Trials per task not stated in extracted text. | ||||
| RDT-1B 清华大学 TSAIL(thu-ml) | 34.5 | 13.7 | 第三方 X-VLA paper, Table 2, row 'RDT (Liu et al., 2025b)', RoboTwin-2.0 Easy Number as reprinted in X-VLA's comparison table; Hard = 13.7 | |||||
| X-VLAX-VLA-0.9B 清华大学 AIR(2toINF) | 70 | 39 | 论文 Table 2, row 'X-VLA (Ours)', RoboTwin-2.0 Easy (Table 16 'Average' over 50 tasks) Adapted on RoboTwin-2.0 (Abs EEF, batch 128, 60K steps, ColorJitter); README lists '70%' for X-VLA-RoboTwin2 | |||||
| π0 (pi-zero) Physical Intelligence | 46.4 | 第三方 X-VLA paper, Table 2, row 'π0', RoboTwin-2.0 Easy (Hard 16.4) As reprinted by X-VLA | ||||||
| π0.5 Physical Intelligence | 82.7 | 76.8 | 第三方 LingBot-VLA paper, RoboTwin 2.0 table, column 'π0.5', Clean Scenes Randomized Scenes 76.76%; average over 5 RoboTwin 2.0 tasks per LingBot README | |||||
| LingBot-VLA 4BLingBot-VLA-4B-Depth (w/ depth distillation) 蚂蚁灵波(Robbyant) | 88.6 | 86.7 | 论文 RoboTwin 2.0 table, column 'Ours w/ depth', Clean Scenes Average success over 5 RoboTwin 2.0 tasks (per README); w/o depth 86.50; π0.5 82.74; same numbers in GitHub README | |||||
| LingBot-VLA 4BLingBot-VLA-4B (w/o depth) 蚂蚁灵波(Robbyant) | 86.5 | 论文 RoboTwin 2.0 table, column 'Ours w/o depth', Clean Scenes (Randomized 85.34) As above | ||||||
| LingBot-VLA 2.0 蚂蚁灵波科技 (Ant Group) | 93.5 | 92.8 | 官方 README, RoboTwin 2.0 simulation benchmark, Clean setting (vs LingBot-VLA 1.0 88.56%) Released 2026-07-08 per README; no paper on arXiv located; HF card and project page show charts without printed numbers | |||||
| LLaVA-VLA OpenHelix 团队 | 40.3 | 28.6 | 论文 Table VII 'Evaluation on RoboTwin benchmark. Success rates for 8 tasks on the Seen and DR settings', row 'Average success', column LLaVA-VLA (Ours) / Seen Paper labels the benchmark 'RoboTwin'; it cites RoboTwin 2.0 (ref [20]) and uses RoboTwin 2.0 task names. 8 tasks: Click Bell 81.0, Click Alarmclock 73.0, Lift Pot 39.0, Move Can Pot 28.0, Open Laptop 38.0, Pick Dual Bottles 26.0, Place Dual Shoes 8.0, Rotate Qrcode 29.0 (%). Baselines in same table: ACT 7.1, DP 34.5, RDT 48.9 (Seen). Trials per task not stated in extracted text. 'Seen' = clean setting; 'DR' = domain randomization. |
Meta-World sim
Sawyer 单臂多任务仿真基准。 · 指标:成功率 % · meta-world.github.io/
| 模型 | avg | easy | medium | hard | very_hard | 来源 |
|---|---|---|---|---|---|---|
| SmolVLASmolVLA 0.45B (main) Hugging Face (LeRobot) | 57.3 | 82.5 | 41.8 | 45 | 60 | 论文 Table 2, row 'SmolVLA (0.45B)', Meta-World Avg 2.25B variant avg 68.24; 0.24B variant avg 56.95 |
真机评测(论文自报) real
各论文在自己的真机与任务集上报告的成功率。设置互不相同,不能横向比较,只作记录。 · 指标:成功率 %
| 模型 | bridgedata_v2_widowx_17_tasks | google_robot_12_tasks | franka_tabletop_finetuned_avg | franka_droid_finetuned_avg | finetuning_6_domains_avg | aloha_wash_cup_unseen_cup2_total | aloha_pour_water_unseen_room3_total | aloha_pour_water_L_1/3_total | aloha_fold_shorts_1shot_total | aloha_handover_5shot_total | aloha_robot_dog_total | agibot_g1_5_tasks_avg_completion_score | realman_arm_pick_stack_place_overall_avg | franka_4_tasks_avg | so100_multitask_3_tasks_avg | so101_pick_place_lego_in_distribution | gm100_4_platforms_avg_success_rate | gm100_4_platforms_avg_progress_score | gm100_3_platforms_avg_success_rate | gm100_agilex_cobot_magic_success_rate | gm100_galaxea_r1pro_success_rate | long_horizon_astribot_s1_refrigerator_in_domain_success_rate | long_horizon_cobot_magic_arx_x5_stove_in_domain_success_rate | real_gr1_language_following_task_overall_success | unitree_g1_place_1_of_2_fruits | Close the microwave | Lift the red chili pepper | Put eggplant in the basket | Put purple cup on white plate | Put green cup on the pink cloth (cup on stove) | Put purple cup on pink cloth (cup in sink) | Put the carrot in the plate | avg | generalizability_avg | Pick up and place green blocks | Pick up and place strawberries | Grab pen and put it into holder | Single-Target Manipulation | Multi-Target Manipulation | Instruction-following with Distractors | Collect-Waste (in-distribution) | zero-shot pick-and-place, seen-object instructions | Synthetic Categories / basic | Synthetic Categories / light | Synthetic Categories / b.g. | Synthetic Categories / dis. | Synthetic Categories / height | Web Categories / basic | Web Categories / light | Web Categories / b.g. | Web Categories / dis. | Web Categories / height | Pick-Place-Toy / Seen | Pick-Place-Toy / Unseen | Pick-Place-Toy / Clutter | Close-Toolbox | Close-Lid | Pour-Cup | Unfold-Clothes | diverse manipulation, all platforms avg | AgiBot G-1 long-horizon avg completion | Sweep Leftover | bimanual_6task_avg_seen | bimanual_6task_avg_domain_randomization | reach | grasp_cup | grasp_box | reach_with_object_cup | reach_with_object_box | pick_and_place_cup | pick_and_place_box | shirt_folding_score | laundry_folding_score | object_transportation_seen_objects | object_transportation_unseen_instances | object_transportation_unseen_categories | articulated_object_manipulation | droid_zero_shot_unseen_env_objects_avg | r1_lite_r1_pro_finetune_avg | cloth_folding_success | unzipping_success | table_bussing_progress | mof_long_horizon_success | agibot_g1_end_to_end_success | agibot_g1_stepwise_success | 来源 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RynnVLA-001 阿里巴巴达摩院 | 90.6 | 90 | 91.7 | 90 | 93.3 | 86.7 | 91.7 | 论文 Table 1, row 'RynnVLA-001 (Ours)', Average (%) LeRobot SO100 arms; 60 trials per task (two arms x three evaluation settings x 10 trials); each number is the average SR across the three evaluation settings in Table 2. Baselines: GR00T N1.5 55.6, Pi0 70.4 (avg). SR@1 (first-attempt) 56.7. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| UniVLAUniVLA (Full) OpenDriveLab(香港大学 等) | 81.7 | 论文 Table A-V, row 'UniVLA (Full)', Average Succ. AgileX Piper arm (7-DoF). Four tasks: Store screwdriver 93.3, Clean cutting board 100.0, Fold towel twice 46.7, Stack tower of hanoi 86.7; average score 2.63 (max 3). Trials per task not captured from the HTML. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| NORA Declare Lab(新加坡科技设计大学) | 56.7 | 论文 Table 1, row 'Average', column 'NORA (Ours)' Real WidowX-250, 9 tasks x 10 trials (multiple-object, OOD object, spatial categories); baselines RT-1 4.4, OpenVLA 40, SpatialVLA 11.1. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LAPALAPA (Open-X) KAIST / 华盛顿大学 等(Latent Action Pretraining) | 50.1 | 论文 Table 2, row 'LAPA (Open-X)', AVG Real Franka Emika Panda; 3 tasks (knocking, covering, pick&place sink); 54 rollouts per model (18 per task) split across seen-obj/unseen-combo, unseen-obj, unseen-instruction. Columns: Seen Obj. Unseen Combo / Unseen Obj. / Seen Obj. Unseen Instr. Row: 57.8 / 43.9 / 48.5. Table 16 total success rate 50.09% (strict 35.19%). Headline variant. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LAPALAPA (Bridge) KAIST / 华盛顿大学 等(Latent Action Pretraining) | 36.8 | 论文 Table 2, row 'LAPA (Bridge)', AVG Real Franka Emika Panda; 3 tasks (knocking, covering, pick&place sink); 54 rollouts per model (18 per task) split across seen-obj/unseen-combo, unseen-obj, unseen-instruction. Columns: Seen Obj. Unseen Combo / Unseen Obj. / Seen Obj. Unseen Instr. Row: 43.4 / 31.4 / 35.6. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LAPALAPA (Human Videos) KAIST / 华盛顿大学 等(Latent Action Pretraining) | 34 | 论文 Table 2, row 'LAPA (Human Videos)', AVG Real Franka Emika Panda; 3 tasks (knocking, covering, pick&place sink); 54 rollouts per model (18 per task) split across seen-obj/unseen-combo, unseen-obj, unseen-instruction. Columns: Seen Obj. Unseen Combo / Unseen Obj. / Seen Obj. Unseen Instr. Row: 36.5 / 37.4 / 28.1. Pretrained on Something-Something V2 human video only. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| OpenVLA Stanford / UC Berkeley / TRI 等(OpenVLA 团队) | 70.6 | 85 | 67.2 | 58.3 | 论文 Table 4 (Appendix B.1.3), bottom row 'Mean Success Rate', column 'OpenVLA (ours)' (70.6±3.2%) Zero-shot (pretrained OpenVLA, no fine-tuning) on WidowX / BridgeData V2 setup; 17 tasks x 10 trials = 170 rollouts; partial success 0.5 allowed on some tasks; baselines in same table: RT-1-X 18.5±2.7%, Octo 20.0±2.6%, RT-2-X 50.6±3.5% | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| OctoOcto-Base UC Berkeley RAIL 等 | 72 | 论文 Table I (fine-tuning results), row 'Octo', Average Octo fine-tuned with ~100 target demos per domain (Berkeley Insertion 70, Stanford Coffee 75, CMU Baking 50, Berkeley Pick-Up 60, Berkeley Coke 100, Berkeley Bimanual 80); ~20 trials per domain; baselines ResNet+Transformer scratch 20%, VC-1 15%. Zero-shot results (Fig. 4) are bar charts with no printed values | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| RDT-1B 清华大学 TSAIL(thu-ml) | 50 | 62.5 | 100 | 68 | 40 | 76 | 0.5 score 0-1 | 论文 Table 3 'Quantitative results', row 'RDT (ours)', Wash Cup 'Total' sub-column for unseen cup 2 (also used as 'Unseen Object' in Table 2) ALOHA dual-arm; RDT pre-trained then fine-tuned on self-collected ALOHA data; 8 trials per cup (24 total); Total for seen cup 1 = 50, unseen cup 1 = 75; ACT/OpenVLA/Octo Total = 0 for all cups; RDT (scratch) Total = 0 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| CogACT Microsoft Research | 71.2 | 61.4 | 论文 Table 3 (real robot, Realman), row 'CogACT', Overall Avg Fine-tuned on real-robot data; Pick 70.8 / Stack 82.3 / Place 60.4; Octo-Base 4.9, OpenVLA 12.1 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| SmolVLASmolVLA 0.45B (main) Hugging Face (LeRobot) | 78.3 | 90 | 论文 Table 3 (real-world SO-100), row 'SmolVLA (0.45B)', Avg (Pick-Place 75 / Stacking 90 / Sorting 70) Multi-task fine-tuning, 50 demos per task, 200k steps; baselines ACT (single-task) 48.3, π0 (multi-task) 61.7 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| π0 (pi-zero) Physical Intelligence | 0.6 score 0-1 | 第三方 GO-1 paper, Fig. 5(b) 'Average' bar label for π0 π0 fine-tuned per task by the GO-1 authors on AgiBot G1; 5 tasks, 30 trials per task; bar labels verified from the rendered figure | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| π0 (pi-zero)π0 (3.5B), multi-task fine-tuned Physical Intelligence | 61.7 | 第三方 SmolVLA paper, Table 3, row 'π0 (3.5B)', Avg (Pick-Place 100 / Stacking 40 / Sorting 45) Run by SmolVLA authors on SO-100 arm | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| π0.5 Physical Intelligence | 13 | 第三方 LingBot-VLA paper, GM-100 multi-platform table, column 'π0.5', Average SR (Progress Score 27.32%) Post-trained by LingBot authors with 130 episodes per task; 100 tasks, 4 platforms (Agibot G1, AgileX, Galaxea R1Pro, Leju KUAVO 4 Pro), 15 trials per task-robot pair; per-platform SR 7.77 / 17.20 / 14.10 / 12.91 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GO-1 (Genie Operator-1) 智元机器人 (AgiBot) | 0.8 score 0-1 | 论文 Fig. 5(b) 'Real-world Experiment Results', 'Average' group, bar label for GO-1 (per task: Restock Bag 0.98, Table Bussing 1.00, Pour Water 0.67, Restock Beverage 0.60, Fold Shorts 0.66) AgiBot G1; 5 tasks; 30 trials per task (10 seen setup + 20 with variations/distractors); GO-1 pre-trained on AgiBot World beta then fine-tuned per task (lr 2e-5, batch 768, 30k steps); score = normalized completion averaged over rollouts (1.0 full success, fractional partial). Values are bar labels printed in the figure (no numeric table); attribution verified from the rendered PDF page. Baselines: RDT-1B 0.46, π0 0.58, GO-1 w/o Latent Planner 0.66; Fig. 1 teaser prints 78 / 66 / 46 and '32% gain' | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GO-1 (Genie Operator-1)GO-1 w/o Latent Planner 智元机器人 (AgiBot) | 0.7 score 0-1 | 论文 Fig. 5(b) 'Average' bar label for 'GO-1 w/o Latent Planner' (per task 0.93 / 0.87 / 0.42 / 0.49 / 0.60) Same protocol; text: latent planner yields 'an average improvement of 0.12 task completion score' | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LingBot-VLA 4BLingBot-VLA-4B-Depth (w/ depth distillation) 蚂蚁灵波(Robbyant) | 16.9 | 35.2 % progress | 17.3 | 论文 GM-100 multi-platform table, column 'Ours w/ depth', Average SR (Progress Score 35.16%) GM-100: 100 tasks, 4 platforms (Agibot G1, AgileX, Galaxea R1Pro, Leju KUAVO 4 Pro), 130 post-training episodes per task, 15 trials per task-robot pair; per-platform SR 11.98 / 18.93 / 20.98 / 15.60; baselines WALL-OSS 3.85, GR00T N1.6 7.31, π0.5 13.00 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LingBot-VLA 4BLingBot-VLA-4B (w/o depth) 蚂蚁灵波(Robbyant) | 16.2 | 论文 GM-100 table, column 'Ours w/o depth', Average SR (PS 34.32%) Per-platform SR 12.82 / 15.50 / 18.89 / 17.59 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LingBot-VLA 2.0 蚂蚁灵波科技 (Ant Group) | 34.4 | 15.6 | 60 | 66.7 | 官方 README, GM-100 bimanual manipulation, AgileX Cobot Magic: progress score / success rate = 66.2 / 34.4 GM-100 tabletop bimanual benchmark; trial counts not stated in README | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GR00T N1.6 3B NVIDIA | 7.3 | 第三方 LingBot-VLA paper, GM-100 multi-platform table, column 'GR00T N1.6', Average SR (Progress Score 16.66%) Post-trained by LingBot authors with 130 episodes per task; 100 tasks, 4 platforms, 15 trials per task-robot pair; per-platform SR 5.23 / 3.26 / 14.29 / 6.45 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GR00T N1.5 3B NVIDIA | 83 | 官方 'Real GR-1 Language Following Task' table, 'Overall success rate', GR00T N1.5 (N1 = 43.3%); 'Language following rate' 93.3% (N1 = 46.6%) Real Fourier GR-1 humanoid; pick one of two fruits and place on plate, target side randomized; trial count not stated | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GR00T N1.5 3BGR00T N1.5 post-trained (1K demos) NVIDIA | 98.8 | 官方 'Unitree G1 Post-training (1K demos)' table, row 'GR00T N1.5, 1K Demos', 'Place 1 of 2 fruits (4 total)' (N1 = 44.0%); 'Place 1 of 2 objects (5 novel)' = 84.2% Real Unitree G1 humanoid, 1K post-training demos | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| SpatialVLA 上海人工智能实验室 等 | 100 | 72.7 | 72.7 | 45.5 | 81.8 | 90.9 | 45.5 | 论文 Table XI, row 'SpatialVLA', column 'Close the microwave' (Success) Real-world WidowX zero-shot (out-of-the-box, no fine-tuning), 7 BridgeV2-style tasks, 11 trials each (77 rollouts total, Fig. 5). No average printed in the paper; per-task 'Success' column copied. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| UniVLA OpenDriveLab(香港大学 等) | 68.9 | 论文 Table II, row 'UniVLA (Ours)', Average Succ. Generalizability suite: Lightning Variation 66.7, Visual Distractor 53.3, Novel Object 86.7; average score 2.49. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| WALL-OSS 自变量机器人(X Square Robot) | 100 | 85 % progress | 论文 Section 5.2.3 text (Figure 7 bars): 'the pre-trained models—WALL-OSS and pi0—achieve a 100% success rate on the in-distribution (ID) task' Text statement, not a table; 1000 demonstrations; Pick-Place-Cup (500 demos) reported only as 'above 90%' and OOD Collect-Waste as 'above 80%'. Robot/trial counts not printed in text. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GraspVLA 北京大学 EPIC 实验室 / 银河通用 | 93.3 | 96.6 | 93.3 | 93.3 | 90 | 93.3 | 90 | 93.3 | 86.6 | 86.6 | 论文 Table 1, row 'Ours', Synthetic Categories, column 'basic' Zero-shot real-world grasping on Franka Panda (no real-world action data); 15 objects x 2 trials per condition per category group, 300 trials total. Conditions: basic / light / background (b.g.) / distractor (dis.) / height. SPL 87.2. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Being-H0 BeingBeyond(北京) | 0.8 fraction | 0.7 fraction | 0.6 fraction | 0.9 fraction | 0.6 fraction | 1 fraction | 0.8 fraction | 论文 Table 7, row 'Being-H0', column 'Pick-Place-Toy / Seen' 7-DoF Franka Research 3 + 6-DoF Inspire hand, RealSense L515; 20 randomized trials per task; post-training on 50-100 teleop trajectories per task. Caption says 'Success rates (%)' but values are printed as fractions (0-1); copied as printed. Model size not given in the row label. Baselines GR00T N1.5 and InternVL3 (same architecture without physical instruction tuning). | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| EO-1 IPEC-COMMUNITY(上海人工智能实验室 系) | 86 | 81 | 论文 Section 4.5 text describing Figure 6: 'achieving a performance of 86.0%, compared with 43.0% for Fast, 71.0% for GR00T-N1.5, and 68.0% for pi0' Number stated in text/bar chart, not a table. Averaged across robot platforms (Franka Panda, WidowX, AgiBot G-1, etc.) and task categories; Franka pick-and-place 94.0%. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HPT(Heterogeneous Pre-trained Transformers)HPT-XL Finetuned MIT(Lirui Wang, Kaiming He 等) | 76.7 | 论文 Table 3 'Comparison on the Sweep Leftover', row 'HPT-XL Finetuned' Real-world 'Sweep Leftover' task ablation; ~100 demos per task, 15 trials per evaluation per protocol text; printed with std. Baselines: From Scratch 43.3±3.8, VC-1 53.3±2.6, No Prop. Finetuned 63.3±2.6. Printed as 76.7±3.3. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HPT(Heterogeneous Pre-trained Transformers)HPT-B Finetuned MIT(Lirui Wang, Kaiming He 等) | 70 | 论文 Table 3 'Comparison on the Sweep Leftover', row 'HPT-B Finetuned' Real-world 'Sweep Leftover' task ablation; ~100 demos per task, 15 trials per evaluation per protocol text; printed with std. Baselines: From Scratch 43.3±3.8, VC-1 53.3±2.6, No Prop. Finetuned 63.3±2.6. Printed as 70.0±3.0. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LLaVA-VLA OpenHelix 团队 | 44.2 | 30.7 | 论文 Table XI 'Comparison of success rates on real-world bimanual tasks', row 'LLaVA-VLA (Ours)', column Avg. Success / Seen Real robot: Cobot-Magic dual-arm mobile robot with Piper arms (fixed-base bimanual setting). 6 tasks: Stack Bowls 58, Restore Bottle 38, Click Bell 66, Place Vegetable 50, Pack Bottles 28, Lift Pot 25 (%). 100 episodes per task per setting. Baselines: ACT 18.6, TinyVLA 17.5. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| V-JEPA 2-AC Meta FAIR | 100 | 65 | 25 | 75 | 75 | 80 | 65 | 论文 Table 2, row 'V-JEPA 2-AC (ours) / Avg', column 'reach' Table 2 'Zero-Shot Robot Manipulation': deployed zero-shot on two Franka arms with Robotiq grippers in two different labs; image-goal, closed-loop MPC (CEM) planning with the V-JEPA 2-AC world model; success out of 10 trials per lab with permutations (object location, starting pose); 'Avg' row is the printed average of Lab 1 and Lab 2. Action-conditioned model trained on 62 h of unlabeled DROID data. Octo baseline Avg: Reach 100, Grasp Cup 15, Grasp Box 0, Reach w/ Obj Cup 15, Box 70, Pick-&-Place Cup 15, Box 10. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| DexVLA 美的 AI 研究院 等(DexVLA 团队) | 0.9 score 0-1 | 0.4 score 0-1 | 论文 Table 1 'Ablation study of three stage training', row Stage1+Stage2+Stage3 (all checked), column 'Shirt Folding'; also text Sec. 4: 'DexVLA achieves a 0.92 point on shirt folding without any task-specific adaptation' Metric is a normalized task score (0-1), not binary success; averaged over 10 trials (Fig. 7 protocol). Bimanual AgileX robot. The same 0.92 is obtained with Stage 1+2 only (no task-specific Stage 3). Baselines Octo/OpenVLA/DP scored ~0 (figure-only). | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GR-1 字节跳动 Research | 0.8 fraction | 0.7 fraction | 0.3 fraction | 0.8 fraction | 论文 Table 2, row 'GR-1 (Ours)', column 'Object Transportation / Seen Objects' Table 2 'Real Robot Experiment Results'. 7-DoF Kinova Gen2 with wrist RealSense + Kinect Azure. Values printed as fractions. Baselines: RT-1 0.27/0.13/0.00/0.35, MT-R3M 0.15/0.13/0.10/0.30. Number of rollouts per setting not stated in the table. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Galaxea G0.5 星海图(Galaxea) | 82.5 | 76.7 | 论文 Abstract / Sec. 5.1.2 text: 'DROID post-training followed by zero-shot transfer to an unseen environment and objects (82.5%)' Franka Research 3 with Robotiq gripper; post-trained on DROID, evaluated zero-shot in a held-out environment with held-out objects; each task evaluated over 10 trials (binary success except one sequential task with partial credit). Average over the DROID zero-shot task set as stated in text. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| RDT2-VQRDT2-UltraFast (fine-tuned RDT2-FM + one-step consistency distillation; NOT the VQ head) 清华大学 TSAIL(thu-ml) | 77 | 45 | 0.6 score 0-1 | 论文 Table 2, row 'Cloth Folding / Success Rate(%)', column RDT2 ATTRIBUTION CAVEAT: Table 2 'Fine-tuning performance of RDT2 and baseline models on challenging real-world tasks' reports the RDT2-UltraFast variant (Sec. 6.3: 'We use the RDT2-UltraFast variant in this experiment'; Appendix: obtained from the fine-tuned RDT2-FM via consistency distillation). It is a sibling of RDT2-VQ, not RDT2-VQ itself; recorded under this id only because the batch id covers the RDT2 family. RDT2-VQ's own zero-shot results (Pick, Pick&Place, Wiping, Shaking, Button Pressing; 256 trials per task) appear only in Figure 3 (bar chart with standard-error bars) and are not printed as numbers. Fine-tuning: from Stage-1 UMI-pretrained checkpoint, frozen VL backbone, 50K steps + 20K distillation steps. Baselines pi0.5 and pi0-FAST fine-tuned on the same data. Trial counts for Table 2 not stated in text. Same row: pi0.5 36, pi0-FAST 29. Sub-tasks: left sleeve 97, right sleeve 95, final fold 81; unseen object 51. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| InternVLA-A1.5 上海人工智能实验室 InternRobotics | 76.4 | 论文 Sec. 5 real-world results text: 'On the long-horizon MOF task, InternVLA-A1.5 reaches 76.4% while pi0.5 succeeds in only 29.3% of the trials and Motus fails to complete the procedure in any trial' Real-world long-horizon chemistry procedure (MOF) on the authors' bimanual platform; all methods fine-tuned on the same demonstrations; 'multiple trials with randomized object placement' (exact count not stated for MOF; 15 trials per binding for the instruction-following tasks). Per-task numbers for Sort/Insert/Move Tubes are in Figure 8 (figure-only). | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Genie Envisioner(GE-Act)GE-Act 智元机器人(AgiBot) | 0.9 fraction | 0.8 fraction | 论文 Table 1, row 'VidAW ✓ / VidAda ✓', column 'E2E / w/ S' Table 1 'Analysis of Pre-training' (Sec. 3.4, GE-Act on AgiBot G1): row VidAW ✓ (init from GE-Base) + VidAda ✓ (task-specific video adaptation), 'w/ S' (robot state as input) column. Text: 'in-domain pretraining achieves 64 SR and 81 E2E, which further improve to 76% and 89% when combined with general video pretraining.' Values printed as fractions. Metrics: E2E = end-to-end success of the complete task (retries of sub-steps allowed); SR = step-wise success (completed sub-steps / total). The table does not name the task(s) or trial counts for this ablation; without-state ('w/o S') values are E2E 0.37 / SR 0.37. GE-Act vs UniVLA / GR00T N1 / pi0 on the five AgiBot G1 tasks, the Agilex Cobot Magic / Dual Franka cross-embodiment tasks and the four RoboTwin tasks are figure-only (Fig. 8, Fig. 11) - no numbers in text. No CALVIN or LIBERO results in the paper (v1-v3) despite the Dec-2025 release of 'GE-Act trained on Calvin' weights. |
其他基准 mixed
上述以外的公开基准,逐条注明名称。 · 指标:按原文
| 模型 | pdms | 0_shot | success_rate | Object Grounding | Scene Captioning | Action Planning | Letter | Number | Sort into Drawers | Make Sandwiches | Desktop Sorting | Math calculation | Goods Purchase | Language-Conditioned overall | RoboVQA | ERQA | EO-Bench @ Spatial | EO-Bench @ Temporal | Overall | In-domain / Seen | In-domain / Unseen | task_success_score | total | zero_shot_success_rate | test_success_rate | libero_90_success | 来源 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| X-VLAX-VLA-0.9B 清华大学 AIR(2toINF) · NAVSIM (autonomous driving) | 87.3 PDMS | 论文 Table 2, row 'X-VLA (Ours)', NAVSIM PDMS; Table 11 NC 97.5 / DAC 96.5 / EP 82.2 / TTC 92.9 / C 100.0 / PDMS 87.3 Cross-domain (driving) adaptation; UniVLA 81.7 in same table | |||||||||||||||||||||||||
| GR00T N1.5 3B NVIDIA · Sim GR-1 tabletop (0-shot) | 43.9 | 38.3 | 官方 'Data-Limited Post-Training' table, row 'Sim GR-1, 0-shot', GR00T N1.5 (N1 = 39.6); row 'Sim GR-1, 30 Demos per Task' = 47.4 (N1 = 43.2) Simulated GR-1 humanoid tabletop tasks | ||||||||||||||||||||||||
| WALL-OSS 自变量机器人(X Square Robot) · Embodied VQA (in-house) | 91.6 | 87.6 | 69 | 论文 Table 2, row 'WALL-OSS', column 'Object Grounding' In-house embodied VQA benchmark; baseline Qwen2.5-VL-3B scores 46.1 / 57.7 / 59.8. | |||||||||||||||||||||||
| WALL-OSSWALL-OSS (Co-training) 自变量机器人(X Square Robot) · Block-spell instruction following | 87 | 95 | 论文 Table 3, row 'Letter', column 'WALL-OSS (Co-training)' Block-spell instruction-following accuracy; WALL-OSS action-only 26 / 80, pi0 action-only 9 / 35. Trial counts not printed. | ||||||||||||||||||||||||
| InternVLA-M1InternVLA-M1 (3B) 上海人工智能实验室 InternRobotics · Real-world long-horizon task planning (VLM planner) | 90 | 91 | 91 | 93 | 92 | 论文 Table 5 / Figure 12, row 'Ours-3B', column 'Sort into Drawers' Task-scheduling success of the VLM planner in real-world long-horizon/reasoning scenarios (not end-to-end manipulation success); compared with Gemini-2.5 Pro, GPT-5, GPT-4o, Qwen2.5-VL. | |||||||||||||||||||||
| GraspVLA 北京大学 EPIC 实验室 / 银河通用 · Language-conditioned grasping vs AnyGrasp | 93.3 | 论文 Table 3, row 'Ours', Language-Conditioned overall Comparison with AnyGrasp (91.6); arbitrary grasping common 93.3, transparent 86.6; 5 Hz. | |||||||||||||||||||||||||
| EO-1EO-1 (3B) IPEC-COMMUNITY(上海人工智能实验室 系) · Embodied reasoning (RoboVQA / ERQA / EO-Bench) | 58.5 score | 45.5 score | 36.4 score | 38.9 score | 44.8 score | 论文 Table 2, row 'EO-1 (3B)', column 'RoboVQA' Embodied reasoning benchmarks vs standard VLMs (GPT-4o overall 40.5, Gemini 1.5 Flash 44.1). | |||||||||||||||||||||
| LAPA KAIST / 华盛顿大学 等(Latent Action Pretraining) · Language Table | 62 | 49.6 | 论文 Table 1, row 'LAPA', In-domain (1k) Seen Language Table simulation; printed 62.0±8.7 (StdErr). Other columns: In-domain Unseen 49.6±9.5, Cross-task Seen 73.2±6.8 / Unseen 54.8±9.1, Cross-env Seen 33.6±12.7 / Unseen 29.6±12.0. | ||||||||||||||||||||||||
| Galaxea G0.5 星海图(Galaxea) · 2025 BEHAVIOR Challenge (OmniGibson) | 31.4 | 论文 Abstract text: '2025 BEHAVIOR Challenge on 50 long-horizon household mobile manipulation tasks using a generalist policy (31.4% vs. 26.3% for pi0.5 and 26.1% for the challenge winner)'; detailed in Table 4/6 OmniGibson simulator, R1-Pro embodiment; 50 tasks x 10 instances; 'Task Success Score' is the challenge ranking metric (task progress). Single generalist policy (Table 4 lists 4-epoch checkpoint; 1-epoch checkpoint scores lower). | |||||||||||||||||||||||||
| InternVLA-A1.5 上海人工智能实验室 InternRobotics · LIBERO-Plus | 84.8 | 27.7 | 35.2 | 论文 Table 6 'Results on LIBERO-Plus', row 'InternVLA-A1.5 (Ours)', column Total Zero-shot robustness test: model trained on LIBERO evaluated directly under LIBERO-Plus perturbations. Per-category: Camera 83.1, Robot 55.1, Language 86.9, Light 96.4, Background 98.2, Noise 95.6, Layout 85.2. Baselines: pi0.5 84.4, Cosmos-Policy 82.2. | |||||||||||||||||||||||
| MiniVLA Stanford ILIAD · LIBERO-90 | 61.4 | 官方 Blog table 'Trained to 95% Action Accuracy', row 'MiniVLA', column 'Libero 90' Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). Base MiniVLA without VQ or multi-image inputs. | |||||||||||||||||||||||||
| MiniVLAMiniVLA + VQ h8 (action chunks) Stanford ILIAD · LIBERO-90 | 77 | 官方 Blog table 'Model (Final Action Accuracy) | Libero 90', row '+ VQ h8 (action chunks) (85%)' Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). VQ action chunking (Residual VQ, horizon 8). Same table: '+ VQ h1 (single action)' 62.4%. | |||||||||||||||||||||||||
| MiniVLAMiniVLA + VQ h8 + history=2 Stanford ILIAD · LIBERO-90 | 82 | 官方 Blog table 'Model | Libero 90', row '+ VQ h8 + history=2' Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). Adds 2-frame image history on top of VQ h8. | |||||||||||||||||||||||||
| MiniVLAMiniVLA + VQ h8 + wrist images Stanford ILIAD · LIBERO-90 | 82.1 | 官方 Blog table 'Model | Libero 90', row '+ VQ h8 + wrist images' Official SAIL blog post 'MiniVLA: A Better VLA with a Smaller Footprint' (Belkhale & Sadigh, Dec 12 2024) - the project has no paper; README points here. LIBERO-90 (90-task suite), NOT the LIBERO 4-suite; 'rollout task success rates in simulation averaged across the 90 tasks'; rollout counts not stated. MiniVLA = Prismatic VLM with Qwen2.5-0.5B LLM (+ DINO-SigLIP ViT), ~1B params total; models trained to the stated action-token accuracy. OpenVLA (7B) row in the same tables: 62%. Corroborated by the author's X thread https://x.com/suneel_belkhale/status/1867631572255707529 ('from 77% to 82%'). Adds wrist-camera image on top of VQ h8. Blog: 'quite close to the state-of-the-art performance on Libero 90, from Baku'. |
同一基准内按 avg 列(或第一子集)排序,不构成跨基准排名。空格表示来源没有印这个数字。
方向清晰,判断有据。