BodyVLA: Embedding Morphology into Transformers for Cross-Robot Policy Learning

An embodiment-aware transformer policy that injects morphology.

MERL Researchers: Toshiaki Koike-Akino, Kei Suzuki, Jing Liu, Ye Wang, Matthew Brand, Chiori Hori.

Paper

Appendix_along_with_Main_Paper.pdf

Video

Supplemental_Material_Video.mp4


Abstract

Cross-robot policy learning—training a single policy to perform well across multiple embodiments—remains a central challenge in robot learning. Transformer-based policies, such as vision-language-action (VLA) models, are typically embodiment-agnostic and must infer kinematic structure purely from observations, which can reduce robustness across embodiments and even limit performance within a single embodiment. We propose an embodiment-aware transformer policy that injects morphology via three mechanisms: (1) kinematic tokens that factorize actions across joints and compress time through per-joint temporal chunking; (2) a topology-aware attention bias that encodes kinematic topology as an inductive bias in self-attention, encouraging message passing along kinematic edges; and (3) joint-attribute conditioning that augments topology with per-joint descriptors to capture semantics beyond connectivity. Across a range of embodiments, this structured integration consistently improves performance over a vanilla p0.5 VLA baseline, indicating improved robustness both within an embodiment and across embodiments.

Method

We propose an embodiment-aware transformer policy through a structured morphology interface consisting of three components:

Kinematic token and temporal chunking

(1) Kinematic tokens provide a joint-wise interface for the VLA action policy. While the standard action tokens retain temporal structure, kinematic tokens compress the horizon into per-joint summaries, emphasizing cross-joint (spatial) structure and enabling topology/semantics embedding.







Topology-aware attention and joint-attribute conditioning

We embed kinematic topology and semantics in two ways: (2) a topology-aware attention bias injects local kinematic message passing while preserving global coordination through a local/global schedule, and (3) FiLM conditions kinematic-token embeddings on per-joint descriptors to disambiguate joint roles beyond connectivity.

Results

DROID Results

Each component improves performance, with the best result achieved by combining all three (KT+Mix+FiLM).





Our method yields significantly large gains over the baseline on Task 2 and Task 3, improving success rates by 5-fold and 2.3-fold, respectively.







DROID rollout videos: π0.5 Baseline vs. Ours

DROID Task 1

π0.5 Baseline: ✅ Success

Ours: ❌ Failure




DROID Task 2

π0.5 Baseline: ❌ Failure

Ours: ✅ Success




DROID Task 3

π0.5 Baseline: ❌ Failure

Ours: ✅ Success






SO101 and Unitree G1 Simulation Rollouts

Ours — SO101: ✅ Success

Ours — Unitree G1 Dex1: ✅ Success







DROID—SO101 Joint Training and Real-World Experiment

We evaluate DROID—SO101 joint-trained policies on a real SO101 robot.

0 5 10152025030k50k80kLearning Curve— p0.5 Baseline— OursTraining stepsMacro SR (%)+14 pts




Real-world SO101 results
MethodConfig. 1Config. 2Config. 3Total
p0.5 Baseline0314
Ours1191333
Improvement +11 +6 +12 +29




SO101 rollout videos

10 trials - Baseline 0 oranges - Ours 11 oranges

π0.5 Baseline
❌ 0 oranges placed

Ours
✅ 2 oranges placed




10 trials - Baseline 3 oranges - Ours 9 oranges

π0.5 Baseline
❌ 0 oranges placed

Ours
✅ 2 oranges placed




10 trials - Baseline 1 orange - Ours 13 oranges

π0.5 Baseline
Δ 1 orange placed

Ours
✅ 3 oranges placed











Ablation Studies

To validate the effectiveness of our design choices, we study whether performance depends on (i) the kinematic token chunk size G, (ii) auxiliary kinematic tokens (AKT), and (iii) bias initialization for the Soft-Mask variant.

0 10 20 30 40 36 G=1 35.8 G=2 34.4 G=4 30.5 G=8 Kinematic Token Chunk Size Avg SR (%)

Using a single kinematic token chunk (G=1) achieves the best Avg SR.







0 10 20 30 40 50 36 37 No Mask 30.3 33 Full-Mask 37 47.3 Mix-Mask Auxiliary Kinematic Tokens w/o AKT w/ AKT Avg SR (%)

Adding auxiliary kinematic tokens consistently improves Avg SR across all masking choices.







0 10 20 30 40 26.1Zero 25.1Hard 28.1Mix 20.4Linear 36.9Ours Soft-Mask Bias Initialization Soft-Variants Ours Avg SR (%) +8.8 pts

Mix is the best soft-mask initialization (28.1 Avg SR),while Ours reaches 36.9 Avg SR,showing a +8.8 point improvement over the strongest soft-mask variant.







Citation

  •  Suzuki, K., Liu, J., Wang, Y., Hori, C., Brand, M., Romeres, D., Koike-Akino, T., "Embedding Morphology into Transformers for Cross-Robot Policy Learning", arXiv, February 2026.
    BibTeX arXiv
    • @article{Suzuki2026feb,
    • author = {Suzuki, Kei and Liu, Jing and Wang, Ye and Hori, Chiori and Brand, Matthew and Romeres, Diego and Koike-Akino, Toshiaki},
    • title = {{Embedding Morphology into Transformers for Cross-Robot Policy Learning}},
    • booktitle = {arXiv},
    • year = 2026,
    • month = feb,
    • url = {https://arxiv.org/abs/2603.00182}
    • }





MERL Publications

  •  Suzuki, K., Liu, J., Wang, Y., Hori, C., Brand, M., Romeres, D., Koike-Akino, T., "Embedding Morphology into Transformers for Cross-Robot Policy Learning", International Conference on Learning Representations (ICLR) Workshop, April 2026.
    BibTeX TR2026-048 PDF
    • @inproceedings{Suzuki2026apr,
    • author = {Suzuki, Kei and Liu, Jing and Wang, Ye and Hori, Chiori and Brand, Matthew and Romeres, Diego and Koike-Akino, Toshiaki},
    • title = {{Embedding Morphology into Transformers for Cross-Robot Policy Learning}},
    • booktitle = {International Conference on Learning Representations (ICLR) Workshop on Efficient Spatial Reasoning},
    • year = 2026,
    • month = apr,
    • url = {https://www.merl.com/publications/TR2026-048}
    • }