Blind Dexterity: Whole-Body Humanoid Manipulation
via Pure Proprioception

1Intelligent Autonomous Systems Lab, TU Darmstadt 2hessian.AI 3German Research Center for AI (DFKI)
4Tongji University, Shanghai Research Institute for Autonomous Intelligent Systems 5Robotics Institute Germany

Abstract

We present blind, whole-body manipulation skills on a Unitree G1 humanoid using only onboard proprioception, without cameras, markers, force-torque, or tactile sensors. Despite this minimal sensing, the trained policies exhibit surprising capability across qualitatively different tasks: push-resilient bipedal walking without IMU feedback, active soccer ball trapping with a foot, seeking and lifting a suitcase by its handle, and mounting a randomly positioned skateboard.

We argue that these capabilities arise from a key underappreciated signal: the way the joint encoder readouts evolve under purposeful compliant contact, effectively forming a whole-body tactile channel. By generating contact-rich motions, the trained policies actively probe the environment; as a result, task-relevant object state (e.g. pose) becomes increasingly decodable from short proprioceptive histories. We expose this information using compact task-specific state estimators trained alongside, but fully separately from, the policies; their prediction errors decrease rapidly after informative contact.

Our results indicate that joint encoder-based proprioception, combined with compliant actuation—now widely available on commercial robots and low-cost motors—is already a strong, practical substrate for whole-body dexterous manipulation and interactive perception, and therefore a natural foundation on which richer sensing can be layered.

TL;DR

Problem

Modern robotic dexterity relies on cameras, object trackers, force-torque sensors, or tactile skins. But machine vision is sensitive to occlusion, lighting, color, and changes in scene appearance; dedicated tactile hardware is fragile, expensive, and hard to simulate faithfully at GPU-accelerated scale.

Can blind proprioceptive policies—already so good at locomotion—also do whole-body manipulation?

Insight

Under compliant position control, contact-induced loads perturb nominal joint tracking, leaving sparse but informative signatures in encoder histories.

  • Proprioception already carries blind locomotion over stairs and uneven terrain.
  • A short proprioceptive history reveals how tracking deviations evolve during contact.
  • Contact-rich interactions should therefore leak live object information into short proprioceptive histories.

Approach: Train with Sensory Deprivation

Delete every object-related observation at training time: the manipulation policy receives exactly the proprioceptive inputs used by conventional blind-locomotion policies.

  1. Train contact-rich policies from scratch with reinforcement learning in simulation.
  2. Train separate task-specific state estimators to probe what proprioceptive histories reveal.
  3. Randomize object and scene configurations broadly enough that the policy cannot exploit memorized initial conditions.

What We Find

Blind Dexterity

We design and study four skills with increasing levels of interaction complexity:

Encoder-only walking

To our knowledge, the first real-world push-resilient bipedal humanoid locomotion policy using only joint encoders—without IMU or force/torque sensing.

Football trapping

Search for and trap a randomly placed football with one foot.

Skateboard mounting

Locate, orient, and mount a freely moving skateboard.

Suitcase lifting

Find a recessed handle and gently lift a suitcase randomly placed on tables of varying heights.

Our policies learn to sweep, tap, drag, and slide against the world to create the sensations they need in their joint angles. Collectively, they are an existence proof that useful haptic perception can emerge without dedicated tactile sensors.

Interactive Perception

Active football localization

The policy sweeps with one foot, then taps and traps the ball after first contact.

Skateboard pose disambiguation

The policy touches the nose or tail and drags the deck to disambiguate its position and yaw.

Gentle suitcase search

The policy touches the table and suitcase, then searches along the top edge until it feels the handle opening; all without toppling the slim object.

Across tasks, estimator error drops after these informative contacts. The policies actively create proprioceptive evidence from which hidden object state can be perceived.

What Matters

  • Blind student policies distilled from privileged teachers perform poorly. They imitate direct, object-aware motions but do not learn the active search strategies needed before contact.
  • Blind policies trained from scratch discover active search strategies. They learn to seek informative contact before manipulating the object.

Takeaway

Off-the-shelf robots already possess a latent capacity for haptic perception through their joint encoders.

This capacity should be exploited whenever vision is unreliable—for example, during highly dynamic manipulation or under occlusion—and used as a natural foundation on which richer sensing can be layered.

Read

Cite