A Georgia Tech team pairs a physics simulator with two neural networks to teach robots what soft, deformable objects are made of by watching them move.
A robot gripper squishing dough, a surgical tool slipping on tissue, a warehouse arm tangling in a cable: these are the kinds of tasks that break current robots. Soft, deformable objects are the open frontier in robotics, and a new preprint from Georgia Tech tries to close the gap with a hybrid model that pairs a physics-based simulator with two learned correction modules.
The system watches how an object moves and infers what it is made of: how stretchy or squishy each part is. That estimate feeds a traditional physics engine that simulates how the object deforms. On top of that, a second learned module watches for cases where the physics engine's predictions are off and corrects them. The result is a robot that can identify a novel soft object from a few interactions and decide where to poke or look next when it is not sure.
The authors, all at Georgia Tech, claim the model predicts deformation more accurately than prior baselines. The catch: this is an arXiv preprint, not peer-reviewed, and no independent group has reproduced the result. The paper also stops at lab sequences. No real robot, no factory floor, no operating room.
Deformable-object handling is the next test for robots moving into kitchens and garment lines, and this preprint will need peer review and independent reproduction before anyone builds on it.