Screw Attention: Rigid-Body Algebra Inside a Transformer
Screw Attention is a transformer layer that embeds rigid-body algebra directly into its attention mechanism. It allows learned policies to use kinematic structure inherently rather than learning spatial relations implicitly from data. This enables better robustness to geometric changes and superior performance in manipulation tasks by respecting the physical structure of the robot and scene.