blog

Movement is essential to intelligence. The cycle of perceiving and acting is key to our understanding of the physical world around us: cleaning a tabletop, navigating an intersection, or moving household items. These seemingly trivial tasks hide a complex choreography of sensory-motor abilities in plain sight.

In this blog, we extrapolate the idea of next-word prediction (given a partial sentence) to next-action prediction (given the context, e.g. image, sensor data). We found that a simple formulation doesn't work out of the box but rather requires careful understanding of state-action spaces and causality.

We shed light on learning to drive and testing for human drivers within the context of current EU regulations. We hypothesize that training lessons and driving tests are a possible blueprint for a test of generalization for …