They used an external camera system to track the balls and an algorithm to predict where and when the ball would fall. When the robot misses a catch, it looks back or down at where the ball fell, shrugs, or shakes its head. This guy was designed for theme parks, but one day it will be playing catch with our children and fetch with our dogs. Next they should program it to make dad jokes.