Robot history helps most when video learning predicts forward
A robot’s current image can show where an object is, yet miss whether it is moving or how an interaction is unfolding. Giving the controller more past images may help, but processing them can delay its next action.
Long-WAM is a robot-control framework that predicts how a scene will change before generating actions. In RoboCasa GR-1, simulated tasks involving several object transfers, separately trained models completed more tasks with 19.2 seconds of history than with 2.4 seconds, with forecast and action lengths fixed.