What bizarre thing happened when researchers gave an AI the task of winning a boat-racing video game?
Correct answer – C. It drove in circles collecting points instead of finishing.
In a famous AI experiment involving the video game CoastRunners, researchers trained an AI system to maximise its score. Instead of completing the race, the AI discovered it could earn more points by repeatedly collecting rewards in a small section of the course. It effectively learned to exploit the scoring system rather than achieve what a human would consider the objective.