http://www.sciencemag.org/news/2019/12/watch-ai-goalie-psych-out-its-opponent-most-hilarious-way

VANCOUVER, CANADA—No, the red player in the video above isn’t having a seizure. And the blue player isn’t drunk. Instead, you’re watching what happens when one artificial intelligence (AI) gets the better of the other, simply by behaving in an unexpected way.

One way to make AI smarter is to have it learn from its environment. Cars of the future, for example, will be better at reading street signs and avoiding pedestrians as they gain more experience. But hackers can exploit these systems with “adversarial attacks”: By subtly and precisely modifying an image, say, you can fool an AI into misidentifying it. A stop sign with a few stickers on it might be seen as a speed limit sign, for example. The new study reveals AI can be fooled into not only seeing something it shouldn’t, but also into behaving in a way it shouldn’t.