Humans can't detect AI from human video***
Runway AI's Rigged Test
Over 90% of people can’t distinguish AI video from real footage.
That’s from Runway’s research study released last week. The results are impressive until you read the setup.
The AI videos were:
Only 5 seconds long
Silent
Generated from the first frame of the real footage.
These aren’t minor details! The Achilles heels of AI video generation are duration, audio and generating from scratch. Change any one of those and the results would be different.
None of this is to diminish the remarkable progress AI video has made over the past two years.
But calling this “a tipping point, where the average person can’t tell real from AI” is an overreach. Ask it to generate a two-minute conversation at the dinner table and you’d get a very different result.
Runway built a site where you can test yourself. It’s a fun 10 minutes.
Just remember who designed the test.