Yesterday, Sam Altman, CEO of OpenAI,announced Sora, the company’s new AI video generator.
I don’t mean that as a compliment.
I doubt many people would have guessed on first glance that humans were not involved in the process.
But while its animation potential is concerning enough, it’s the realistic videos that are downright terrifying.
I mean, some of them still don’t seem AI-generated to me, and Iknowthey are.
How are none of these puppies real?
They so clearly love the snow.
God, are we already living in the Matrix?
How does Sora work?
While we don’t have all the details, OpenAI describes Sora’s core processes inits technical report.
First off, Sora is a diffusion model.
These patches contain information of the space and time for a given video.
The company doesn’t confirm where this video and photo data comes from, however.
What else can Sora do?
While it can obviously generate videos from standard prompts, OpenAI says Sora can generate video from still images.
Apple researchers are working on the same throw in of process with theirKeyframer program.
It can also expand an existing video forward or backwards in time.
OpenAI showed an example of this using a video of a streetcar in San Francisco.
It added about 15 seconds of additional video to the start in three different ways.
They can use the technique to make “perfect loops,” as well.
OpenAI thinks Sora is perfect for simulating worlds.
Sora isn’t perfect
To their credit, OpenAI does note Sora’s current weaknesses and limitations.
Apparently, glass shattering is also an issue to render.
(This one is particularly trippy to watch).
Sam Altman took to Twitterfollowing the announcement and asked users to send him responses to put through Sora.
But that doesn’t mean Sora isn’t terrifying.
It won’t take much research or time for it to improve.
I mean,this is where AI video generation was 10 months ago.
But I mean, comeon: Some of these videos are too good.
We’re pushing past the things that can trick you at first glance, but in hindsight look fake.
Now, some of these videos are tough to believearen’treal.
You’d better hope these watermarks actually work, people.
It’s going to be awildride.