OpenAI Unveils Sora: A Game-Changing Text-to-Video Model for Generating Complex Scenes |


Almost 15 months after the launch of its game-changing language model ChatGPT, OpenAI has unveiled another AI tool: Sora. “Introducing Sora, our text-to-video model. Sora can generate videos up to a minute long while maintaining visual quality and adherence to the user’s prompt,” said OpenAI about the new tool.
What can Sora do?
As per OpenAI, Sora is able to generate complex scenes with multiple characters, specific types of motion, and accurate details of the subject and background.“The model understands not only what the user has asked for in the prompt, but also how those things exist in the physical world,” said the company. Furthermore, the model has a deep understanding of language, enabling it to accurately interpret prompts and generate compelling characters that express vibrant emotions. Sora can also create multiple shots within a single generated video that accurately persist characters and visual style, said OpenAI.
OpenAI has acknowledged that the model is not fully there and has some weaknesses. It may struggle with accurately simulating the physics of a complex scene, and may not understand specific instances of cause and effect. For example, a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark. Also, the model may also confuse spatial details of a prompt, for example, mixing up left and right, and may struggle with precise descriptions of events that take place over time, like following a specific camera trajectory, OpenAI has warned.
The ChatGPT creator has also stressed on the safety aspect. “The company will be working domain experts in areas like misinformation, hateful content, and bias , who will be adversarially testing the model. “We’ll be engaging policymakers, educators and artists around the world to understand their concerns and to identify positive use cases for this new technology. Despite extensive research and testing, we cannot predict all of the beneficial ways people will use our technology, nor all the ways people will abuse it,” the company said.


Source link

Leave a Reply

Your email address will not be published. Required fields are marked *