Adobe teams up with Luma AI to unveil new generative video model
In a significant move, Adobe has announced the integration of Ray3, a new generative video model developed by Luma AI, into its creative AI ecosystem. The partnership aims to empower creators with tools that enhance their creative vision and workflows.
Ray3, according to Luma AI's founding engineer, Piotr Dollar, is designed to provide enhanced character consistency and produce natural-feeling motion. Built on a new multimodal reasoning system, it aims to enhance understanding of creative intent.
The integration with Adobe Firefly brings the vision of Ray3 to life. Adobe Firefly, an all-in-one destination for creative AI solutions, will now include Ray3 as part of its capabilities.
Filmmakers, producers, and visual storytellers can utilise Ray3 in Firefly Boards for testing visual directions before shooting. Content creators can also use Ray3 in Firefly's Text to Video feature to quickly generate b-roll or background footage.
Ray3 supports native HDR and can create cinematic, high-quality videos up to 10 seconds in duration. The combination of Adobe's creative app ecosystem with Ray3's intelligence is intended to give creators the ability to move from idea to cinematic video quickly with professional-grade quality and control.
Adobe's Vice President of New GenAI Business Ventures, Hannah Elsakr, emphasised Adobe's focus on building an AI ecosystem that puts creators at the centre and empowers them with tools like Adobe Firefly. The company aims to help creators move faster while keeping control of their creative vision.
Luma AI has chosen Adobe as its first third-party launch partner for Ray3. This partnership is not just about faster workflows; it's about unlocking new ways to imagine and tell stories.
Ray3 generates environments, shot compositions, and camera perspectives while storyboarding or planning scenes. It will be available alongside models from Adobe partners including Google, OpenAI, Runway, Ideogram, Pika, Topaz Labs, Moonvalley, and more.
Adobe is focused on building the creative AI ecosystem of the future. With the addition of Ray3, Adobe Firefly aims to become a go-to solution for creative AI, providing creators with the tools they need to bring their visions to life.