OpenAI may be dialing back its efforts in the video generation market with the shutdown of its Sora app, but ByteDance on Thursday confirmed that its new audio and video model, Dreamina Seedance 2.0, is now rolling out in its editing platform, CapCut.
ByteDance says the model allows creators to draft, edit, and sync video and audio content by using prompts, images, or reference videos.
The phased rollout will begin with CapCut users in Brazil, Indonesia, Malaysia, Mexico, the Philippines, Thailand, and Vietnam, with more markets added over time.
The news of the launch in CapCut follows a recent report that said the model’s global rollout would be paused, while it worked to address intellectual property issues that drew criticism from Hollywood over alleged copyright infringement. That likely explains the limited number of markets where the model is currently available within CapCut.
In China, the model is available to users of ByteDance’s Jianying app.
The video generation model works without reference images, even if the creator only uses a few words to describe the scene they have in mind, ByteDance says in its announcement. CapCut is also good at rendering realistic textures, movement, and lighting across a range of visual perspectives and angles, which the company notes could be used to edit, enhance, or correct creators’ own footage.
Another use case would be allowing creators to test potential ideas based on early concepts or sketches before filming the real video.
In addition, Dreamina Seedance 2.0 can be used for a wide range of content, including cooking recipes, fitness tutorials, business or product overviews, and videos with motion or action-focused content, where AI video models have historically faced challenges, the company explains.
At launch, the model supports clips of up to 15 seconds long across six aspect ratios.
In CapCut, the model will roll out across different areas, including editing features such as AI Video and generation tools like Video Studio. It will also come to ByteDance’s AI generation platform, Dreamina, and its marketing platform, Pippit.
Given its ability to create realistic content, ByteDance says it has added safety restrictions, so the model won’t have the ability to make videos from images or videos that contain real faces. CapCut will also block the use of unauthorized generation of intellectual property. (However, if the restrictions were working properly, the model would be available now in the United States. Likely, more tweaks are still being made.)
The content produced by Dreamina Seedance 2.0 will also include an invisible watermark, which will help to identify content made with the model when it’s shared off-platform, ByteDance added. This could aid in things like takedown requests from rights holders in the event that the model allowed copyright content through.
ByteDance says it will partner with experts and creative communities as the model rolls out to iterate and improve upon the model’s capabilities.
Source: techcrunch.com
