While OpenAI appears to be scaling back its activities in the video generation arena with the closure of its Sora app, ByteDance announced on Thursday that its latest audio and video model, Dreamina Seedance 2.0, is currently being deployed in its editing platform, CapCut.
According to ByteDance, the model enables creators to compose, refine, and synchronize video and audio content using prompts, images, or reference videos.
The gradual rollout will commence with CapCut users located in Brazil, Indonesia, Malaysia, Mexico, the Philippines, Thailand, and Vietnam, with additional markets to be included over time.
The announcement regarding the launch in CapCut comes after a recent report indicated that the model’s worldwide rollout would be halted while resolving intellectual property concerns that had prompted criticism from Hollywood regarding suspected copyright violations. This likely accounts for the limited number of regions where the model is presently accessible within CapCut.
In China, the model is available to users of ByteDance’s Jianying app.
The video generation model operates without the need for reference images; even a brief description using a few words from the creator is sufficient, stated ByteDance in its announcement. CapCut excels at producing realistic textures, motion, and lighting from various visual perspectives and angles, which the company claims can be utilized to edit, enhance, or rectify creators’ original footage.
Another potential application would involve creators experimenting with possible ideas grounded in early concepts or drafts prior to filming the actual video.
Moreover, Dreamina Seedance 2.0 can cater to a broad spectrum of content types, including cooking recipes, fitness tutorials, business or product presentations, and action-intensive videos, where AI video models have traditionally encountered difficulties, according to the company.
Upon launch, the model accommodates clips lasting up to 15 seconds across six different aspect ratios.
In CapCut, the model will be introduced across various functionalities, encompassing editing tools like AI Video and content generation features such as Video Studio. It will also be incorporated into ByteDance’s AI generation platform, Dreamina, and its marketing hub, Pippit.
Considering its potential to produce realistic content, ByteDance has implemented safety measures to ensure the model cannot generate videos from images or videos containing actual faces. CapCut will also prohibit the unauthorized creation of intellectual property. (Nevertheless, if the safeguards were functioning effectively, the model would currently be available in the United States, suggesting that further adjustments might still be underway.)
The output created by Dreamina Seedance 2.0 will feature an unobtrusive watermark, which will assist in identifying content generated with the model when shared externally, ByteDance elucidated. This could facilitate actions such as takedown requests from rights holders should the model produce copyrighted material.
ByteDance stated that it plans to collaborate with professionals and creative communities as the model is launched to enhance and refine its functionalities.