I briefly tried the process of using AI to make short plays and explored various methods before the quality became slightly stable. SD2 works well, mini is enough. Later, I plan to use the same mechanism to do it in Jimeng. The general idea is:
- First use Codex + Imagen to lock the characters, scenes and nine-frame storyboard, then split it into three groups of three-frame storyboards, and give them to Higgsfield's Seedance 2 Mini to generate 15-second videos respectively. 2 The sounds are all generated simultaneously from the video model, and finally FFmpeg is used to rearrange the footage, correct the subtitles and unify the loudness. 3 A total of 51 seconds of material were generated and cut into this 39-second sci-fi comedy short at a cost of
- 5 credits. gravity overdue by @YouTube