Learning Timeline
Key Insights
Effects of Using LoRA
Using 'Cosvid LoRA' helps speed up the generation time, but it may cause colors to become slightly saturated and result in a minor loss of quality.
Current Global Model Limitations
The Ditto Global model currently transforms the entire scene rather than specific parts. Local editing (such as changing only clothes) is not yet supported and will be updated in future models on GitHub.
Hardware Requirements
This process can be run on a laptop with a GPU featuring at least 16GB VRAM, with an estimated wait time of around 6 minutes.
Prompts
Visual Style Transformation Prompt
Target:
Ditto
turn into 3D Pixar style
Sim2Real Transformation Prompt
Target:
Ditto Sim2Real
turn it into the real domain
Step by Step
How to Transform Videos into 3D Pixar Style
- Upload the original video you want to modify to the Ditto platform.
- Go to the text/prompt input section.
- Type specific instructions for the visual style (Example: 'turn into 3D Pixar style').
- Ensure the selected model is the 'Global Style' model.
- Click the 'Run' button to start the AI generation process.
- Wait for the process to complete (estimated 6 minutes on a GPU with 16GB VRAM).
How to Convert Anime to Realistic (Sim2Real)
- Upload an animated video (such as a Studio Ghibli style clip) to the upload section.
- Open the 'Model Selection' drop-down menu.
- Select the 'Ditto Sim to Real' model.
- Enter a prompt to guide the AI in transforming the visual domain (Example: 'turn it into the real domain').
- Click the 'Run' button to generate a live-action video based on the animation.
