Translate and Lip-Sync a Video

Personalize Videos at Scale with a CSV

Replace Dialogue in a Single-Speaker Video

Prepare Your Content

Troubleshoot LipDub AI: Common Issues and Best Practices

Manage Projects, Versions, and Generated Videos

Manage Your Account, Plan, Credits, and Integrations

Create a Multi-Speaker LipDub

Getting Started with LipDub AI

Learn how LipDub AI works, choose the right project type, and prepare your files before creating a video.

Getting Started

Follow complete, step-by-step instructions for creating each type of LipDub AI project.

Create Videos

Manage existing projects, generated videos, account settings, plans, credits, and connected services.

Manage LipDub AI

Resolve common video, face, translation, audio, timing, generation, and account issues.

Troubleshooting and Best Practices

<h2 class="LexTKB__h2" dir="ltr">Choose the right project type</h2>The most important first step is selecting the correct project type.From Home, you can quickly start a Translation or Personalization project. To access all four project types, open Projects and select Create Project.<table class="LexTKB__table"><colgroup><col><col><col></colgroup><tbody><tr><th class="LexTKB__tableCell LexTKB__tableCellHeader" style="vertical-align: top; text-align: start; background-color: rgb(242, 243, 245);">Project type</th><th class="LexTKB__tableCell LexTKB__tableCellHeader" style="vertical-align: top; text-align: start; background-color: rgb(242, 243, 245);">Choose this project when</th><th class="LexTKB__tableCell LexTKB__tableCellHeader" style="vertical-align: top; text-align: start; background-color: rgb(242, 243, 245);">Main inputs</th></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Translation project</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">You want to translate a video featuring one visible face into one or more languages. LipDub generates translated speech and synchronizes it to the speaker’s lips.</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">A source video and your source and target languages</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Personalization project</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">You want to create many customized versions of a video by changing details such as a name, company, or other variable.</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">A source video and a CSV containing recipient data</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Dialogue Replacement project</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">You want to replace the dialogue in a video featuring one visible face, using uploaded audio or speech generated from written text.</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">A source video and either replacement audio or a script</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Multi-speaker project</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Multiple faces appear anywhere in the footage, or you need to control speaker training and assign separate audio to specific people. It can also share subject training data across multiple videos in the same project.</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">One or more source videos and separate audio for each speaker</td></tr></tbody></table>Dialogue Replacement projects were previously called Single-speaker projects.<blockquote class="LexTKB__quote" dir="ltr">Important: Use a Multi-speaker project whenever more than one face appears at any point in the source footage— even when only one person speaks. It is the only project type that lets you choose which face detections are included in each person’s training data and assign audio to specific speakers.</blockquote>In a Multi-speaker project, you only need to label and train the faces you intend to lip-sync.<h3 class="LexTKB__h3" dir="ltr">Translate without lip-sync</h3>When creating a Translation project, you can select Pure Dubbing to generate translated audio without changing the subject’s mouth movements. Pure Dubbing is a Translation project setting, not a separate project type.<hr><h2 class="LexTKB__h2" dir="ltr">Navigate LipDub AI</h2>The main navigation appears on the left side of the platform.<table class="LexTKB__table"><colgroup><col><col></colgroup><tbody><tr><th class="LexTKB__tableCell LexTKB__tableCellHeader" style="vertical-align: top; text-align: start; background-color: rgb(242, 243, 245);">Area</th><th class="LexTKB__tableCell LexTKB__tableCellHeader" style="vertical-align: top; text-align: start; background-color: rgb(242, 243, 245);">What you can do</th></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Home</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Quickly start a Translation or Personalization project, or open your existing projects.</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Create Translation</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Go directly to the Translation project setup.</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Create Personalization</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Go directly to the Personalization project setup.</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Projects</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Search, open, and manage existing projects, or select Create Project to access all four project types.</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Subscription</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">View and manage your subscription and available credits.</td></tr><tr><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Translation Memory</td><td class="LexTKB__tableCell" style="vertical-align: top; text-align: start;">Create, edit, and delete preferred translation entries for use when reviewing translated segments.</td></tr></tbody></table>Your current credit balance appears near the top-right corner of the platform.Open the account menu in the top-right corner to access:<ul class="LexTKB__ul"><li value="1" class="LexTKB__listItem">Account Settings</li><li value="2" class="LexTKB__listItem">Manage Subscription &amp; Billing</li><li value="3" class="LexTKB__listItem">Credit Usage History</li><li value="4" class="LexTKB__listItem">Terms of use</li><li value="5" class="LexTKB__listItem">Log out</li></ul>Detailed account, billing, and credit information is covered in Manage Your Account, Plan, Credits, and Integrations.<hr><h2 class="LexTKB__h2" dir="ltr">Understand the basic workflow</h2>The exact steps differ by project type, but most LipDub projects follow the same general process:<ol class="LexTKB__ol1"><li value="1" class="LexTKB__listItem">Create a project Choose the project type that matches your footage and intended result.</li><li value="2" class="LexTKB__listItem">Upload your source content Depending on the workflow, this may include a video, audio files, a written script, or a CSV.</li><li value="3" class="LexTKB__listItem">Process the footage LipDub analyzes the video and prepares it for the selected workflow. When training is required, LipDub uses visible footage of the subject speaking to learn their individual lip movement.</li><li value="4" class="LexTKB__listItem">Configure the new dialogue Translate the original speech, add personalization variables, upload replacement audio, or assign audio to individual speakers.</li><li value="5" class="LexTKB__listItem">Review your project Check the transcript, audio, speaker assignments, timing, and project-specific generation settings.</li><li value="6" class="LexTKB__listItem">Generate the video LipDub displays the project status while it is processing, training, or generating.</li><li value="7" class="LexTKB__listItem">Review and use the result Preview the completed video, download it, or use any sharing and export options available for that project type.</li></ol>You can often return to the same project and generate additional languages, audio versions, personalized videos, or quality variations without starting over.<hr><h2 class="LexTKB__h2" dir="ltr">Before creating your first project</h2>Keep these three rules in mind:<ul class="LexTKB__ul"><li value="1" class="LexTKB__listItem">Choose the project type based on every face that appears in the footage—not only the person who speaks.</li><li value="2" class="LexTKB__listItem">Use the cleanest and most consistent video and audio available. The inputs you provide directly affect the generated result.</li><li value="3" class="LexTKB__listItem">Only upload voices and likenesses you have permission to use and clone.</li></ul>For supported formats, recording recommendations, training-footage guidance, and upload requirements, see Prepare Videos, Audio, Transcripts, and CSV Files.<hr><h2 class="LexTKB__h2" dir="ltr">Continue with the appropriate guide</h2>Once you have selected a project type, follow its complete workflow guide:<ul class="LexTKB__ul"><li value="1" class="LexTKB__listItem">Translate and Lip-Sync a Video</li><li value="2" class="LexTKB__listItem">Personalize Videos at Scale with a CSV</li><li value="3" class="LexTKB__listItem">Replace Dialogue in a Single-Speaker Video</li><li value="4" class="LexTKB__listItem">Create a Multi-Speaker LipDub</li></ul>

Go back to application

Was this article helpful?

You recently requested to reset your password for your account. Use the button below to reset it. This password reset is only valid for the next 24 hours.

If you’re having trouble with the button above, copy and paste the URL below into your web browser.

LipDub AI Help Center

Getting Started

Create Videos

Manage LipDub AI

Troubleshooting and Best Practices

Featured Articles

Getting Started with LipDub AI