Skip to content
  • There are no suggestions because the search field is empty.

Translate with LipDub AI

With Single-Actor Projects, you can now translate & create audio directly on the platform

 

Automatic Translation: Easily translate the actor’s voice from one language to another.

We currently support 29 languages, and more are on the way! 🙂

Limitations of this feature

  1. Original video must have original audio - If you upload a muted video, LipDub AI cannot translate a muted video.
  2. Potential alignment issues - when the hand movement may not 100% perfectly match the new translated audio like the original
      • why? - For example, Spanish may take twice as long to say the same sentence in English. This has the potential for not perfect alignment due to the automatic translation lip-sync.

note: For optimal results to have clean audio stems (i.e. no background music/SFX) in the original language audio.

Notion Image
 

Here is the list of supported languages that LipDub AI can translate to:

  1. English
  2. Japanese
  3. Chinese
  4. German
  5. Hindi
  6. French
  7. Korean
  8. Portuguese
  9. Italian
  10. Spanish
  11. Indonesian
  12. Dutch
  13. Turkish
  14. Filipino
  15. Polish
  16. Swedish
  17. Bulgarian
  18. Romanian
  19. Arabic
  20. Czech
  21. Greek
  22. Finnish
  23. Croatian
  24. Malay
  25. Slovak
  26. Danish
  27. Tamil
  28. Ukrainian
  29. Russian

                                                      Translation Editor

                                                      If you’d like to double check and edit the translation before generating your result, you absolutley can! Simply turn the toggle on below:

                                                      Notion Image
                                                       

                                                      Once the LipDub AI finishes automatically translating into your new language, you can proof read and double check everything looks good before you move on to generate the final lip-synced video 😊

                                                      Notion Image
                                                       

                                                      Limitations of Translation Editor

                                                      1. Maximum video size is 10 minutes in length
                                                      2. Only the supported languages (29) are available
                                                      3. Unable to edit the original language transcript
                                                      4. Only available with automatic voice clone. Unable to use it if you want to use voices from the voice library.
                                                      5. Audio speed may increase for certain segments of the text if there is significantly more characters than in the original language.