Skip to content
  • There are no suggestions because the search field is empty.

Translate with LipDub AI

With Single-Actor Projects, you can now translate & create audio directly on the platform

 

Automatic Translation: Easily translate the actor’s voice from one language to another.

We currently support 74 languages, and more are on the way! 🙂

Limitations of this feature

  1. Original video must have original audio - If you upload a muted video, LipDub AI cannot translate a muted video.
  2. Potential alignment issues - The hand movement may not 100% perfectly match the new translated audio like the original.
      • Why? - For example, Spanish may take twice as long to say the same sentence in English. This has the potential for not perfect alignment due to the automatic translation lip-sync.

note: For optimal results to have clean audio stems (i.e. no background music/SFX) in the original language audio.

Notion Image
 

Here is the list of supported languages that LipDub AI can translate to:

  1. Afrikaans
  2. Arabic
  3. Armenian
  4. Assamese
  5. Azerbaijani
  6. Belarusian
  7. Bengali
  8. Bosnian
  9. Bulgarian
  10. Catalan
  11. Cebuano
  12. Chichewa
  13. Chinese
  14. Croatian
  15. Czech
  16. Danish
  17. Dutch
  18. English
  19. Estonian
  20. Filipino
  21. Finnish
  22. French
  23. Galician
  24. Georgian
  25. German
  26. Greek
  27. Gujarati
  28. Hausa
  29. Hebrew
  30. Hindi
  31. Hungarian
  32. Icelandic
  33. Indonesian
  34. Irish
  35. Italian
  36. Japanese
  37. Javanese
  38. Kannada
  39. Kazakh
  40. Kirghiz (Kyrgyz)
  41. Korean
  42. Latvian
  43. Lingala
  44. Lithuanian
  45. Luxembourgish
  46. Macedonian
  47. Malay
  48. Malayalam
  49. Marathi
  50. Nepali
  51. Norwegian
  52. Pashto
  53. Persian (Farsi)
  54. Polish
  55. Portuguese
  56. Punjabi
  57. Romanian
  58. Russian
  59. Serbian
  60. Sindhi
  61. Slovak
  62. Slovenian
  63. Somali
  64. Spanish
  65. Swahili
  66. Swedish
  67. Tamil
  68. Telugu
  69. Thai
  70. Turkish
  71. Ukrainian
  72. Urdu
  73. Vietnamese
  74. Welsh

                                                      Translation Editor

                                                      If you’d like to double check and edit the translation before generating your result, you absolutley can! Simply turn the toggle on below:

                                                      Notion Image
                                                       

                                                      Once the LipDub AI finishes automatically translating into your new language, you can proof read and double check everything looks good before you move on to generate the final lip-synced video 😊

                                                      Notion Image
                                                       

                                                      Limitations of Translation Editor

                                                      1. Maximum video size is 10 minutes in length.
                                                      2. Only the supported languages (74) are available.
                                                      3. Unable to edit the original language transcript.
                                                      4. Only available with automatic voice clone. Unable to use it if you want to use voices from the voice library.
                                                      5. Audio speed may increase for certain segments of the text if there is significantly more characters than in the original language.