FAQs

 

❓Q1 — Does the original audio in the source video matter?

• The "Translate with AI" feature requires the original language audio in your source video that you upload. Check out our video guide for ⁠Single-Actor Projects to learn how to use this automatic translation feature.

• LipDub has an experimental feature called ⁠Maintain Expression Feature ✨ that uses the original audio to train an AI model based on the audio viseme/phonemes.

• If you are trying to lip-sync an AI avatar that doesn't have any source audio, then simply uploading a video without any audio is also fine

• LipDub is language agnostic. You can upload any language and LipDub will lip-sync the actor to it.

• LipDub is HIGHLY sensitive. If you upload a dub audio with background music or SFX, we will lipsync the actor to instruments or SFX if the actor is on screen. This is why we recommend voice-isolated dialogue stems for the dub audio.

• Audio for Training data does not matter! Training data videos will just used to for training the AI model from a visual standpoint. it will not use the audio in the "Additional Footage for Training" section in the ⁠Multi-Actor Guide

❓Q2 — Does Lipdub support variable frame rate?

❓Q3 — Does Lipdub have an API?

❓Q4 — How long does it take to upload/process, train and generate?

❓Q5 — What influences the upload & processing time?

❓Q6 — Do you have a free trial?

❓Q7 — How do I request a credit refund if something went wrong?

❓Q8 — How do I stop my training job?

❓Q9 — How do I know when training is finished?

❓Q10 — What do I do If I run into an error at any point during my workflow using Lipdub Platform?

❓Q11 — What happens if a video is longer than my dub audio file? What happens if its shorter?

Here's a few scenarios to be aware of:

• • Uploaded Audio is shorter than video: Output video is cut to match with the shorter audio.

• • Uploaded Audio is longer than video: The output video stops at the end of the original video. LipDub does not extend past the length of the original video. So longer audio will result in the audio being cut short.

• • Uploaded Audio is shorter than video: If the actor is on screen and their audio is silent, then LipDub assumes the actor should have a closed mouth shape for the rest of the video. If the actor is not on screen, then LipDub cannot lip-sync them, since they are not in frame.

• • Uploaded Audio is longer than video: The output video stops at the end of the original video. LipDub does not extend past the length of the original video. So longer audio will result in the audio being cut short.

❓Q12 — What is a LipDub scene?

Check out the article below:

❓Q13 — Supported video formats?

Check out the article below:

❓Q14 — Supported audio formats?

Check out the article below:

❓Q15 — How do I capture additional training footage?

Check out the article below:

❓Q16 — How many languages does LipDub support?

Depends on how you get your audio that you want to lip-sync to. (see below)

Upload your own audio:

• • Any sound/language in the world. LipDub is language agnostic. So LipDub will lip-sync to all known languages, Dothraki (Game of Thrones), Klingon (StarTrek), Birds chirping, ANYTHING. 

• • Currently there are 29 languages that are supported for automatic translation and lip-sync.

1. English
2. Japanese
3. Chinese
4. German
5. Hindi
6. French
7. Korean
8. Portuguese
9. Italian
10. Spanish
11. Indonesian
12. Dutch
13. Turkish
14. Filipino
15. Polish
16. Swedish
17. Bulgarian
18. Romanian
19. Arabic
20. Czech
21. Greek
22. Finnish
23. Croatian
24. Malay
25. Slovak
26. Danish
27. Tamil
28. Ukrainian
29. Russian

❓Q17 — Do you support multiple dialects per language?

We currently offer these 29 languages for automatic translation directly in the app.

• • You want to automatically translate from American English to a different English accent (e.g. British, or Scottish, or Mexican English accent)
    • Accent control is something we are working towards! Not yet available.
  • You want to automatically translate from Mandarin to Shanghainese
    • Adding more dialects per language is something we are working towards!
    • Currently Mandarin is offered, but not Shanghainese. Please see the list of supported languages above, we will update them with more dialects as soon as we can support them!

❓Q18 — Does LipDub work on animated characters or non-human characters?

LipDub recognizes human looking faces. So if the animated character does not resemble a human face then LipDub may not detect a face, and therefore may not generate a lip-synced output.

❓Q19 — Can I buy credits and not be on a monthly subscription?

In order to access credits you can use our 14 day free trial. It comes when you first sign up to the platform and sign up for the “Light” plan. If you just signed into your account for the first time you can sign up for the free trial by clicking on “Upgrade plan” button at the top right screen. If you don’t sign up for a monthly plan, then you will not be able to get purchase one time top up credits.

Absolutely! One time top up credits is only purchasable so long as you are on a monthly subscription tier (any subscription plan works!). 😊 Once you are on a monthly subscription you can purchase one time top up credits by clicking on the + icon next to your credit amount at the top right of your screen. Note: If you are not the owner of your organization’s account then you cannot purchase top up credits. Please contact your owner of your organization’s account so they can purchase the top up credits. If you don’t sign up for a monthly plan, then you will not be able to get purchase one time top up credits. Note: One time purchase of top up credits have a 20% premium compared to simply upgrading to the next monthly subscription tier. So instead of 1 credit costing $1, 1 top-up credit will cost $1.2

❓Q21 — What happens if I run out of credits before my subscription renews?

If you run out of credits before your subscription renews then you have the two options. You can purchase one time top up credits by clicking the + icon next to your credit amount at the top right of your screen. You can also upgrade to a higher tier subscription to get access to more credits as well. To upgrade your plan, please click on “Upgrade plan” at the top right of your screen. 😊

❓Q22 — How do I buy credits?

You can buy credits buy signing up for a monthly subscription. If this is your first time in the platform you can use our 14 day free trial! It comes when you first sign up to the platform and sign up for the “Light” plan. If you just signed into your account for the first time you can sign up for the free trial by clicking on “Upgrade plan” button at the top right screen and under the “Light” plan, you will be able to start your 14 days free trial. (See my screenshot below) As you start working with LipDub, its important you watch our best practices 3min video. You can watch it using this link - https://vimeo.com/1064416253/e2682b9d4a?share=copy

❓Q23 — I've uploaded the wrong assets. Can I cancel the job?

Unfortunately not at this time. You cannot manually cancel a job after its been kicked off. If you want to request this feature, please add it to our suggest feedback board in our Discord Server and we’ll prioritize it! If its urgent and you want to cancel the job, you can reach out to support@lipdub.ai and we’ll see if we can cancel it from our backend for you!

❓Q24 — How do I cancel my monthly subscription plan? I don’t want to renew, how do I cancel my plan?

You can cancel your subscription by going to subscription tab at the top left of your screen. Here you can select “Manage Billing” button. From this page you can proceed to cancel your subscription. We’re sad to see you go! There are common mistakes users make on the LipDub platform that may result into poor video outputs. If you want to make sure you are generating the best possible results, be sure to watch this video https://vimeo.com/1064416253/e2682b9d4a?share=copy and reach out to support@lipdub.ai. The support team will gladly hop on a quick 5-10min call to explain how to get the best possible results tailored to your specific videos.

❓Q25 — Is it possible to try before I subscribe? Can I try the platform without a plan?

Absolutely! You can try the LipDub platform before you subscribe, yes. If this is your first time logging in, then you can try our 14 day free trial. You can access this free trial by clicking on “Upgrade plan” button at the top right screen and under the Light plan, you will be able to start your 14 days free trial. As you start working with LipDub, its important you watch our best practices 3min video. You can watch it using this link - https://vimeo.com/1064416253/e2682b9d4a?share=copy

Absolutely! You can try the LipDub platform before you subscribe, yes. If this is your first time logging in, then you can try our 14 day free trial. You can access this free trial by clicking on “Upgrade plan” button at the top right screen and under the Light plan, you will be able to start your 14 days free trial.

❓Q27 — How much does it cost me to train a video?

Cost of training depends on what subscription plan you purchased. Here’s a link to our subscription pricing page if you want to take a look. https://www.lipdub.ai/pricing-page

❓Q28 — How much is 1 credit worth in US dollars?

If you sign up for a monthly subscription, 1 credit is worth $1 dollar. If you purchase top up credits, then 1 credit is worth $1.2 dollars. This is because the one time purchase of top up credits have a 20% premium on them, compared to your monthly subscription credits.

❓Q29 — What are the different subscriptions currently available now?

LipDub offers a few different subscription plans. You can find more information on our pricing page - https://www.lipdub.ai/pricing-page. You can also view our available plans in the subscription tab in the top left screen when you are in the application.

❓Q30 — Does LipDub export SRT files? Does LipDub export subtitle files?

LipDub does not have the ability to export subtitle (SRT) files yet. If this is a feature that you find valuable please add it to our suggest feedback channel in our discord server! Or shoot us a friendly email at support@lipdub.ai here’s the link to our discord server - https://discord.com/invite/RRK5AySHjA

❓Q31 — How do I create an SRT from Lipdub’s translated result?

LipDub does not have the ability to export subtitle (SRT) files yet. If this is a feature that you find valuable please add it to our suggest-feedback channel in our Discord server! Or shoot us a friendly email at support@lipdub.ai here’s the link to our discord server - https://discord.com/invite/RRK5AySHjA

❓Q32 — The actor thumbnail is not available

If the video thumbnails are not appearing, then please try logging out and back in. This is a known issue! We’re working on a fix for this ASAP! If you are still experiencing this, then please try logging out and refreshing your browsers cache, and then logging back in to LipDub application.

❓Q33 — An error occurred while generating the LipDubbed video.

If you encounter an error, please reach out to support@lipdub.ai or send a message in our dedicated Customer support Discord channel and the support team will gladly help find a solution! here’s the link to our discord server - https://discord.com/invite/RRK5AySHjA

❓Q34 — What the maximum output resolution, as it looks blocky

The maximum output resolution is the same as the maximum input resolution. Which currently is 4K (UHD) 3840 x 2160. Here’s a link to our support video specifications - https://support.lipdub.ai/faq-and-tips/3Eafvf7YpakyfGQsx8hZqj/supported-video-formats-and-file-specifications/hSPKFXdCMdJggHFdRKjNSa

❓Q35 — Where are the settings of my account

User settings page is not yet in the application Common SaaS features such as reset password and webhooks for API, is in our product roadmap. These features and the Account settings page are coming soon.

❓Q36 — How do I create an account for my colleague?

Common SaaS features such as user management, and creating accounts for other users of your organization is in the product development roadmap. These features and the Account settings page are coming soon.

❓Q37 — How do I contact the Sales?

You can contact sales by emailing —> sales@lipdub.ai

❓Q38 — When was LipDub founded?

LipDub AI was founded in 2023. Focused on providing the highest-quality AI lip sync for video translation, dialogue replacement, and personalization across all live-action, animated, or AI-generated content. LipDub AI is based out of Toronto, Ontario

❓Q39 — Where is the LipDub Demo?

Here’s a quick 4min onboarding video to get you started on the LipDub platform -https://vimeo.com/1064416253/e2682b9d4a?share=copy