D-ID, an AI video creation platform known for its viral success in animating photos, has introduced a groundbreaking tool that translates videos into other languages while cloning the speaker’s voice and adjusting their lip movements to match the translated words. This innovative technology builds on D-ID’s earlier work, which gained widespread attention a few years ago for animating and giving voice to old family photos.
The company’s latest offering, AI Video Translate, is now available to D-ID subscribers at no additional cost. This tool allows creators to automatically translate their videos into 30 languages, including Arabic, Mandarin, Japanese, Hindi, Spanish, and French. The service is part of D-ID’s subscription plans, which start at $56 per year for the basic plan with minimal AI feature credits, and can go up to $1,293 per year before transitioning to enterprise-level pricing.
D-ID’s AI Video Translate technology is designed to help creators and enterprises expand their global reach by making it more affordable to localize content across different languages. This is especially valuable in industries like marketing, entertainment, and social media, where reaching a diverse audience is critical. By offering an AI-driven alternative to traditional dubbing, D-ID aims to provide a more accessible and cost-effective solution for video localization.
The introduction of AI Video Translate comes at a time when AI technologies for dubbing, voice cloning, and translation are becoming increasingly mainstream. Companies like Microsoft and Vimeo have also entered the space, offering tools to translate and dub videos in real-time or replicate the speaker’s voice using AI. YouTube, for example, recently rolled out a multi-language audio feature to help creators translate their videos into additional languages, with popular creator MrBeast among the early adopters.
D-ID’s new technology will compete with a growing number of solutions in the AI video space, including those from Descript, ElevenLabs, Speechify, Veed, Camb.ai, and others. Additionally, tools like Wav2lip have made it easier for startups to develop AI-powered dubbing and lip-syncing technologies, further expanding the market for such solutions.
The AI Video Translation tool is available through D-ID Studio and its API, with a one-month trial and further demos accessible on the company’s website. As AI continues to advance, D-ID’s latest offering is poised to revolutionize how creators and businesses approach video localization, making it more efficient and accessible to a global audience.
read more: ElevenLabs Expands AI-Powered Reader App Globally with Support for 32 Languages
