auto synced translated dubs

We have hosted the application auto synced translated dubs in order to run this application in our online workstations with Wine or directly.

Quick description about auto synced translated dubs:

Auto-Synced-Translated-Dubs is a toolchain that automatically translates and re-dubs videos using AI voices while keeping the new speech aligned to the original timing via subtitle files. It assumes you have a human-made SRT (or similar) subtitle file; the script then uses translation services such as Google Cloud or DeepL to generate translated subtitle tracks in one or more target languages. Using the timestamps of each subtitle line, it computes the required duration of each spoken segment and synthesizes audio via neural TTS services, producing one audio clip per subtitle entry. The tool then time-stretches or compresses each TTS clip to match the original speech duration exactly, which preserves lip-sync and rhythm as closely as possible without manual editing. Finally, it combines all the clips into a single dubbed audio track that can be muxed with the original video, along with new translated subtitle files.

Features:

• Automatic translation of subtitle files into multiple target languages using services like Google Cloud and DeepL
• AI voice dubbing that generates one audio clip per subtitle line with realistic neural TTS voices
• Precise timing control by stretching or shrinking each clip to match original subtitle durations for better sync
• End-to-end pipeline that outputs a complete dubbed audio track plus translated subtitle files
• Configurable behavior via config.ini and modular scripts for translation-only or full dubbing workflows
• Cross-platform Python project with setup guides for Google Cloud, Azure TTS, and other external services

Programming Language: Python.
Categories: