🎙️ LipSync System for Ren'Py — Professional Dubbing Animation Tool

Bring your voice acting to life with realistic, frame-accurate lip animation in Ren’Py.

This professional LipSync system analyzes your WAV audio files and automatically synchronizes mouth movements to spoken dialogue — perfect for dubbing, voice-acted visual novels, or animated character scenes.  This is for professionals who want to take their storytelling to a new level of immersion.

🔍 What This System Does

This script dynamically reads your .wav voice files and calculates speech intensity in real time to produce natural mouth animation synced to the audio.

It automatically detects speech phases (closed → semi-open → open mouth) by measuring sound peaks and volume levels.

Once set up, your characters' mouths move smoothly in rhythm with the spoken voice lines — no manual timing or keyframes required.

💡 Features

✅ Automatic Lip Movement

Analyzes .wav audio and creates natural mouth opening and closing.

✅ Audio-Driven Animation

Uses real-time audio position tracking for perfect sync with Ren’Py’s voice playback.

✅ Supports Per-Character Settings

You can enable or disable lip-sync per character using persistent variables (e.g., persistent.silvie_lipsync = True).

✅ Efficient Caching System

Preloads and caches analyzed lip data for fast re-use and minimal memory load.

✅ Debug-Friendly

Includes detailed debug logs to measure memory usage and analysis performance.

✅ Fully Customizable Folder Structure

Works with sprite folders such as sprites/character/group/expression/1.png, 2.png, 3.png for each mouth stage.

✅ Professional-Level Dubbing Support

Ideal for games with recorded dialogue or cinematic storytelling.

🧠 How It Works (Simplified)

1. The system loads your .wav voice file.

2. It analyzes the audio in 10ms chunks and measures the loudness (decibels).

3. Based on the volume, it assigns a mouth stage:

 - Stage 1 → Closed

 - Stage 2 → Semi-open

 - Stage 3 → Fully open

 4. Ren’Py automatically updates the character’s sprite every frame while the voice plays.

 - The result: lip movement that follows the rhythm and dynamics of real speech.

The setup cannot be easier:

📦 Included Files

- lipsync_module.rpy — the complete, documented source code

- your chosen license agreement

- Ready-to-integrate template for your Ren’Py project

🧰 Compatibility

Ren’Py 8.4+

.wav voice files (16-bit PCM, 44,1Khz)

Works on Windows, Mac, Linux, and Android builds

💬 Support

For technical questions, integration help, or license inquiries, please contact:

📧 jaybessecretservice@protonmail.com