| | --- |
| | license: mit |
| | language: |
| | - en |
| | - zh |
| | base_model: |
| | - Wan-AI/Wan2.2-S2V-14B |
| | pipeline_tag: any-to-any |
| | --- |
| | |
| | # RealVideo |
| |
|
| | RealVideo is a WebSocket-based video calling system that supports text input. It leverages **GLM-4.5-AirX** and |
| | **GLM-TTS** models to generate audio responses and utilizes autoregressive diffusion to generate corresponding video frames. The |
| | system features a modular design with full functionality and a clean code structure. |
| | Visit [blog](https://z.ai/blog/realvideo) here! |
| |
|
| | ## Features |
| |
|
| | - **Text Input**: Supports text message input. |
| | - **AI Voice Response**: Integrates GLM-4.5-AirX and GLM-TTS models to generate voice responses. |
| | - **Lip Sync**: Generates real-time conversational video based on any input image and audio. |
| | - **Real-time Communication**: WebSocket-based real-time bidirectional communication. |
| |
|
| | ## Quick Start |
| |
|
| | you can check in our [GitHub](https://github.com/zai-org/RealVideo). |
| |
|
| | ## Technical Highlights |
| |
|
| | - **Model Integration**: Allows for convenient and quick voice cloning, taking text input to generate audio output. |
| | - **Modular Design**: Clear code structure, easy to maintain and extend. |
| | - **Real-time Performance**: Optimized audio processing and real-time video generation algorithms. |
| |
|
| | ## Acknowledgements |
| |
|
| | This project utilizes the following open-source libraries: |
| |
|
| | - [self forcing](https://github.com/guandeh17/Self-Forcing) |
