|
|
@@ -1,35 +1,29 @@
|
|
|
[](https://github.com/Akshay090/svg-banners)
|
|
|
|
|
|
## 👉🏻 CosyVoice 👈🏻
|
|
|
-**🔥CosyVoice 2.0**: [Demos](https://funaudiollm.github.io/cosyvoice2/); [Paper](https://fun-audio-llm.github.io/pdf/CosyVoice_v1.pdf); [Modelscope](https://www.modelscope.cn/studios/iic/CosyVoice2-0.5B)
|
|
|
+**CosyVoice 2.0**: [Demos](https://funaudiollm.github.io/cosyvoice2/); [Paper](https://fun-audio-llm.github.io/pdf/CosyVoice_v1.pdf); [Modelscope](https://www.modelscope.cn/studios/iic/CosyVoice2-0.5B)
|
|
|
|
|
|
**CosyVoice 1.0**: [Demos](https://fun-audio-llm.github.io); [Paper](https://fun-audio-llm.github.io/pdf/CosyVoice_v1.pdf); [Modelscope](https://www.modelscope.cn/studios/iic/CosyVoice-300M)
|
|
|
|
|
|
-## Highlight
|
|
|
+## Highlight🔥
|
|
|
|
|
|
**CosyVoice 2.0** has been released! Compared to version 1.0, the new version offers more accurate, more stable, faster, and better speech generation capabilities.
|
|
|
-
|
|
|
### Multilingual
|
|
|
- **Support Language**: Chinese, English, Japanese, Korean, Chinese dialects (Cantonese, Sichuanese, Shanghainese, Tianjinese, Wuhanese, etc.)
|
|
|
- **Crosslingual & Mixlingual**:Support zero-shot voice cloning for cross-lingual and code-switching scenarios.
|
|
|
-
|
|
|
### Ultra-Low Latency
|
|
|
- **Bidirectional Streaming Support**: CosyVoice 2.0 integrates offline and streaming modeling technologies.
|
|
|
- **Rapid First Packet Synthesis**: Achieves latency as low as 150ms while maintaining high-quality audio output.
|
|
|
-
|
|
|
### High Accuracy
|
|
|
- **Improved Pronunciation**: Reduces pronunciation errors by 30% to 50% compared to CosyVoice 1.0.
|
|
|
- **Benchmark Achievements**: Attains the lowest character error rate on the hard test set of the Seed-TTS evaluation set.
|
|
|
-
|
|
|
### Strong Stability
|
|
|
- **Consistency in Timbre**: Ensures reliable voice consistency for zero-shot and cross-language speech synthesis.
|
|
|
- **Cross-language Synthesis**: Marked improvements compared to version 1.0.
|
|
|
-
|
|
|
### Natural Experience
|
|
|
- **Enhanced Prosody and Sound Quality**: Improved alignment of synthesized audio, raising MOS evaluation scores from 5.4 to 5.53.
|
|
|
- **Emotional and Dialectal Flexibility**: Now supports more granular emotional controls and accent adjustments.
|
|
|
|
|
|
-
|
|
|
## Roadmap
|
|
|
|
|
|
- [x] 2024/12
|