|
|
@@ -1,6 +1,9 @@
|
|
|
[](https://github.com/Akshay090/svg-banners)
|
|
|
|
|
|
## 👉🏻 CosyVoice 👈🏻
|
|
|
+
|
|
|
+**CosyVoice 3.0**: [Demos](https://funaudiollm.github.io/cosyvoice3/); [Paper](https://arxiv.org/abs/2505.17589); [CV3-Eval](https://github.com/FunAudioLLM/CV3-Eval)
|
|
|
+
|
|
|
**CosyVoice 2.0**: [Demos](https://funaudiollm.github.io/cosyvoice2/); [Paper](https://arxiv.org/abs/2412.10117); [Modelscope](https://www.modelscope.cn/studios/iic/CosyVoice2-0.5B); [HuggingFace](https://huggingface.co/spaces/FunAudioLLM/CosyVoice2-0.5B)
|
|
|
|
|
|
**CosyVoice 1.0**: [Demos](https://fun-audio-llm.github.io); [Paper](https://funaudiollm.github.io/pdf/CosyVoice_v1.pdf); [Modelscope](https://www.modelscope.cn/studios/iic/CosyVoice-300M)
|
|
|
@@ -26,6 +29,10 @@
|
|
|
|
|
|
## Roadmap
|
|
|
|
|
|
+- [x] 2025/07
|
|
|
+
|
|
|
+ - [x] release cosyvoice 3.0 eval set
|
|
|
+
|
|
|
- [x] 2025/05
|
|
|
|
|
|
- [x] add cosyvoice 2.0 vllm support
|
|
|
@@ -251,5 +258,39 @@ You can also scan the QR code to join our official Dingding chat group.
|
|
|
4. We borrowed a lot of code from [AcademiCodec](https://github.com/yangdongchao/AcademiCodec).
|
|
|
5. We borrowed a lot of code from [WeNet](https://github.com/wenet-e2e/wenet).
|
|
|
|
|
|
+## Citations
|
|
|
+
|
|
|
+``` bibtex
|
|
|
+@article{du2024cosyvoice,
|
|
|
+ title={Cosyvoice: A scalable multilingual zero-shot text-to-speech synthesizer based on supervised semantic tokens},
|
|
|
+ author={Du, Zhihao and Chen, Qian and Zhang, Shiliang and Hu, Kai and Lu, Heng and Yang, Yexin and Hu, Hangrui and Zheng, Siqi and Gu, Yue and Ma, Ziyang and others},
|
|
|
+ journal={arXiv preprint arXiv:2407.05407},
|
|
|
+ year={2024}
|
|
|
+}
|
|
|
+
|
|
|
+@article{du2024cosyvoice,
|
|
|
+ title={Cosyvoice 2: Scalable streaming speech synthesis with large language models},
|
|
|
+ author={Du, Zhihao and Wang, Yuxuan and Chen, Qian and Shi, Xian and Lv, Xiang and Zhao, Tianyu and Gao, Zhifu and Yang, Yexin and Gao, Changfeng and Wang, Hui and others},
|
|
|
+ journal={arXiv preprint arXiv:2412.10117},
|
|
|
+ year={2024}
|
|
|
+}
|
|
|
+
|
|
|
+@article{du2025cosyvoice,
|
|
|
+ title={CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training},
|
|
|
+ author={Du, Zhihao and Gao, Changfeng and Wang, Yuxuan and Yu, Fan and Zhao, Tianyu and Wang, Hao and Lv, Xiang and Wang, Hui and Shi, Xian and An, Keyu and others},
|
|
|
+ journal={arXiv preprint arXiv:2505.17589},
|
|
|
+ year={2025}
|
|
|
+}
|
|
|
+
|
|
|
+@inproceedings{lyu2025build,
|
|
|
+ title={Build LLM-Based Zero-Shot Streaming TTS System with Cosyvoice},
|
|
|
+ author={Lyu, Xiang and Wang, Yuxuan and Zhao, Tianyu and Wang, Hao and Liu, Huadai and Du, Zhihao},
|
|
|
+ booktitle={ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
|
|
|
+ pages={1--2},
|
|
|
+ year={2025},
|
|
|
+ organization={IEEE}
|
|
|
+}
|
|
|
+```
|
|
|
+
|
|
|
## Disclaimer
|
|
|
The content provided above is for academic purposes only and is intended to demonstrate technical capabilities. Some examples are sourced from the internet. If any content infringes on your rights, please contact us to request its removal.
|
lyuxiang.lx
