 禾息
|
62e04e8856
Enhance CosyVoice with CUDA stream management and estimator handling
|
1 år sedan |
 雾聪
|
96950745a6
Revert "mv AsyncLLMEngine init to CosyVoice2"
|
1 år sedan |
|
雾聪
|
9b3f351496
mv AsyncLLMEngine init to CosyVoice2
|
1 år sedan |
 Yabin Li
|
00b454cf30
Merge pull request #1053 from qi-hua/dev/use_vllm
|
1 år sedan |
 qihua
|
c0f6a474f3
fix(async_cosyvoice): 恢复原本文本令牌处理逻辑
|
1 år sedan |
|
qihua
|
ab5b8eb160
refactor(llm): 重构 vLLM 推理任务处理方式，支持多任务处理
|
1 år sedan |
|
qihua
|
b4fe05d466
docs: 添加speed_test.ipynb文件
|
1 år sedan |
|
qihua
|
a1314e573a
chore: 新增 requirements_vllm.txt 文件，指定VLLM 模型所需的依赖
|
1 år sedan |
|
qihua
|
2fbeba50ae
refactor(llm): 移除未使用的异步推理方法
|
1 år sedan |
|
qihua
|
d4d187bd8c
refactor(llm): 重构 VLLM 推理方式
|
1 år sedan |
|
qihua
|
90b666ea20
初步合并vllm支持，异步推理的通道处理还存在bug
|
1 år sedan |
 Xiang Lyu
|
fd45708e4b
Merge pull request #977 from hanasay/main
|
1 år sedan |
 hanasay
|
296ed4f526
Convert audio to mono while extract speech token
|
1 år sedan |
|
Xiang Lyu
|
95e99e0417
Merge pull request #940 from c4fun/fastapi-cosyvoice2
|
1 år sedan |
 c4fun
|
ba6d8c07ba
revert the main function to original and only preserve the inference endpoint
|
1 år sedan |
|
Xiang Lyu
|
da3f129977
Merge pull request #936 from huyyxy/main
|
1 år sedan |
|
c4fun
|
2889c25863
supports and defaultly supports cosyvoice2 in fastapi server
|
1 år sedan |
 huyyxy
|
aa65200713
feat(docker): update CUDA base image to 12.4.1 for TensorRT support
|
1 år sedan |
|
Xiang Lyu
|
86e26f54c7
Merge pull request #930 from sd0ric4/main
|
1 år sedan |
 sd0ric4
|
f1c214377c
fix: add POST endpoints to resolve browser error about GET request with body
|
1 år sedan |
|
Xiang Lyu
|
369ea80bd4
Merge pull request #926 from Vinkle-hzt/main
|
1 år sedan |
 huzetao.hzt
|
69518b2bde
fix bistream extra token
|
1 år sedan |
|
Xiang Lyu
|
276cfa02b6
Merge pull request #925 from FunAudioLLM/dev/lyuxiang.lx
|
1 år sedan |
|
lyuxiang.lx
|
190840b8dc
fix pitch computation
|
1 år sedan |
|
lyuxiang.lx
|
c6c3f27ecc
fix typo
|
1 år sedan |
|
Xiang Lyu
|
49761d2474
Merge pull request #924 from FunAudioLLM/dev/lyuxiang.lx
|
1 år sedan |
|
lyuxiang.lx
|
07e477519b
add llm bistream
|
1 år sedan |
|
Xiang Lyu
|
41c5e8cd6d
Merge pull request #887 from Wauplin/patch-1
|
1 år sedan |
 Lucain
|
66ceaff472
Fix diffusers / huggingface_hub compatibility in requirements.txt
|
1 år sedan |
|
Xiang Lyu
|
07a314767f
Merge pull request #884 from FunAudioLLM/dev/lyuxiang.lx
|
1 år sedan |
