qihua a1314e573a chore: 新增 requirements_vllm.txt 文件,指定VLLM 模型所需的依赖 1 year ago
..
llm.py 69518b2bde fix bistream extra token 1 year ago
llm_vllm.py a1314e573a chore: 新增 requirements_vllm.txt 文件,指定VLLM 模型所需的依赖 1 year ago
vllm_use_cosyvoice2_model.py 90b666ea20 初步合并vllm支持,异步推理的通道处理还存在bug 1 year ago