zhuchaowe/maxkb
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: 修复vllm模型不能正常生成问题的bug

Browse Source
This commit is contained in:
CaptainB 2024-10-18 11:54:44 +08:00 committed by 刘瑞斌
parent 12d348439c
commit cb3c064463
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
apps/setting/models_provider/impl/base_chat_open_ai.py
View File

@ -54,5 +54,5 @@ class BaseChatOpenAI(ChatOpenAI):
**kwargs, **kwargs,
).generations[0][0], ).generations[0][0],
).message ).message
self.usage_metadata = chat_result.response_metadata['token_usage'] self.usage_metadata = chat_result.response_metadata['token_usage'] if 'token_usage' in chat_result.response_metadata else chat_result.usage_metadata
return chat_result return chat_result