zhuchaowe/maxkb
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: Fix xinference cannot add deepseek-vl-chat model

Browse Source 
--bug=1052077 --user=刘瑞斌 【github#2051】【模型管理】xinference添加issue中提供的视觉模型失败 https://www.tapd.cn/57709429/s/1652171
This commit is contained in:
CaptainB 2025-02-10 10:58:13 +08:00 committed by 刘瑞斌
parent 8530237e3c
commit a325b26704
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
apps/setting/models_provider/impl/base_chat_open_ai.py
View File

@ -104,7 +104,7 @@ class BaseChatOpenAI(ChatOpenAI):
if generation_chunk.message.usage_metadata is not None: if generation_chunk.message.usage_metadata is not None:
self.usage_metadata = generation_chunk.message.usage_metadata self.usage_metadata = generation_chunk.message.usage_metadata
# custom code # custom code
if 'reasoning_content' in chunk['choices'][0]['delta']: if len(chunk['choices']) > 0 and 'reasoning_content' in chunk['choices'][0]['delta']:
generation_chunk.message.additional_kwargs["reasoning_content"] = chunk['choices'][0]['delta'][ generation_chunk.message.additional_kwargs["reasoning_content"] = chunk['choices'][0]['delta'][
'reasoning_content'] 'reasoning_content']