zhuchaowe/maxkb
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: 修复【知识库】高级分段 自动清洗，把所有换行被去除 (#684)

Browse Source
This commit is contained in:
shaohuzhang1 2024-07-02 11:32:20 +08:00 committed by GitHub
parent 6c67b65e6a
commit 00f2a8bbd4
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
apps/common/util/split_model.py
View File

@ -257,7 +257,7 @@ def post_handler_paragraph(content: str, limit: int, with_filter: bool):
replace_map = { replace_map = {
re.compile('\n+'): '\n', re.compile('\n+'): '\n',
re.compile('\\s+'): ' ', re.compile(' +'): ' ',
re.compile('#+'): "", re.compile('#+'): "",
re.compile("\t+"): '' re.compile("\t+"): ''
} }