Commit Graph

224 Commits

Author SHA1 Message Date
朱潮
2fa779e61e disable for autoload 2026-04-18 23:08:28 +08:00
朱潮
90229ffeaf 优化skill覆盖逻辑 2026-04-17 11:43:20 +08:00
朱潮
9d47324a76 add rag_retrieve-only 2026-04-16 20:09:02 +08:00
朱潮
e1bf685314 add rag_retrieve autoload 2026-04-16 19:38:13 +08:00
朱潮
8c49997ed6 dataset to datsets 2026-04-15 11:09:55 +08:00
朱潮
2964326cb8 update to deepagents 0.5.2 2026-04-11 16:23:59 +08:00
朱潮
ed34ff9ee9 Merge branch 'prod' into developing 2026-04-11 16:08:16 +08:00
朱潮
a9044c6d2e TOOL_OUTPUT_MAX_LENGTH 扩展 2026-04-11 13:31:45 +08:00
autobee-sparticle
213e541697
fix: resolve PrePrompt Hook env var crash and increase Mem0 pool size (#24)
1. Fix "all environment values must be bytes or str" error in hook execution
   by ensuring all env values are converted to str (getattr may return None
   when attribute exists but is None). Also sanitize shell_env values.

2. Increase MEM0_POOL_SIZE default from 20 to 50 to address "connection pool
   exhausted" errors under high concurrency.

Fixes: sparticleinc/felo-mygpt#2519

Co-authored-by: zhuchao <zhuchaowe@163.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-01 22:04:31 +09:00
朱潮
dc2e8a39e3 Merge branch 'feature/moshui20260330-schedule-job' into dev 2026-03-31 20:04:49 +08:00
朱潮
2b749e988f merge from feature/moshui20260330-schedule-job 2026-03-31 09:46:17 +08:00
朱潮
3b9c7165a9 feat: 添加定时任务调度系统(schedule-job)
- 新增 schedule-job skill,支持 cron 周期任务和一次性定时任务
- 新增 schedule_manager.py CLI 工具(list/add/edit/delete/toggle/logs)
- 新增 ScheduleExecutor 全局异步调度器,每 60s 扫描到期任务并调用 agent 执行
- 任务数据存储在 projects/robot/{bot_id}/users/{user_id}/tasks.yaml
- 执行结果写入 task_logs/execution.log
- 集成到 FastAPI lifespan 生命周期管理
- 添加 croniter、pyyaml 依赖

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 23:17:47 +08:00
朱潮
7214adcf8e Merge branch 'dev' of https://github.com/sparticleinc/catalog-agent into dev 2026-03-30 21:02:05 +08:00
autobee-sparticle
18bf296aa0
feat: move enable_thinking control from docker-compose to request body (#21)
* add page number

* feat: add skill feature memory

添加 skill 功能的 feature memory,记录技能包管理服务和 Hook 系统的核心信息。

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* feat(skill): add feature memory with changelog and decisions

添加 skill 功能的完整记忆文档:

Changelog:
- 2025-Q4: 初始实现 (GRPC 层 + 内置 skills)
- 2026-Q1: API 完善 (REST API + Hook 系统)

Design Decisions:
- 001: Skill 架构设计 (目录结构、Hook 系统)
- 002: 上传安全措施 (ZipSlip、路径遍历防护)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* soffice sharp 支持

* shell_env support

* feat: move enable_thinking control from docker-compose to request body

Remove DEFAULT_THINKING_ENABLE environment variable from docker-compose
and settings.py. The enable_thinking flag is now solely controlled via
request body (default: false), as felo-mygpt already passes this config
from RobotConfig database.

Closes sparticleinc/felo-mygpt#2473

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: 朱潮 <zhuchaowe@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: zhuchao <zhuchaowe@163.com>
2026-03-26 20:12:39 +09:00
朱潮
79206aafea Merge branch 'developing' into bot_manager 2026-03-26 15:55:35 +08:00
朱潮
89b7bb9928 fix: 解压 skill 到 robot 目录时清理不在列表中的多余 skill 文件夹
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-26 15:55:06 +08:00
朱潮
6ecb0d70e3 Merge branch 'developing' into bot_manager 2026-03-26 15:47:42 +08:00
朱潮
6b9ae7f86a fix: skill 删除时同步清理 robot 目录,解压时跳过已存在的 skill
1. remove_skill 删除 uploads 下的 skill 后,同步删除 projects/robot/{bot_id}/skills/ 下的副本
2. _extract_skills_to_robot 不再每次全量清空重建,已存在的 skill 直接跳过

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-26 15:47:28 +08:00
朱潮
9e9cb9ba77 添加百度搜索 2026-03-23 21:31:20 +08:00
朱潮
30dc697071 realtime接口支持16khz输出 2026-03-23 10:37:17 +08:00
朱潮
f9e9c3c26d 默认音色 2026-03-21 23:56:58 +08:00
朱潮
99273a91d3 支持语音合成和语音识别api 2026-03-21 23:50:51 +08:00
朱潮
4fbc7e8667 已经实现基本对话 2026-03-21 01:00:02 +08:00
朱潮
36f2a5b87a 支持master key 2026-03-17 11:18:15 +08:00
朱潮
a05da928f0 update shell_env 2026-03-17 10:09:48 +08:00
朱潮
8e52b787f8 merge 2026-03-16 22:24:44 +08:00
朱潮
c27270588f 增加取消推理 2026-03-16 22:22:39 +08:00
朱潮
da1352550f 实现shell_env支持 2026-03-16 13:56:24 +08:00
朱潮
5d10ed275e Merge branch 'master' into bot_manager 2026-03-16 13:40:50 +08:00
朱潮
5a7aa06681 v2 实现shell_env支持 2026-03-16 13:39:58 +08:00
朱潮
dd6dfb7116 Merge branch 'master' into bot_manager 2026-03-16 13:32:36 +08:00
朱潮
32fd8c8656 shell_env支持 2026-03-16 13:31:59 +08:00
朱潮
97ff629d86 默认不是单agent 2026-03-15 15:43:19 +08:00
朱潮
f7e8680472 merge from master 2026-03-14 22:03:23 +08:00
朱潮
9f669e1b6d dataset支持dataset_id软连接 2026-03-12 19:54:09 +08:00
朱潮
49034bc571 add webdav support 2026-03-09 12:31:07 +08:00
朱潮
26905ad623 新增memory管理 2026-03-04 13:43:49 +08:00
朱潮
5b29e866f2 现在 v1 和 v2 接口都支持传递额外参数了 2026-03-02 20:01:43 +08:00
朱潮
9c258664f2 Merge branch 'master' into bot_manager 2026-02-28 23:28:56 +08:00
朱潮
8d29a263e1 修复 robot 目录被意外清空的问题
移除 create_robot_project 的重建逻辑,避免在发送消息时删除 dataset 文件夹内容

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-02-28 23:28:37 +08:00
朱潮
6365d65715 user_identifier 2026-02-27 00:21:06 +08:00
朱潮
c9c9a71452 subaccount 2026-02-26 23:56:45 +08:00
朱潮
912d5ebbed 个人中心 2026-02-26 18:11:22 +08:00
朱潮
c751c7997e sigle agent mode 2026-02-26 08:58:32 +08:00
朱潮
2e928cbc9c feat: 添加单智能体模式 (Single Agent Mode)
为特定用户群体提供简化的智能体访问体验:
- 后端通过环境变量配置模板智能体
- 登录时自动为用户复制模板 bot
- 前端根据配置显示简化的侧边栏入口

后端变更:
- 添加 single_agent_bot_id 字段到 agent_user 表
- settings.py 添加单智能体模式配置
- 登录接口返回 single_agent 配置

环境变量:
- SINGLE_AGENT_MODE: 是否启用单智能体模式
- TEMPLATE_BOT_ID: 模板智能体 ID
- TEMPLATE_BOT_NAME: 模板智能体名称

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2026-02-26 08:05:18 +08:00
朱潮
98f23fa346 update payment 2026-02-26 00:35:42 +08:00
朱潮
d7dfd8810e update payment 2026-02-25 23:42:44 +08:00
朱潮
4a8fffaf7d 删除id 2026-02-11 22:43:15 +08:00
朱潮
1d22bcaf3a RAGFLOW_ALLOWED_EXTENSIONS 2026-02-11 00:05:49 +08:00
朱潮
d759ed2218 update env 2026-02-10 21:46:10 +08:00
朱潮
5f6e806b18 rag_flow 2026-02-10 21:41:16 +08:00
朱潮
bd39a53507 add rag flow 2026-02-10 18:59:10 +08:00
朱潮
742eaf0a1c remove robot_type 2026-02-08 00:04:39 +08:00
朱潮
1df52ca8d0 merge from prod 2026-02-06 22:07:47 +08:00
朱潮
e67d50b4fc rename general agent 2026-02-06 17:05:17 +08:00
朱潮
7e058e1505 Merge branch 'prod' into bot_manager 2026-02-04 17:54:42 +08:00
朱潮
525801d7f5 update summary 2026-02-04 15:31:41 +08:00
朱潮
352a2f2f44 降低MAX_CONTEXT_TOKENS 2026-02-03 16:53:51 +08:00
朱潮
c9d00a1b04 admin share 2026-02-01 19:39:26 +08:00
朱潮
5d8efd0dc4 删除部分表 2026-01-30 19:37:22 +08:00
朱潮
51f988e535 update sql表名 2026-01-30 00:03:26 +08:00
朱潮
4c70857ff6 增加bot_manager 2026-01-28 23:32:34 +08:00
朱潮
f1107ea35a 增加enable_thinking和enable_memory 2026-01-28 17:13:41 +08:00
朱潮
3dc119bca8 refactor(mem0): optimize connection pool and async memory handling
- Fix mem0 connection pool exhausted error with proper pooling
- Convert memory operations to async tasks
- Optimize docker-compose configuration
- Add skill upload functionality
- Reduce cache size for better performance
- Update dependencies

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-22 19:39:12 +08:00
朱潮
99755ceab5 remove settingsetting 2026-01-21 10:38:29 +08:00
朱潮
b53174ae9f 需要 openai_api_key的环境变量 2026-01-21 08:38:06 +08:00
朱潮
f694101747 refactor: migrate from Memori to Mem0 for long-term memory
Replace Memori with Mem0 for memory management:
- Delete memori_config.py, memori_manager.py, memori_middleware.py
- Add mem0_config.py, mem0_manager.py, mem0_middleware.py
- Update environment variables (MEMORI_* -> MEM0_*)
- Integrate Mem0 with LangGraph middleware
- Add sync connection pool for Mem0 in DBPoolManager
- Move checkpoint message prep to config creation

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-20 21:15:30 +08:00
朱潮
4d6ee6ae0c fix: pass db_url to init_global_memori
Add db_url property to MemoriManager that falls back to
CHECKPOINT_DB_URL setting, and pass it explicitly from
fastapi_app.py to ensure Memori can create sync connections.

This fixes the error "Either db_pool or db_url must be provided"
when recalling memories.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2026-01-20 08:27:34 +08:00
朱潮
455a48409d feat: integrate Memori long-term memory system
Add Memori (https://github.com/MemoriLabs/Memori) integration for
persistent cross-session memory capabilities in both create_agent
and create_deep_agent.

## New Files

- agent/memori_config.py: MemoriConfig dataclass for configuration
- agent/memori_manager.py: MemoriManager for connection and instance management
- agent/memori_middleware.py: MemoriMiddleware for memory recall/storage
- tests/: Unit tests for Memori components

## Modified Files

- agent/agent_config.py: Added enable_memori, memori_semantic_search_top_k, etc.
- agent/deep_assistant.py: Integrated MemoriMiddleware into init_agent()
- utils/settings.py: Added MEMORI_* environment variables
- pyproject.toml: Added memori>=3.1.0 dependency

## Features

- Semantic memory search with configurable top-k and threshold
- Multi-tenant isolation (entity_id=user, process_id=bot, session_id)
- Memory injection into system prompt
- Background asynchronous memory augmentation
- Graceful degradation when Memori is unavailable

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2026-01-20 00:12:43 +08:00
朱潮
05744cb9f4 批量保存聊天记录 2026-01-19 09:44:57 +08:00
朱潮
f9ba3c8e51 添加聊天记录查询 2026-01-18 12:29:20 +08:00
朱潮
20d5e96986 feat: 添加 PostgreSQL 支持用于 checkpoint 存储
- 添加 postgres:16-alpine 服务配置
- 配置 CHECKPOINT_DB_URL 环境变量
- 添加服务依赖和健康检查

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-18 00:32:23 +08:00
朱潮
90117b41fe 修复符号链接的问题,和deep_agent提示词 2026-01-13 14:22:44 +08:00
朱潮
b93c40d5a5 merge 2026-01-08 23:10:09 +08:00
朱潮
d45079ca55 feat: 将system_prompt解析从markdown代码块改为XML标签格式
- agent_config.py: enable_thinking判断从 ```guideline 改为 <guidelines>
- fastapi_utils.py:
  - preamble解析从 ```preamble``` 改为 <preamble>
  - guidelines/tools/scenarios/terms 块解析从 markdown 格式改为 XML 标签格式
  - 移除不再使用的 parse_guidelines_text 函数

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-08 22:56:43 +08:00
朱潮
342932030f feat(skills): add skill management API module
- Create new skill_manager.py with list and upload endpoints
- Add GET /api/v1/skill/list to retrieve official and user skills
- Add POST /api/v1/skill/upload for skill file upload
- Parse SKILL.md frontmatter to extract name and description
- Move skill upload endpoint from files.py to skill_manager.py
- Add SKILLS_DIR configuration to settings.py
- Register skill_manager router in fastapi_app.py

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2026-01-07 19:45:04 +08:00
朱潮
f74f09c191 fix(skills): improve skill extraction and handling logic
- Refactor _extract_skills_to_robot to accept bot_id instead of robot_dir
  - Add multi-directory skill search with priority order
  - Switch from zip extraction to direct directory copying
  - Add rag-retrieve skill directory
2026-01-07 14:56:10 +08:00
朱潮
1233bdda0c ♻️ refactor(deep-agent): customize agent memory middleware path display
- Change workspace_root from ~/.deepagents/{bot_id} to projects/robot/{bot_id}
- Refactor CustomSkillsMiddleware to support user and project skills separately
- Update skill path formatting for better visibility in system prompts
- Remove unused symlink_utils module and related setup code
- Clean up imports in fastapi_app.py and utils/__init__.py
2026-01-07 12:05:40 +08:00
朱潮
8bb8c3fbc8 add scripts/ 2026-01-04 17:19:03 +08:00
朱潮
a6f166d51e refactor: simplify path displays and remove sensitive config data
- Add CustomSkillsMiddleware to show ./skills instead of full paths
- Enable virtual_mode for FilesystemBackend in local mode
- Display "." instead of ~/.deepagents/{bot_id} in system prompt
- Remove backend_host and masterkey from robot project config

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-31 20:30:44 +08:00
朱潮
306cebd8f1 refactor(project-manager): simplify project path resolution logic
- Remove complex symlink resolution in _get_robot_dir
- Simplify skills source directory path calculation
- Remove project_path parameter from create_project_directory call

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-31 16:27:46 +08:00
朱潮
78c413f4ea feat(robot): add default rag-retrieve skill for catalog/deep agents
When skills parameter is empty or None and robot_type is
catalog_agent or deep_agent, automatically load rag-retrieve skill.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-31 13:42:24 +08:00
朱潮
766b9becda feat(deep-agent): add skills support and improve project structure
- Add skills parameter to ChatRequest for skill file processing
- Extract and unzip skill files to robot project skills directory
- Add robot_config.json with bot_id and environment variables
- Update symlink setup to skip if ~/.deepagents already exists
- Enhance system prompt with directory access restrictions
- Refactor _get_robot_dir to handle symlink paths correctly

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-31 13:21:58 +08:00
朱潮
0e6b2f1511 add CHECKPOINT_DB_URL 2025-12-24 20:43:10 +08:00
朱潮
b86a8364e9 db 2025-12-24 11:05:10 +08:00
朱潮
e117f1ee07 新增checkpoint清理机制 2025-12-24 00:12:01 +08:00
朱潮
bf11975183 修改balance资源配置 2025-12-23 23:11:24 +08:00
朱潮
06102559ef add SUMMARIZATION_MESSAGES_TO_KEEP 2025-12-23 22:31:26 +08:00
朱潮
d8dc973b95 sqlite pool and change agent cache to tools cache 2025-12-23 22:18:18 +08:00
朱潮
09a9c8be93 add MCP_HTTP_TIMEOUT and try catch 2025-12-23 20:13:46 +08:00
朱潮
d3465d418e add symlink 2025-12-23 17:36:45 +08:00
朱潮
aaad9df20a add skills 2025-12-22 23:47:12 +08:00
朱潮
a92bea5b58 删除一些环境变量 2025-12-18 09:41:43 +08:00
朱潮
b78b178c03 删除agent manager 2025-12-17 20:27:06 +08:00
朱潮
c9a91f8f4d add DEFAULT_THINKING_ENABLE 2025-12-17 12:33:58 +08:00
朱潮
e36787fb63 修改agent_config 2025-12-16 21:26:20 +08:00
朱潮
de72321875 add safe_print 2025-12-16 16:28:11 +08:00
朱潮
b8dcccbb1d add AgentConfig 2025-12-16 16:10:09 +08:00
朱潮
9525c0f883 add AgentConfig 2025-12-16 16:06:47 +08:00
朱潮
73b87bd2eb add x-request-id 2025-12-16 10:49:32 +08:00