opensource/dify
2
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-05-10 22:28:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,150 Commits 492 Branches 170 Tags 701 MiB
feat/new-agent-node
Commit Graph

321 Commits

Author SHA1 Message Date
Yansong Zhang
b804c7ed47 fix: restore SandboxExpiredRecordsCleanConfig, remove debug logs 
- Restore SandboxExpiredRecordsCleanConfig (billing/ops config that
  was mistakenly removed with sandbox execution code)
- Remove [DEBUG-AGENT] logging from app_generate_service.py

Made-with: Cursor
 2026-04-13 14:39:48 +08:00
Yansong Zhang
c03b25a940 merge: resolve conflicts with origin/main 
Conflicts resolved:
- workflow_app_runner.py: adopt main's DifyGraphInitContext pattern
- token_buffer_memory.py: adopt main's match/case, add AppMode.AGENT
- app_dsl_service.py: adopt main's match/case, add AppMode.AGENT

Made-with: Cursor
 2026-04-13 12:52:56 +08:00
Yansong Zhang
90cce7693f revert: remove all sandbox and skill related code 
Remove ~12,900 lines of sandbox/skill code that was ported from
feat/support-agent-sandbox. This reverts to direct tool execution
(the original behavior before sandbox integration).

Removed:
- core/sandbox/ (SandboxBuilder, bash tools, providers, initializers)
- core/skill/ (SkillManager, assembler, entities)
- core/virtual_environment/ (5 provider implementations)
- core/zip_sandbox/ (archive operations)
- core/app_assets/ (asset management)
- core/app_bundle/ (bundle management)
- controllers/cli_api/ (DifyCli callback endpoints)
- services/sandbox/ (provider service)
- services/skill_service, app_asset_service, app_bundle_service
- models/sandbox.py, app_asset.py
- bin/dify-cli-* (3 platform binaries)
- web sandbox-provider-page and service
- SandboxLayer, _resolve_sandbox_context, _invoke_tool_in_sandbox
- CliApiConfig, DIFY_SANDBOX_CONTEXT_KEY
- sandbox-related migrations

Preserved: All Agent V2 core functionality (agent-v2 node, strategy
engine, transparent upgrade, LLM remapping, memory, context, tools
via direct execution).

Made-with: Cursor
 2026-04-13 10:42:36 +08:00
YBoy
4be479fa06
refactor(api): type SQLALCHEMY_ENGINE_OPTIONS with TypedDict (#34941) 2026-04-11 00:39:37 +00:00
Yansong Zhang
10bb276e97 fix(api): complete Docker sandbox tool execution pipeline 
- Add linux/arm64 dify-cli binary for Docker containers
- Add DIFY_PORT config field for Docker socat forwarding
- Fix InvokeFrom.AGENT (doesn't exist) → InvokeFrom.DEBUGGER
  in CLI API fetch/tools/batch endpoint

Full pipeline verified: Docker container → dify init → dify execute
→ CLI API callback → plugin invocation → result returned to stdout.

Made-with: Cursor
 2026-04-10 11:06:54 +08:00
Yansong Zhang
73fd439541 fix(api): resolve sandbox deadlock under gevent and refine integration 
- Skip Local sandbox provider under gevent worker (subprocess pipes
  cause cooperative threading deadlock with Celery's gevent pool).
- Add non-blocking sandbox readiness check before tool execution.
- Add gevent timeout wrapper for sandbox bash session.
- Fix CLI binary resolution: add SANDBOX_DIFY_CLI_ROOT config field.
- Fix ExecutionContext.node_id propagation.
- Fix SkillInitializer to gracefully handle missing skill bundles.
- Update _invoke_tool_in_sandbox to use correct `dify execute` CLI
  subcommand format (not `invoke-tool`).

The full sandbox-in-agent pipeline works end-to-end for network-based
providers (Docker, E2B, SSH). Local provider is skipped under gevent
but works in non-gevent contexts.

Made-with: Cursor
 2026-04-10 10:51:40 +08:00
wangxiaolei
27e484e7f8
feat: redis add retry logic (#34566) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-09 03:08:25 +00:00
Yansong Zhang
66212e3575 feat(api): implement zero-migration transparent upgrade (Phase 8) 
Add two feature-flag-controlled upgrade paths that allow existing apps
and LLM nodes to transparently run through the Agent V2 engine without
any database migration:

1. AGENT_V2_TRANSPARENT_UPGRADE (default: off):
   When enabled, old apps (chat/completion/agent-chat) bypass legacy
   Easy-UI runners. VirtualWorkflowSynthesizer converts AppModelConfig
   to an in-memory Workflow (start -> agent-v2 -> answer) at runtime,
   then executes via AdvancedChatAppGenerator. Falls back to legacy
   path on any synthesis error.

   VirtualWorkflowSynthesizer maps:
   - model JSON -> ModelConfig
   - pre_prompt/chat_prompt_config -> prompt_template
   - agent_mode.tools -> ToolMetadata[]
   - agent_mode.strategy -> agent_strategy
   - dataset_configs -> context
   - file_upload -> vision

2. AGENT_V2_REPLACES_LLM (default: off):
   When enabled, DifyNodeFactory.create_node() transparently remaps
   nodes with type="llm" to type="agent-v2" before class resolution.
   Since AgentV2NodeData is a strict superset of LLMNodeData, the
   mapping is lossless. With tools=[], Agent V2 behaves identically
   to LLM Node.

Both flags default to False for safety. Turn off = instant rollback.
46 existing tests pass. Flask starts successfully.

Made-with: Cursor
 2026-04-09 10:30:52 +08:00
Yansong Zhang
0c7e7e0c4e feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6) 
Port the complete infrastructure for agent sandbox execution and skill system:

Sandbox & Virtual Environment (core/sandbox/, core/virtual_environment/):
- Sandbox entity with lifecycle management (ready/failed/cancelled states)
- SandboxBuilder with fluent API for configuring providers
- 5 VM providers: Local, SSH, Docker, E2B, AWS CodeInterpreter
- VirtualEnvironment base with command execution, file transfer, transport layers
- Channel transport: pipe, queue, socket implementations
- Bash session management and DifyCli binary integration
- Storage: archive storage, file storage, noop storage, presign storage
- Initializers: DifyCli, AppAssets, DraftAppAssets, Skills
- Inspector: file browser, archive/runtime source, script utils
- Security: encryption utils, debug helpers

Skill & App Assets (core/skill/, core/app_assets/, core/app_bundle/):
- Skill entity and manager
- App asset accessor, builder pipeline (file, skill builders)
- App bundle source zip extractor
- Storage and converter utilities

API Endpoints:
- CLI API blueprint (controllers/cli_api/) for sandbox callback
- Sandbox provider management (workspace/sandbox_providers)
- Sandbox file browser (console/sandbox_files)
- App asset management (console/app/app_asset)
- Skill management (console/app/skills)
- Storage file endpoints (controllers/files/storage_files)

Services:
- Sandbox service, provider service, file service
- App asset service, app bundle service

Config:
- CliApiConfig, CreatorsPlatformConfig, CollaborationConfig
- FILES_API_URL for sandbox file access

Note: Controller route registration temporarily commented out (marked TODO)
pending resolution of deep dependency chains (socketio, workflow_comment,
command node, etc.). Core sandbox modules are fully ported and syntax-validated.
110 files changed, 10,549 insertions.

Made-with: Cursor
 2026-04-08 17:39:02 +08:00
Xiyuan Chen
5a8a68cab8
feat: enterprise otel exporter (#33138) 
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
Co-authored-by: Yunlu Wen <yunlu.wen@dify.ai>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-27 07:56:31 +00:00
letterbeezps
56e0907548
fix: do not block upsert for baidu vdb (#33280) 
Co-authored-by: zhangping24 <zhangping24@baidu.com>
Co-authored-by: Crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-23 20:42:57 +08:00
wangxiaolei
aa4a9877f5
fix: fix max_retries is hardcode (#33619) 2026-03-18 10:08:16 +08:00
盐粒 Yanli
a717519822
refactor(api): tighten phase 1 shared type contracts (#33453) 2026-03-17 17:50:51 +08:00
QuantumGhost
4a090876f1
chore(api): rename configuration EVENT_BUS_REDIS_CLUSTERS (#33528) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-16 17:50:15 +08:00
Ye Ding
f795d24151
feat: Add Hologres as a VDB & FullText DB choice (#32830) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Crazywoola <100913391+crazywoola@users.noreply.github.com>
 2026-03-15 20:55:02 +08:00
lif
1104d35bbb
chore: remove unused WEAVIATE_GRPC_ENABLED config option (#33378) 
Signed-off-by: majiayu000 <1835304752@qq.com>
 2026-03-13 15:06:50 +08:00
Yunlu Wen
1ecedab024
feat: enterprise plugin pre uninstall (#33158) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-10 15:03:37 +08:00
wangxiaolei
2f4c740d46
feat: support redis xstream (#32586) 2026-03-04 13:18:55 +08:00
wangxiaolei
b584434e28
feat: redis connection support max connections (#32935) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-04 11:52:43 +08:00
Conner Mo
16df9851a2
feat(api): optimize OceanBase vector store performance and configurability (#32263) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-02-13 09:48:55 +08:00
Bowen Liang
c0ffb6db2a
feat: support config max size of plugin generated files (#30887) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2026-02-13 09:48:27 +08:00
Runzhe
32350f7a04
feat(api): add scheduled cleanup task for specific workflow logs (#31843) 
Co-authored-by: 章润喆 <zhangrunzhe@zhangrunzhedeMacBook-Air.local>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: hjlarry <hjlarry@163.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: hj24 <mambahj24@gmail.com>
 2026-02-11 20:54:36 +08:00
hj24
7e0bccbbf0
fix: update index to optimize message clean performance (#32238) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-02-11 16:07:52 +08:00
Ponder
6015f23e79
feat: enhancement celery configuration (#32145) 2026-02-10 17:55:24 +08:00
QuantumGhost
a1fc280102
feat: Human Input Node (#32060) 
The frontend and backend implementation for the human input node.

Co-authored-by: twwu <twwu@dify.ai>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: yyh <92089059+lyzno1@users.noreply.github.com>
Co-authored-by: zhsama <torvalds@linux.do>
 2026-02-09 14:57:23 +08:00
zyssyz123
2c9430313d
fix: redis for api token (#31861) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: hj24 <mambahj24@gmail.com>
 2026-02-06 16:25:27 +08:00
QuantumGhost
90fe9abab7
revert: revert human input relevant code (#31766) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-30 19:18:49 +08:00
QuantumGhost
f90fa2b186
fix(api): fix workflow state persistence issue (#31752) 
Ensure workflow pause configuration is correctly set for all entrypoints.
 2026-01-30 17:44:29 +08:00
QuantumGhost
03e3acfc71
feat(api): Human Input Node (backend part) (#31646) 
The backend part of the human in the loop (HITL) feature and relevant architecture / workflow engine changes.

Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: 盐粒 Yanli <yanli@dify.ai>
Co-authored-by: CrabSAMA <40541269+CrabSAMA@users.noreply.github.com>
Co-authored-by: Stephen Zhou <38493346+hyoban@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
 2026-01-30 10:18:49 +08:00
-LAN-
2626e773d9
chore: Set plugin schema cache TTL to 1h (#31708) 2026-01-29 16:41:09 +08:00
Nie Ronghua
ceb6914793
refactor(model): Refactor plugin model schema cache to be process-global to prevent redundant Daemon API calls (#31689) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2026-01-29 14:31:15 +08:00
zyssyz123
515002a8ba
feat: app trial (#26281) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: hj24 <mambahj24@gmail.com>
 2026-01-22 15:42:54 +08:00
hj24
e80d76af15
feat: add lock for retention jobs (#31320) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-21 14:06:35 +08:00
wangxiaolei
0ec2b12e65
feat: allow pass hostname in docker env (#30975) 2026-01-14 19:30:37 +08:00
jialin li
c327d0bb44
fix: Correction to the full name of Volc TOS (#30741) 2026-01-14 10:11:30 +08:00
非法操作
51ea87ab85
feat: clear free plan workflow run logs (#29494) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2026-01-12 15:57:40 +08:00
zyssyz123
fe0802262c
feat: credit pool (#30720) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-08 13:17:30 +08:00
wangxiaolei
f1fff0a243
fix: fix WorkflowExecution.outputs containing non-JSON-serializable o… (#30464) 2026-01-05 10:57:23 +08:00
Byron.wang
5362f69083
feat(refactoring): Support Structured Logging (JSON) (#30170) 2026-01-04 11:46:46 +08:00
非法操作
3015e9be73
feat: add archive storage client and env config (#30422) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-12-31 16:14:46 +08:00
wangxiaolei
2c919efa69
feat: support tencent cos custom domain (#30193) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-12-29 15:41:02 +08:00
Michael.Y.Ma
3322e7a7e3
feat: Add OSS-specific parameters for HW and ALI private deployment (#29705) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-12-22 21:59:32 +08:00
huku
eb5a444d3d
fix: plugin execution timeout not respecting PLUGIN_MAX_EXECUTION_TIMEOUT (#29785) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-12-18 15:11:01 +08:00
hj24
46c9a59a31
feat: sandbox retention basic settings (#29842) 2025-12-18 14:16:23 +08:00
crazywoola
a915b8a584
revert: "security/fix-swagger-info-leak-m02" (#29721) 2025-12-16 14:19:33 +08:00
longbingljw
4cc6652424
feat: VECTOR_STORE supports seekdb (#29658) 2025-12-16 12:35:04 +09:00
zyssyz123
724cd57dbf
fix: dos in annotation import (#29470) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-12-15 15:22:04 +08:00
L1nSn0w
355a2356d4
security/fix-swagger-info-leak-m02 (#29283) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-12-15 11:24:06 +08:00
TomoOkuyama
569c593240
feat: Add InterSystems IRIS vector database support (#29480) 
Co-authored-by: Tomo Okuyama <tomo.okuyama@intersystems.com>
 2025-12-15 10:20:43 +08:00
Jyong
9affc546c6
Feat/support multimodal embedding (#29115) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-12-09 14:41:46 +08:00