opensource/dify
2
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-03-29 16:40:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
7,309 Commits 430 Branches 169 Tags 606 MiB
4fdcd74f52
Commit Graph

525 Commits

Author SHA1 Message Date
jyong
832bef053f Merge branch 'main' into feat/r2 
# Conflicts:
#	docker/docker-compose.middleware.yaml
#	web/app/components/workflow-app/components/workflow-main.tsx
#	web/app/components/workflow-app/hooks/index.ts
#	web/app/components/workflow/hooks-store/store.ts
#	web/app/components/workflow/hooks/index.ts
#	web/app/components/workflow/nodes/_base/components/variable/var-reference-picker.tsx
 2025-07-02 18:20:05 +08:00
jyong
81b07dc3be r2 2025-07-02 18:15:23 +08:00
efrey kong
826bf25abf
Fix: prevent SQL errors when metadata filter Constant value is None or blank (#21803) 2025-07-02 14:43:01 +08:00
jyong
e23d7e39ec Merge branch 'feat/datasource' into feat/r2 
# Conflicts:
#	api/services/rag_pipeline/rag_pipeline.py
#	web/app/components/workflow/constants.ts
#	web/app/components/workflow/header/run-and-history.tsx
#	web/app/components/workflow/hooks/use-nodes-interactions.ts
#	web/app/components/workflow/hooks/use-workflow-interactions.ts
#	web/app/components/workflow/hooks/use-workflow.ts
#	web/app/components/workflow/index.tsx
#	web/app/components/workflow/nodes/_base/components/panel-operator/panel-operator-popup.tsx
#	web/app/components/workflow/nodes/_base/panel.tsx
#	web/app/components/workflow/nodes/code/use-config.ts
#	web/app/components/workflow/nodes/llm/default.ts
#	web/app/components/workflow/panel/index.tsx
#	web/app/components/workflow/panel/version-history-panel/index.tsx
#	web/app/components/workflow/store/workflow/index.ts
#	web/app/components/workflow/types.ts
#	web/config/index.ts
#	web/types/workflow.ts
 2025-07-02 14:01:59 +08:00
QuantumGhost
89250a36b7
fix(api): files not returned in the answer node (#21807) 2025-07-02 13:54:10 +08:00
QuantumGhost
c2e599cd85
fix(api): Fix resetting sys var causing internal server error (#21604) 
and sorts draft variables by their creation time, ensures a consist order.
 2025-07-02 13:36:35 +08:00
jiangbo721
71d6cf1b1d
fix: Make the latency and logs of web applications consistent. (#21578) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-07-02 12:04:33 +08:00
jiangbo721
9a4c1fe834
fix: if parameter is not required, continue (#21761) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-07-01 21:25:45 +08:00
jyong
f33b6c0c73 add online drive 2025-07-01 16:08:54 +08:00
Han
69b6f6f5d2
Fixes issue 21157/20661 extra quote in agent node (#21674) 
Co-authored-by: Wang Han <wanghan@zhejianglab.org>
 2025-07-01 10:43:46 +08:00
Yeuoly
0cb00d5fd2
refactor: move structured output support outside LLM Node (#21565) 
Co-authored-by: Novice <novice12185727@gmail.com>
 2025-06-27 14:55:31 +08:00
NeatGuyCoding
6bb82f8ee0
Fix minor comment missing (#21517) 2025-06-26 10:06:49 +08:00
jyong
efccbe4039 r2 2025-06-25 17:32:26 +08:00
jyong
540096a8d8 Merge branch 'main' into feat/r2 
# Conflicts:
#	api/core/plugin/impl/oauth.py
#	api/core/workflow/entities/variable_pool.py
#	api/models/workflow.py
#	api/services/dataset_service.py
 2025-06-25 14:35:23 +08:00
QuantumGhost
268da31332
fix(api): adding variable to variable pool recursively while loading draft variables. (#21478) 
This PR fix the issue that `ObjectSegment` are not recursively added to the draft variable pool while loading draft variables from database. It also fixes an issue about loading variables with more than two elements in the its selector.

Enhances #19735.
Closes #21477.
 2025-06-25 12:39:22 +08:00
QuantumGhost
501d3b6203
feat(api): Explicitly define version method for all BaseNode subclasses (#21443) 
This PR addresses issue #21441 by implementing explicit `version` method definitions for all `BaseNode` subclasses to improve code maintainability.

### Changes

Added explicit `version` method definitions for all `BaseNode` subclasses:

- `QuestionClassifierNode`
- `KnowledgeRetrievalNode` 
- `AgentNode`

Added comprehensive test suite to validate:

1. All subclasses of `BaseNode` have explicitly defined `version` method
2. All subclasses have required `_node_type` property
3. The `(node_type, node_version)` combination is unique across all subclasses
 2025-06-24 20:27:22 +08:00
quicksand
45146edb31
fix(document_extractor): xlsx file column int type error (#21408) 2025-06-24 13:42:13 +08:00
QuantumGhost
10b738a296
feat: Persist Variables for Enhanced Debugging Workflow (#20699) 
This pull request introduces a feature aimed at improving the debugging experience during workflow editing. With the addition of variable persistence, the system will automatically retain the output variables from previously executed nodes. These persisted variables can then be reused when debugging subsequent nodes, eliminating the need for repetitive manual input.

By streamlining this aspect of the workflow, the feature minimizes user errors and significantly reduces debugging effort, offering a smoother and more efficient experience.

Key highlights of this change:

- Automatic persistence of output variables for executed nodes.
- Reuse of persisted variables to simplify input steps for nodes requiring them (e.g., `code`, `template`, `variable_assigner`).
- Enhanced debugging experience with reduced friction.

Closes #19735.
 2025-06-24 09:05:29 +08:00
Dongyu Li
b77081a19e feat(datasource): update datasource icon 2025-06-23 15:57:37 +08:00
twwu
af64f29e87 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 2025-06-23 13:59:39 +08:00
QuantumGhost
3f9ced5374
Revert "feat:conversation variable support file array" (#21273) 2025-06-20 19:57:28 +08:00
jyong
b618f3bd9e r2 2025-06-19 15:30:46 +08:00
jyong
3d0e288e85 r2 2025-06-19 14:29:39 +08:00
jyong
f7fbded8b9 Merge branch 'main' into feat/r2 2025-06-19 13:32:07 +08:00
ZalterCitty
6325129761
fix wrongly remove reset nodes (#20880) 
Co-authored-by: zhuqingchao <zhuqingchao@xiaomi.com>
 2025-06-19 11:37:07 +08:00
kinoooolu
2bb19f85c6
feat:conversation variable support file array (#21174) 
Co-authored-by: kino.lu <kino.lu@vipshop.com>
 2025-06-19 10:26:38 +08:00
-LAN-
879f839d75
refactor(graph_engine): Merge duplicated if block (#20784) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-18 14:33:29 +08:00
jyong
f7a4e5d1a6 Merge branch 'main' into feat/r2 2025-06-18 10:57:44 +08:00
jyong
66de2e1f0a Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/workflow/graph_engine/entities/event.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-17 19:07:15 +08:00
jyong
7f7ea92a45 r2 2025-06-17 19:06:17 +08:00
Dongyu Li
739ebf2117 feat(datasource): change datasource result type to event-stream 2025-06-17 18:24:09 +08:00
W_OOD
0476937f55
fix(agent_node):Fix spelling errors. (#21094) 2025-06-17 17:48:43 +08:00
-LAN-
0dcacdf83d
feat: add a flask_context_manager. (#21061) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-17 16:31:29 +08:00
Dongyu Li
c5976f5a09 feat(datasource): change datasource result type to event-stream 2025-06-17 13:51:41 +08:00
jyong
b277acc298 Merge branch 'main' into feat/r2 2025-06-16 14:08:02 +08:00
jyong
8d47d8ce4f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/website_crawl/website_crawl_plugin.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-16 13:50:33 +08:00
jyong
41fef8a21f r2 2025-06-16 13:48:43 +08:00
yihong
909259da37
fix: delete some dead code using vulture (#20999) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-06-16 12:07:41 +08:00
Harry
5ccb8d9736 feat: online document 2025-06-13 18:22:15 +08:00
Harry
0908f310fc feat: webcrawl 2025-06-13 17:47:51 +08:00
jyong
b2b95412b9 r2 2025-06-13 15:04:22 +08:00
-LAN-
1e03c97663
fix(llm_node): missing parameters for structure outputs (#20915) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-11 18:56:07 +08:00
jyong
1d8b390584 Merge branch 'main' into feat/r2 
# Conflicts:
#	docker/docker-compose.middleware.yaml
 2025-06-11 17:16:27 +08:00
jyong
e934503fa0 r2 2025-06-10 18:16:30 +08:00
Jyong
21a50e22d2
fix auto metadata filter (#20845) 2025-06-10 10:46:17 +02:00
QuantumGhost
c439e82038
refactor(api): Decouple ParameterExtractorNode from LLMNode (#20843) 
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
 2025-06-10 11:47:50 +08:00
QuantumGhost
a97ff587d2
fix(api): Resolve error encountered when executing QuestionClassifieNode (#20829) 
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
 2025-06-10 00:34:51 +08:00
jyong
0ca38d8215 r2 2025-06-06 15:06:26 +08:00
Bowen Liang
c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 2025-06-06 10:48:28 +08:00
HaiyangP
3fb9b41fe5
A more concise and effective extractor for excel and csv files (#20625) 
Co-authored-by: haiyangpengai <xxxx>
 2025-06-05 14:59:55 +08:00
Arcaner
ad2f25875e
fix(llm_node): update file variable mapping to use vision configs (#20417) 2025-06-05 09:58:24 +08:00
-LAN-
5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-04 19:56:54 +08:00
jyong
133193e7d0 r2 2025-06-04 16:23:12 +08:00
jyong
abcca11479 r2 2025-06-03 19:10:40 +08:00
jyong
9cdd2cbb27 r2 2025-06-03 19:02:57 +08:00
jyong
309fffd1e4 Merge branch 'main' into feat/r2 
# Conflicts:
#	api/core/repositories/sqlalchemy_workflow_node_execution_repository.py
#	api/core/workflow/entities/node_entities.py
#	api/core/workflow/enums.py
 2025-06-03 18:56:49 +08:00
-LAN-
275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 18:56:38 +08:00
非法操作
ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 2025-06-03 18:17:34 +08:00
jyong
7b7f8ef51d r2 2025-06-03 18:12:24 +08:00
-LAN-
36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:36:18 +08:00
-LAN-
72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:16:06 +08:00
jyong
0486aa3445 r2 2025-06-03 13:30:51 +08:00
Contrail
a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 2025-06-03 12:47:39 +08:00
jyong
631768ea1d r2 2025-05-30 15:42:36 +08:00
-LAN-
a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 14:36:44 +08:00
yihong
5a991295e0
fix: drop some type fixme (#20344) 2025-05-30 14:10:09 +08:00
-LAN-
db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 11:05:08 +08:00
-LAN-
f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:56:37 +08:00
-LAN-
32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:47:56 +08:00
-LAN-
482e50aae9
Refactor/remove db from cycle manager (#20455) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:34:13 +08:00
jyong
a826879cf7 Merge branch 'main' into feat/r2 2025-05-29 23:04:38 +08:00
Yeuoly
d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 2025-05-29 17:55:20 +08:00
jyong
a025db137d Merge branch 'main' into feat/r2 2025-05-29 09:54:28 +08:00
jyong
797d044714 r2 2025-05-29 09:53:42 +08:00
-LAN-
f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-28 19:56:17 +08:00
jyong
7f59ffe7af r2 2025-05-28 17:56:04 +08:00
teawoong Kim
400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 2025-05-28 17:04:38 +08:00
-LAN-
f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 22:41:07 +08:00
-LAN-
9c9d3d7bd0
feat: document extractor chardet encoding (#20269) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 13:27:46 +08:00
-LAN-
55503ce771
fix: persist workflow execution status on partial success and failure (#20264) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 11:24:08 +08:00
jyong
5fc2bc58a9 r2 2025-05-27 00:01:23 +08:00
Yeuoly
83ca7f8deb feat: add datasource support to PluginDeclaration and PluginCategory 2025-05-26 17:32:25 +08:00
Heyang Wang
b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193) 
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-26 16:41:57 +08:00
jyong
35be8721b9 Merge branch 'main' into feat/r2 2025-05-26 14:50:33 +08:00
jyong
665ffbdc10 r2 2025-05-26 14:49:59 +08:00
jyong
ec1c4efca9 r2 2025-05-25 23:09:01 +08:00
jyong
6d547447d3 r2 2025-05-23 19:30:48 +08:00
jyong
64d997fdb0 r2 2025-05-23 15:55:41 +08:00
Yeuoly
a49942b949 fix: rename first_step_parameters 2025-05-23 15:12:31 +08:00
jyong
b93d26ee9f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/entities/datasource_entities.py
 2025-05-23 00:06:51 +08:00
jyong
b82b26bba5 r2 2025-05-23 00:05:57 +08:00
-LAN-
6b3666f826
feat: Split WorkflowCycleManager (#20071) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-22 09:49:25 +08:00
-LAN-
d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 22:01:53 +08:00
Yeuoly
3bfc602561 refactor: update datasource entity structure and parameter handling 
- Renamed and split parameters in DatasourceEntity into first_step_parameters and second_step_parameters.
- Updated validation methods for new parameter structure.
- Adjusted datasource_node to reference first_step_parameters.
- Cleaned up unused imports and improved type hints in workflow.py.
 2025-05-21 20:36:26 +08:00
jyong
82be119fec Merge branch 'main' into feat/r2 2025-05-20 15:18:52 +08:00
jyong
ba52bf27c1 r2 2025-05-20 14:57:26 +08:00
-LAN-
4977bb21ec
feat(workflow): domain model for workflow node execution (#19430) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-17 00:56:16 +08:00
Yeuoly
c5a2f43ceb refactor: replace BuiltinToolManageService with RagPipelineManageService for datasource management and remove unused datasource engine and related code 2025-05-16 18:42:07 +08:00
jyong
4ff971c8a3 r2 2025-05-16 11:26:56 +08:00
jyong
93ac6d37e9 r2 2025-05-15 16:44:55 +08:00