opensource
/
dify
mirror of https://github.com/langgenius/dify.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,999 Commits 364 Branches 164 Tags 835 MiB
Commit Graph

483 Commits

Author SHA1 Message Date
jyong 1d8b390584 Merge branch 'main' into feat/r2 
# Conflicts:
#	docker/docker-compose.middleware.yaml
 2025-06-11 17:16:27 +08:00
jyong e934503fa0 r2 2025-06-10 18:16:30 +08:00
Jyong 21a50e22d2
fix auto metadata filter (#20845) 2025-06-10 10:46:17 +02:00
QuantumGhost c439e82038
refactor(api): Decouple `ParameterExtractorNode` from `LLMNode` (#20843) 
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
 2025-06-10 11:47:50 +08:00
QuantumGhost a97ff587d2
fix(api): Resolve error encountered when executing `QuestionClassifieNode` (#20829) 
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
 2025-06-10 00:34:51 +08:00
jyong 0ca38d8215 r2 2025-06-06 15:06:26 +08:00
Bowen Liang c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 2025-06-06 10:48:28 +08:00
HaiyangP 3fb9b41fe5
A more concise and effective extractor for excel and csv files (#20625) 
Co-authored-by: haiyangpengai <xxxx>
 2025-06-05 14:59:55 +08:00
Arcaner ad2f25875e
fix(llm_node): update file variable mapping to use vision configs (#20417) 2025-06-05 09:58:24 +08:00
-LAN- 5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-04 19:56:54 +08:00
jyong 133193e7d0 r2 2025-06-04 16:23:12 +08:00
jyong abcca11479 r2 2025-06-03 19:10:40 +08:00
jyong 9cdd2cbb27 r2 2025-06-03 19:02:57 +08:00
jyong 309fffd1e4 Merge branch 'main' into feat/r2 
# Conflicts:
#	api/core/repositories/sqlalchemy_workflow_node_execution_repository.py
#	api/core/workflow/entities/node_entities.py
#	api/core/workflow/enums.py
 2025-06-03 18:56:49 +08:00
-LAN- 275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 18:56:38 +08:00
非法操作 ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 2025-06-03 18:17:34 +08:00
jyong 7b7f8ef51d r2 2025-06-03 18:12:24 +08:00
-LAN- 36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:36:18 +08:00
-LAN- 72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:16:06 +08:00
jyong 0486aa3445 r2 2025-06-03 13:30:51 +08:00
Contrail a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 2025-06-03 12:47:39 +08:00
jyong 631768ea1d r2 2025-05-30 15:42:36 +08:00
-LAN- a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 14:36:44 +08:00
yihong 5a991295e0
fix: drop some type fixme (#20344) 2025-05-30 14:10:09 +08:00
-LAN- db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 11:05:08 +08:00
-LAN- f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:56:37 +08:00
-LAN- 32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:47:56 +08:00
-LAN- 482e50aae9
Refactor/remove db from cycle manager (#20455) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:34:13 +08:00
jyong a826879cf7 Merge branch 'main' into feat/r2 2025-05-29 23:04:38 +08:00
Yeuoly d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 2025-05-29 17:55:20 +08:00
jyong a025db137d Merge branch 'main' into feat/r2 2025-05-29 09:54:28 +08:00
jyong 797d044714 r2 2025-05-29 09:53:42 +08:00
-LAN- f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-28 19:56:17 +08:00
jyong 7f59ffe7af r2 2025-05-28 17:56:04 +08:00
teawoong Kim 400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 2025-05-28 17:04:38 +08:00
-LAN- f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 22:41:07 +08:00
-LAN- 9c9d3d7bd0
feat: document extractor chardet encoding (#20269) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 13:27:46 +08:00
-LAN- 55503ce771
fix: persist workflow execution status on partial success and failure (#20264) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 11:24:08 +08:00
jyong 5fc2bc58a9 r2 2025-05-27 00:01:23 +08:00
Yeuoly 83ca7f8deb feat: add datasource support to PluginDeclaration and PluginCategory 2025-05-26 17:32:25 +08:00
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193) 
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-26 16:41:57 +08:00
jyong 35be8721b9 Merge branch 'main' into feat/r2 2025-05-26 14:50:33 +08:00
jyong 665ffbdc10 r2 2025-05-26 14:49:59 +08:00
jyong ec1c4efca9 r2 2025-05-25 23:09:01 +08:00
jyong 6d547447d3 r2 2025-05-23 19:30:48 +08:00
jyong 64d997fdb0 r2 2025-05-23 15:55:41 +08:00
Yeuoly a49942b949 fix: rename first_step_parameters 2025-05-23 15:12:31 +08:00
jyong b93d26ee9f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/entities/datasource_entities.py
 2025-05-23 00:06:51 +08:00
jyong b82b26bba5 r2 2025-05-23 00:05:57 +08:00
-LAN- 6b3666f826
feat: Split WorkflowCycleManager (#20071) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-22 09:49:25 +08:00
-LAN- d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 22:01:53 +08:00
Yeuoly 3bfc602561 refactor: update datasource entity structure and parameter handling 
- Renamed and split parameters in DatasourceEntity into first_step_parameters and second_step_parameters.
- Updated validation methods for new parameter structure.
- Adjusted datasource_node to reference first_step_parameters.
- Cleaned up unused imports and improved type hints in workflow.py.
 2025-05-21 20:36:26 +08:00
jyong 82be119fec Merge branch 'main' into feat/r2 2025-05-20 15:18:52 +08:00
jyong ba52bf27c1 r2 2025-05-20 14:57:26 +08:00
-LAN- 4977bb21ec
feat(workflow): domain model for workflow node execution (#19430) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-17 00:56:16 +08:00
Yeuoly c5a2f43ceb refactor: replace BuiltinToolManageService with RagPipelineManageService for datasource management and remove unused datasource engine and related code 2025-05-16 18:42:07 +08:00
jyong 4ff971c8a3 r2 2025-05-16 11:26:56 +08:00
jyong 93ac6d37e9 r2 2025-05-15 16:44:55 +08:00
jyong 360f8a3375 Merge branch 'main' into feat/r2 2025-05-15 15:15:23 +08:00
jyong 818eb46a8b r2 2025-05-15 15:14:52 +08:00
satohk 1b4fea1794
fix: Referencing Metadata in the response of the External Knowledge A… (#19637) (#19644) 
Co-authored-by: satou.kazuhiro <satou.kazuhiro@fanuc.co.jp>
 2025-05-14 15:05:28 +08:00
jiangbo721 fabfc7d4d8
fix: remove error message $ symbol (#19587) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-13 16:20:29 +08:00
SSebo 57b3912227
fix: common prerequisite node workflow remove reachable node that failed to streaming llm… (#19552) 
Co-authored-by: zhangshibo <zhangshibo@didiglobal.com>
 2025-05-13 13:47:29 +08:00
非法操作 b00f94df64
fix: replace all dataset.Model.query to db.session.query(Model) (#19509) 2025-05-12 13:52:33 +08:00
LeanDeR c720e0dd04
refactor(workflow): revamp logging module for loop & iteration nodes (#19484) 2025-05-12 09:32:41 +08:00
Bowen Liang cbc8ebd8f5
chore: bump pydantic to 2.11 and pydantic-settings to 2.9 (#15049) 2025-05-08 17:39:51 +08:00
Will 58d9d35515
fix: inconsistent metadata definitions (#19343) 2025-05-08 16:33:28 +08:00
jyong 3f1363503b r2 2025-05-07 16:19:09 +08:00
Will bfa652f2d0
fix: metadata filtering condition variable unassigned; fix External K… (#19208) 2025-05-07 14:52:09 +08:00
-LAN- f23cf98317
refactor: Remove RepositoryFactory (#19176) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-06 21:14:51 +08:00
jyong a25cc4e8af r2 2025-05-06 13:56:13 +08:00
Novice 0cfc82d731
fix(structured-output): reasoning model's json format parsing (#19261) 2025-05-06 13:16:08 +08:00
kenwoodjw c5568f756f
fix basic auth if not base64 encode (#19242) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
 2025-05-06 09:18:37 +08:00
Hao Cheng 9bcf837f17
fix: use only supported operators in metadata filter system prompts (#19195) 2025-05-03 20:08:08 +08:00
Will a212a63e6a
fix: time type metadata filtering error (#19192) 2025-05-03 20:07:37 +08:00
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372) 
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2025-04-30 17:28:02 +08:00
-LAN- bcc95e520b
feat: support remove first and remove last in variable assigner (#19144) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-04-30 15:50:00 +08:00
Will 69b43a955f
fix: inconsistent case expression in _process_metadata_filter_func (#19146) 2025-04-30 15:14:01 +08:00
QuantumGhost bd1bbfee4b
Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
feiyang_deepnova 226afd4550
Fix: the issue of getting empty environment variables. (#19085) 2025-04-29 18:01:11 +08:00
Jyong b8bb45b106
remove unstructured api key check (#18989) 2025-04-28 17:26:30 +08:00
jyong 3c386c63a6 Merge remote-tracking branch 'origin/feat/r2' into feat/r2 2025-04-28 16:19:29 +08:00
jyong 49d1846e63 r2 2025-04-28 16:19:12 +08:00
quicksand 5de01c1444
feat (document_extractor): support .properties file (#18969) 2025-04-28 15:28:11 +08:00
crazywoola 2c2af1d117
feat: add VTT data transform to Document extractor (#18936) 2025-04-28 13:45:15 +08:00
-LAN- d9aa2b155a
refactor: Refactors repository imports structure (#18901) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-04-27 17:29:03 +08:00
Yeuoly c2d02f8f4d Merge branch 'main' into feat/r2 2025-04-27 14:31:19 +08:00
Yeuoly abafa68647
refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 2025-04-27 14:22:25 +08:00
非法操作 c1559a7c8e
fix: LLMResultChunk cause concatenate str and list exception (#18852) 2025-04-27 11:32:14 +08:00
Jyong e2cb7006c4
check metadata_filtering_conditions could be None in auto mode (#18548) 2025-04-22 17:09:33 +08:00
ZalterCitty a1158cc946
fix: Update prompt message content types to use Literal and add union type for content (#17136) 
Co-authored-by: 朱庆超 <zhuqingchao@xiaomi.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-04-22 16:17:55 +08:00
Novice da9269ca97
feat: structured output (#17877) 2025-04-18 16:33:53 +08:00
jyong 5c4bf2a9e4 r2 2025-04-17 15:07:23 +08:00
Novice c91045a9d0
fix(fail-branch): prevent streaming output in exception branches (#17153) 2025-04-16 22:34:07 +08:00
呆萌闷油瓶 8cc37f3115
fix:the extraction function of the list operation node received 0 that should not be received (#18170) 2025-04-16 16:26:24 +08:00
Ganondorf b006b9ac0c
Http requests node add ssl verify (#18125) 
Co-authored-by: lizb <lizb@sugon.com>
 2025-04-16 15:59:34 +08:00
kenwoodjw dfc123819e
fix basic auth encoding (#18047) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
 2025-04-15 11:34:50 +08:00
Novice cd7fd100a7
fix(langfuse): qusetion classify node can't see cost in langfuse (#17982) 2025-04-14 15:28:26 +08:00
Yongtao Huang 5d72003ebb
Remove dead code (#17899) 2025-04-11 20:33:52 +08:00
briqt 91cfa90503
Fix external knowledge Issues: (#17685) (#17843) 2025-04-11 15:37:27 +08:00