opensource
/
dify
mirror of https://github.com/langgenius/dify.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,820 Commits 379 Branches 166 Tags 733 MiB
Commit Graph

4993 Commits

Author SHA1 Message Date
-LAN- bab4975809
chore: add ast-grep rule to convert Optional[T] to T | None (#25560) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-15 13:06:33 +08:00
-LAN- b8ee1d4697
Merge branch 'main' into feat/queue-based-graph-engine 2025-09-15 12:21:18 +08:00
dependabot[bot] 6c36bf28d7
chore(deps): bump clickzetta-connector-python from 0.8.102 to 0.8.104 in /api (#25697) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-09-15 12:50:12 +09:00
dependabot[bot] 5548b22fe7
chore(deps): bump transformers from 4.53.3 to 4.56.1 in /api (#25696) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-09-15 12:49:26 +09:00
jyong 7eb8259e3d fix priority task 2025-09-15 11:44:13 +08:00
Guangdong Liu 07d383ffaa
refactor: update API routes and documentation for app and datasets endpoints (#25628) 2025-09-15 10:59:11 +08:00
Ritoban Dutta 67a686cf98
[Chore/Refactor] use __all__ to specify export member. (#25681) 2025-09-15 09:45:35 +08:00
ChasePassion a3f2c05632
optimize _merge_splits function by using enumerate instead of manual index tracking (#25680) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-15 09:41:16 +08:00
-LAN- b4ef1de30f
feat(graph_engine): add ready_queue state persistence to GraphRuntimeState 
- Add ReadyQueueState TypedDict for type-safe queue serialization
- Add ready_queue attribute to GraphRuntimeState for initializing with pre-existing queue state
- Update GraphEngine to load ready_queue from GraphRuntimeState on initialization
- Implement proper type hints using ReadyQueueState for better type safety
- Add comprehensive tests for ready_queue loading functionality

The ready_queue is read-only after initialization and allows resuming workflow
execution with a pre-populated queue of nodes ready to execute.
 2025-09-15 03:05:10 +08:00
jyong c08a60021a add dataset service api enable 2025-09-14 22:06:32 +08:00
jyong 815e5568c3 add dataset service api enable 2025-09-14 21:53:32 +08:00
jyong 80c32a130f add dataset service api enable 2025-09-14 20:43:49 +08:00
crazywoola c004988ecd
Fix wrong permission logic (#25649) 2025-09-14 18:44:12 +08:00
Guangdong Liu 7a626747cf
bugfix: The randomly generated email by Faker actually corresponded to an existing account in the test database, causing the test to fail. (#25646) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-09-14 18:41:35 +08:00
Asuka Minato 4f868275a9
example for __all__ (#25666) 2025-09-14 18:40:06 +08:00
NeatGuyCoding 0add1af1c8
feat: add test containers based tests for disable segments from index task (#25660) 2025-09-14 14:12:52 +08:00
autofix-ci[bot] 0f15a2baca
[autofix.ci] apply automated fixes 2025-09-13 20:20:53 +00:00
-LAN- 4cdc19fd05
feat(graph_engine): add abstract layer and dump / load methods for ready queue. 2025-09-14 04:19:24 +08:00
-LAN- efa5f35277
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-14 01:48:06 +08:00
Yongtao Huang 831548132e
Merge branch 'feat/rag-2' into fix-permission 2025-09-13 23:42:32 +08:00
Yongtao Huang ec87474d45 Fix worng permission logic 2025-09-13 23:40:59 +08:00
Yongtao Huang 8d0139bb21
Merge branch 'feat/rag-2' into fix-miss-import 2025-09-13 23:34:38 +08:00
Yongtao Huang bfb25ced7a Fix missing import of DataSourceOauthBinding 2025-09-13 23:32:07 +08:00
Yongtao Huang 188eb838c5
[Test] speed up Hypothesis strategies to avoid too_slow (#25623) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-13 21:05:19 +08:00
-LAN- 766fda395b
Merge branch 'main' into feat/queue-based-graph-engine 2025-09-13 19:37:52 +08:00
NeatGuyCoding a825f0f2b2
Feature add test containers disable segment from index task (#25631) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-13 14:28:10 +08:00
-LAN- b0e815c3c7
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-13 01:31:17 +08:00
-LAN- 1b0f92a331
feat(stress-test): add comprehensive stress testing suite using Locust (#25617) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-12 22:25:05 +08:00
Krito. a13d7987e0
chore: adopt StrEnum and auto() for some string-typed enums (#25129) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-09-12 21:14:26 +08:00
QuantumGhost 32a1a61d65 security(api): enforce privilege validation for dataset-to-pipeline transformation 
The transformation from classic dataset to knowledge pipeline represents an irreversible
write operation that permanently alters the dataset structure. To prevent unauthorized
modifications, this change implements strict privilege validation in `RagPipelineTransformApi`.

Only users with editor privileges or dataset operator roles are authorized to execute
this transformation, ensuring proper access control for this critical operation.
 2025-09-12 17:07:26 +08:00
jyong ad870de554 add dataset service api enable 2025-09-12 15:35:13 +08:00
kenwoodjw c91253d05d
fix segment deletion race condition (#24408) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-09-12 15:29:57 +08:00
Guangdong Liu 285291f545
refactor: update API routes and documentation for console endpoints (#25554) 2025-09-12 11:51:24 +08:00
QuantumGhost ac41151571 chore(api): remove unused installed_plugins.jsonl 2025-09-12 10:38:43 +08:00
Yeuoly ec808f3fe8
refactor: centralize default end user session ID constant (#25416) 
This PR refactors the handling of the default end user session ID by centralizing it as an enum in the models module where the `EndUser` model is defined. This improves code organization and makes the relationship between the constant and the model clearer.

Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-09-12 10:27:16 +08:00
zyssyz123 c2fcd2895b
Feat/email register refactor (#25369) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
 2025-09-12 10:24:54 +08:00
Ganondorf bb1514be2d
Force update search method to keyword_search (#25464) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-12 10:12:25 +08:00
Novice 17b5309e47
fix: single step system file error (#25533) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-09-12 09:47:45 +08:00
Asuka Minato 05af23f88f
use autospec=True in mock (#25497) 2025-09-12 09:46:02 +08:00
Yongtao Huang 4511f4f537
Remove redundant parse_args call in WorkflowByIdApi.patch (#25498) 2025-09-12 09:40:41 +08:00
Wu Tianwei 84e3571ec3
fix: delete get upload file endpoint (#25543) 
Co-authored-by: jyong <718720800@qq.com>
 2025-09-12 09:36:53 +08:00
NeatGuyCoding de18b14372
feat: add test containers based tests for delete segment from index task (#25564) 2025-09-12 09:33:39 +08:00
Yongtao Huang a1322ddb5d
Fix: correct has_more pagination logic in get_conversational_variable (#25484) 
Signed-off-by: Yongtao Huang<yongtaoh2022@gmail.com>
 2025-09-12 09:32:22 +08:00
GuanMu c7868fb176
test: remove print code (#25481) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-12 09:30:56 +08:00
-LAN- 462ba354a4
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-12 00:21:06 +08:00
NeatGuyCoding 99f4cd1cfa
feat: add test containers based tests for deal dataset vector index (#25545) 2025-09-11 21:12:53 +08:00
-LAN- 3c668e4a5c
fix: update test assertions for ToolProviderApiEntity validation 
- Fixed test_repack_provider_entity_no_dark_icon to use empty string instead of None for icon_dark field
- Updated test_builtin_provider_to_user_provider_no_credentials assertion to match actual implementation behavior where masked_credentials always contains empty strings for schema fields
 2025-09-11 16:41:10 +08:00
-LAN- 872cff7bab
chore(iteration_node): convert some Any to object 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-11 15:40:12 +08:00
-LAN- 8fb69429f9
feat(graph_engine): support parallel mode in iteration node 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-11 15:37:46 +08:00
-LAN- 85064bd8cf
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-11 15:13:31 +08:00
-LAN- ba5df3612b
fix: tests 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-11 15:13:18 +08:00
-LAN- a923ab1ab8
fix: type errors 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-11 15:01:16 +08:00
QuantumGhost 874406d934
security(api): fix privilege escalation vulnerability in model config and chat message APIs (#25518) 
The `ChatMessageApi` (`POST /console/api/apps/{app_id}/chat-messages`) and 
`ModelConfigResource` (`POST /console/api/apps/{app_id}/model-config`) 
endpoints do not properly validate user permissions, allowing users without `editor` 
permission to access restricted functionality.

This PR addresses this issue by adding proper permission check.
 2025-09-11 14:53:35 +08:00
-LAN- b4c1766932
fix: type errors 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 21:48:05 +08:00
-LAN- 00a1af8506
refactor(graph_engine): use singledispatch in Node 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 20:59:34 +08:00
Eric Guo 70e4d6be34
Fix 500 in dataset page. (#25474) 2025-09-10 15:57:04 +08:00
jyong c295b1d645 fix user_id missed 2025-09-10 13:50:12 +08:00
quicksand f56fccee9d
fix: workflow knowledge query raise error (#25465) 2025-09-10 13:47:47 +08:00
Asuka Minato cbc0e639e4
update sql in batch (#24801) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 13:00:17 +08:00
Guangdong Liu b51c724a94
refactor: Migrate part of the console basic API module to Flask-RESTX (#24732) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 12:15:47 +08:00
GuanMu 26a9abef64
test: imporve (#25461) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-10 11:36:22 +08:00
Will fecdb9554d
fix: inner_api get_user_tenant (#25462) 2025-09-10 11:31:16 +08:00
NeatGuyCoding 45ef177809
Feature add test containers create segment to index task (#25450) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-10 10:02:53 +08:00
Newton José 6574e9f0b2
Fix: Add Password Validation to Account Creation (#25382) 2025-09-10 08:58:39 +08:00
Asuka Minato cce13750ad
add rule for strenum (#25445) 2025-09-10 08:51:21 +08:00
-LAN- b6b98a2c8e
Merge branch 'feat/dispatch-method' into feat/queue-based-graph-engine 2025-09-10 03:12:59 +08:00
-LAN- 7e69403dda
refactor(graph_engine): use singledispatchmethod in event_handler 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 03:12:33 +08:00
-LAN- 9796cede72
fix: add missing type field to node configurations in integration tests 
- Added 'type' field to all node data configurations in test files
- Fixed test_code.py: added 'type: code' to all code node configs
- Fixed test_http.py: added 'type: http-request' to all HTTP node configs
- Fixed test_template_transform.py: added 'type: template-transform' to template node config
- Fixed test_tool.py: added 'type: tool' to all tool node configs
- Added setup_code_executor_mock fixture to test_execute_code_scientific_notation

These changes fix the ValueError: 'Node X missing or invalid type information' errors
that were occurring due to changes in the node factory validation requirements.
 2025-09-10 02:54:01 +08:00
-LAN- 836ed1f380
refactor(graph_engine): Move ErrorHandler into a single file package 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 02:35:05 +08:00
-LAN- 80f39963f1
chore: add import lint to CI 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 02:32:24 +08:00
-LAN- 9cf2b2b231
fix: type errors 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 02:22:58 +08:00
-LAN- 2a97a69825
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-10 02:03:45 +08:00
-LAN- f17c71e08a
refactor(graph_engine): Move GraphStateManager to single file package. 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 01:55:30 +08:00
-LAN- 08dd3f7b50
Fix basedpyright type errors (#25435) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-10 01:54:26 +08:00
-LAN- d52621fce3
refactor(graph_engine): Merge error strategies into error_handler.py 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 01:49:46 +08:00
-LAN- e060d7c28c
refactor(graph_engine): remove Optional 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 01:49:15 +08:00
-LAN- ea5dfe41d5
chore: ignore comment 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-10 01:36:11 +08:00
-LAN- a23c8fcb1a
refactor: move execution limits from engine core to layer 
Remove max_execution_time and max_execution_steps from ExecutionContext and GraphEngine since these limits are now handled by ExecutionLimitsLayer. This follows the separation of concerns principle by keeping execution limits as a cross-cutting concern handled by layers rather than embedded in core engine components.

Changes:
- Remove max_execution_time and max_execution_steps from ExecutionContext
- Remove these parameters from GraphEngine.__init__()
- Remove max_execution_time from Dispatcher
- Update workflow_entry.py to no longer pass these parameters
- Update all tests to remove these parameters
 2025-09-10 01:32:45 +08:00
-LAN- e0e82fbfaa
refactor: extract _run method into smaller focused methods in IterationNode 
- Extract iterator variable retrieval and validation logic
- Separate empty iteration handling
- Create dedicated methods for iteration execution and result handling
- Improve type hints and use modern Python syntax
- Enhance code readability and maintainability
 2025-09-10 01:15:36 +08:00
-LAN- 1c9f40f92a
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-09 22:16:59 +08:00
-LAN- 6ffa2ebabf
feat: improve error handling in graph node creation 
- Replace ValueError catch with generic Exception
- Use logger.exception for automatic traceback logging
- Abort on node creation failure instead of continuing
 2025-09-09 22:16:42 +08:00
-LAN- 48e32e285e
fix: migration 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-09 21:41:03 +08:00
Yongtao Huang 2ac7a9c8fc
Chore: thanks to bump-pydantic (#25437) 2025-09-09 20:07:17 +08:00
Novice 240b65b980
fix(mcp): properly handle arrays containing both numbers and strings (#25430) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-09 20:06:35 +08:00
QuantumGhost 6637b9efda fix(api): Fix incorrect import of `ToolProviderID` 2025-09-09 17:42:42 +08:00
-LAN- 95dc1e2fe8
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-09 17:13:16 +08:00
-LAN- 7443c5a6fc
refactor: update pyrightconfig to scan all API files (#25429) 2025-09-09 17:12:45 +08:00
GuanMu a1cf48f84e
Add lib test (#25410) 2025-09-09 17:11:49 +08:00
-LAN- 6fe7cf5ebf
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-09 17:11:46 +08:00
jyong fc8adb9d6c fix ruff 2025-09-09 17:07:22 +08:00
Asuka Minato 38057b1b0e
add typing to all wraps (#25405) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-09 16:48:33 +08:00
twwu 045d07885d Merge branch 'main' into fix/value-content-rerender-error 2025-09-09 16:40:08 +08:00
-LAN- a1e8ac4c96
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-09 15:49:09 +08:00
ttz12345 d2e50a508c
Fix:About the error problem of creating an empty knowledge base interface in service_api (#25398) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-09-09 15:18:31 +08:00
Yongtao Huang 4aba570fa8
Fix flask response: 200 -> {}, 200 (#25404) 2025-09-09 15:06:18 +08:00
Novice e180c19cca
fix(mcp): current_user not being set in MCP requests (#25393) 2025-09-09 14:58:14 +08:00
Xiyuan Chen 64c9a2f678
Feat/credential policy (#25151) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-08 23:45:05 -07:00
Novice 566e0fd3e5
fix(container-test): batch create segment position sort (#25394) 2025-09-09 13:47:29 +08:00
-LAN- b46858d87d
Merge branch 'main' into feat/queue-based-graph-engine 2025-09-09 13:33:17 +08:00
NeatGuyCoding 7dfb72e381
feat: add test containers based tests for clean notion document task (#25385) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-09 11:02:19 +08:00