opensource
/
dify
mirror of https://github.com/langgenius/dify.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,172 Commits 298 Branches 160 Tags 439 MiB
Commit Graph

548 Commits

Author SHA1 Message Date
-LAN- e229510e73
perf: eliminate lock contention in worker pool by removing callbacks 
Remove worker idle/active callbacks that caused severe lock contention.
Instead, use sampling-based monitoring where worker states are queried
on-demand during scaling decisions. This eliminates the performance
bottleneck caused by workers acquiring locks 10+ times per second.

Changes:
- Remove callback parameters from Worker class
- Add properties to expose worker idle state directly
- Update WorkerPool to query worker states without callbacks
- Maintain scaling functionality with better performance
 2025-09-04 19:37:31 +08:00
-LAN- 36048d1526
feat(graph_engine): allow to scale down without lock 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 19:32:07 +08:00
-LAN- aff7ca12b8
fix(code_node): type checking bypass 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 19:25:08 +08:00
-LAN- ad9eed2551
fix: disable scale for perfermance 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 19:11:22 +08:00
-LAN- 2aeaefccec
test: fix test 2025-09-04 17:47:36 +08:00
-LAN- 4d63bd2083
refactor(graph_engine): rename SimpleWorkerPool to WorkerPool 2025-09-04 17:47:13 +08:00
-LAN- 226f14a20f
feat(graph_engine): implement scale down worker 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 15:35:20 +08:00
autofix-ci[bot] 2b28aed4e2
[autofix.ci] apply automated fixes 2025-09-04 04:50:21 +00:00
-LAN- ead8568bfc
fix: some errors reported by basedpyright 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 11:58:54 +08:00
-LAN- 04bbf540d9
chore: code format 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 02:33:53 +08:00
-LAN- 657c27ec75
feat(graph_engine): make runtime state read-only in layer 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 02:30:40 +08:00
-LAN- 16e9cd5ac5
feat(graph_runtime_state): prevent to set variable pool after initialized. 2025-09-04 02:20:19 +08:00
-LAN- 8332472944
refactor(graph_engine): rename Layer to GraphEngineLayer 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-04 02:11:31 +08:00
-LAN- fe3f03e50a
feat: add property-based access control to GraphRuntimeState 
- Replace direct field access with private attributes and property decorators
- Implement deep copy protection for mutable objects (dict, LLMUsage)
- Add helper methods: set_output(), get_output(), update_outputs()
- Add increment_node_run_steps() and add_tokens() convenience methods
- Update loop_node and event_handlers to use new accessor methods
- Add comprehensive unit tests for immutability and validation
- Ensure backward compatibility with existing property access patterns
 2025-09-04 02:08:58 +08:00
-LAN- f6acff4cce
chore: remove unused variables 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-03 12:12:27 +08:00
-LAN- b81745aed8
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-03 11:56:05 +08:00
-LAN- 9d5956cef8
[Chore/Refactor] Switch from MyPy to Basedpyright for type checking (#25047) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-03 11:52:26 +08:00
-LAN- 77a9a73d0d
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-03 01:33:17 +08:00
Bowen Liang 7b379e2a61
chore: apply ty checks on api code with script and ci action (#24653) 2025-09-02 16:05:13 +08:00
-LAN- 1770b93e5b
chore(graph_engine): Add a TODO commment in `_update_response_outputs` in event_handlers 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-02 15:20:03 +08:00
-LAN- d8ff4aa9ba
feat(graph_engine): Handle NodeRunAgentLogEvent 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-02 15:02:07 +08:00
-LAN- 9f8f21bf87
chore: remove backup files 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-02 15:01:58 +08:00
-LAN- a32dde5428
Fix: Resolve workflow_node_execution primary key conflicts with UUID v7 (#24643) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-02 14:18:29 +08:00
-LAN- 0b0dc63f29
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-09-02 11:52:25 +08:00
Yongtao Huang be3af1e234
Migrate SQLAlchemy from 1.x to 2.0 with automated and manual adjustments (#23224) 
Co-authored-by: Yongtao Huang <99629139+hyongtao-db@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2025-09-02 10:30:19 +08:00
Frederick2313072 5b3cc560d5
fix:hard-coded top-k fallback issue. (#24879) 2025-09-01 15:46:37 +08:00
willzhao ffba341258
[CHORE]: remove redundant-cast (#24807) 2025-09-01 14:05:32 +08:00
-LAN- 8433cf4437
refactor(graph_engine): Merge event_collector and event_emitter into event_manager 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 13:15:58 +08:00
-LAN- bb5d52539c
refactor(graph_engine): Merge branch_handler into edge_processor 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 12:53:06 +08:00
-LAN- 88622f70fb
refactor(graph_engine): Move setup methods into `__init__` 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 12:08:03 +08:00
-LAN- 0fdb1b2bc9
refactor(graph_engine): Correct private attributes and private methods naming 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 04:37:23 +08:00
-LAN- a5cb9d2b73
refactor(graph_engine): inline output_registry into response_coordinator 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 03:59:53 +08:00
-LAN- 64c1234724
refactor(graph_engine): Merge worker management into one WorkerPool 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 03:23:47 +08:00
-LAN- 202fdfcb81
refactor(graph_engine): Remove backward compatibility code 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 02:41:16 +08:00
-LAN- e2f4c9ba8d
refactor(graph_engine): Merge state managers into unified_state_manager 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-09-01 02:08:08 +08:00
Yongtao Huang 72acd9b483
Remove redundant from_variable_selector null-check (#24842) 2025-08-31 17:00:13 +08:00
-LAN- 82193580de
chore: improve typing 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-08-30 16:35:57 +08:00
-LAN- f2bc4f5d87
fix: resolve type error in node_factory by using type guard for node_type_str 2025-08-29 16:16:58 +08:00
-LAN- dce4d0ff80
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine 2025-08-29 13:22:13 +08:00
-LAN- 3dee8064ba
feat: enhance typing 2025-08-29 13:17:02 +08:00
Will c4496e6cf2
chore: use DataFrame.map instead of deprecated DataFrame.applymap (#24726) 2025-08-28 21:13:47 +08:00
-LAN- bfbb36756a
feat(graph_engine): Add NodeExecutionType.ROOT and auto mark skipped in Graph.init 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-08-28 16:41:51 +08:00
-LAN- d7e0c5f759
chore: use 'XXX | None' instead of Optional[XXX] in graph.py 2025-08-28 15:45:22 +08:00
-LAN- c396788128
chore(graph_engine): add final mark to classes 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-08-28 15:38:35 +08:00
湛露先生 5c01dd97e8
clean typos words. (#24667) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-08-28 15:23:59 +08:00
-LAN- e3a7b1f691
fix: type hints 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-08-28 05:24:18 +08:00
-LAN- 8aab7f49c3
chore(graph_engine): Use `XXX | None` instead of `Optional[XXX]` 2025-08-28 05:09:33 +08:00
autofix-ci[bot] 1e12c1cbf2
[autofix.ci] apply automated fixes 2025-08-27 21:00:36 +00:00
-LAN- affedd6ce4
chore(graph_engine): Use `XXX | None` instead of `Optional[XXX]` 2025-08-28 04:59:49 +08:00
-LAN- ef21097774
refactor(graph_engine): Remove unnecessary check from SkipPropagator 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-08-28 04:45:26 +08:00