e229510e73
perf: eliminate lock contention in worker pool by removing callbacks
...
Remove worker idle/active callbacks that caused severe lock contention.
Instead, use sampling-based monitoring where worker states are queried
on-demand during scaling decisions. This eliminates the performance
bottleneck caused by workers acquiring locks 10+ times per second.
Changes:
- Remove callback parameters from Worker class
- Add properties to expose worker idle state directly
- Update WorkerPool to query worker states without callbacks
- Maintain scaling functionality with better performance
2025-09-04 19:37:31 +08:00
36048d1526
feat(graph_engine): allow to scale down without lock
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 19:32:07 +08:00
aff7ca12b8
fix(code_node): type checking bypass
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 19:25:08 +08:00
ad9eed2551
fix: disable scale for perfermance
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 19:11:22 +08:00
07109846e0
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-04 17:48:08 +08:00
2aeaefccec
test: fix test
2025-09-04 17:47:36 +08:00
4d63bd2083
refactor(graph_engine): rename SimpleWorkerPool to WorkerPool
2025-09-04 17:47:13 +08:00
226f14a20f
feat(graph_engine): implement scale down worker
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 15:35:20 +08:00
804e599598
fix: EndUser not bound to Session when plugin invokes callback ( #25132 )
2025-09-04 13:59:34 +08:00
2b28aed4e2
[autofix.ci] apply automated fixes
2025-09-04 04:50:21 +00:00
938a845852
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-04 12:48:58 +08:00
ead8568bfc
fix: some errors reported by basedpyright
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 11:58:54 +08:00
cdf9b674dc
chore: Bump weaviate-client to latest v3 version ( #25096 )
2025-09-04 11:15:36 +08:00
0a0ae16bd6
fix: old custom model not display credential name ( #25112 )
2025-09-04 10:46:10 +08:00
ac057a2d40
Chore: remove dead code in class Graph ( #22791 )
...
Co-authored-by: Yongtao Huang <99629139+hyongtao-db@users.noreply.github.com>
2025-09-04 10:30:04 +08:00
3427f19a01
chore: improved trace info for generating conversation name ( #25118 )
2025-09-04 10:29:12 +08:00
53c4a8787f
[Chore/Refactor] Improve type safety and resolve type checking issues ( #25104 )
2025-09-04 09:35:32 +08:00
04bbf540d9
chore: code format
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 02:33:53 +08:00
657c27ec75
feat(graph_engine): make runtime state read-only in layer
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 02:30:40 +08:00
16e9cd5ac5
feat(graph_runtime_state): prevent to set variable pool after initialized.
2025-09-04 02:20:19 +08:00
8332472944
refactor(graph_engine): rename Layer to GraphEngineLayer
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-04 02:11:31 +08:00
fe3f03e50a
feat: add property-based access control to GraphRuntimeState
...
- Replace direct field access with private attributes and property decorators
- Implement deep copy protection for mutable objects (dict, LLMUsage)
- Add helper methods: set_output(), get_output(), update_outputs()
- Add increment_node_run_steps() and add_tokens() convenience methods
- Update loop_node and event_handlers to use new accessor methods
- Add comprehensive unit tests for immutability and validation
- Ensure backward compatibility with existing property access patterns
2025-09-04 02:08:58 +08:00
9c96b23d55
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-04 00:27:08 +08:00
db53656a45
Fix jsonschema compliance: use number instead of float ( #25049 )
...
Signed-off-by: Yongtao Huang<yongtaoh2022@gmail.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-03 22:27:41 +08:00
ff7a0e3170
fix: improve error logging for vector search operation in MyScale ( #25087 )
2025-09-03 22:24:45 +08:00
67cc70ad61
fix: model credential name ( #25081 )
...
Co-authored-by: hjlarry <hjlarry@163.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-03 18:23:57 +08:00
a384ae9140
Fix advanced chat workflow event handler signature mismatch ( #25078 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-03 16:22:13 +08:00
dabf266048
Fix: handle 204 No Content response in MCP client ( #25040 )
2025-09-03 15:22:42 +08:00
462e764a3c
typevar example ( #25064 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-03 14:54:38 +08:00
8c97937cae
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-03 13:53:43 +08:00
b673560b92
feat: improve multi model credentials ( #25009 )
...
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-03 13:52:31 +08:00
f6acff4cce
chore: remove unused variables
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-03 12:12:27 +08:00
b81745aed8
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-03 11:56:05 +08:00
9d5956cef8
[Chore/Refactor] Switch from MyPy to Basedpyright for type checking ( #25047 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-03 11:52:26 +08:00
1fff4620e6
clean console apis and rag cleans. ( #25042 )
...
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-03 11:25:18 +08:00
8c41d95d03
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-03 11:06:42 +08:00
bc9efa7ea8
Refactor: use DatasourceType.XX.value instead of hardcoded ( #25015 )
...
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-03 08:56:48 +08:00
77a9a73d0d
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-03 01:33:17 +08:00
b5216df4fe
fix: xxx is not bound to a Session ( #24966 )
2025-09-02 21:37:06 +08:00
8fcc864fb7
Post fix of #23224 ( #25007 )
2025-09-02 20:59:08 +08:00
7b379e2a61
chore: apply ty checks on api code with script and ci action ( #24653 )
2025-09-02 16:05:13 +08:00
1770b93e5b
chore(graph_engine): Add a TODO commment in `_update_response_outputs` in event_handlers
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-02 15:20:03 +08:00
d8ff4aa9ba
feat(graph_engine): Handle NodeRunAgentLogEvent
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-02 15:02:07 +08:00
9f8f21bf87
chore: remove backup files
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-09-02 15:01:58 +08:00
deea07e905
make clean() function in index_processor_base abstractmethod ( #24959 )
...
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-02 14:48:45 +08:00
a32dde5428
Fix: Resolve workflow_node_execution primary key conflicts with UUID v7 ( #24643 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-02 14:18:29 +08:00
0b0dc63f29
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-02 11:52:25 +08:00
ca96350707
chore: optimize SQL queries that perform partial full table scans ( #24786 )
2025-09-02 11:46:11 +08:00
be3af1e234
Migrate SQLAlchemy from 1.x to 2.0 with automated and manual adjustments ( #23224 )
...
Co-authored-by: Yongtao Huang <99629139+hyongtao-db@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-02 10:30:19 +08:00
f7ac1192ae
replace the secret field from obfuscated to full-masked value ( #24800 )
...
Co-authored-by: charles liu <dearcharles.liu@gmail.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-02 09:19:20 +08:00
-LAN-