opensource/dify
2
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-04-08 09:16:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
7,460 Commits 446 Branches 169 Tags 665 MiB
f3f3a99e5b
Commit Graph

4235 Commits

Author SHA1 Message Date
NeatGuyCoding
6f8c7a66c8
feat: add redis fallback mechanism #21043 (#21044) 
Co-authored-by: tech <cto@sb>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-07-10 10:19:58 +08:00
luckylhb90
a371390d6c
optimize: batch embedding and qdrant write_consistency_factor parameter (#21776) 
Co-authored-by: hobo.l <hobo.l@binance.com>
 2025-07-10 10:16:59 +08:00
twwu
e2a141b3bb Merge branch 'main' into feat/rag-2 2025-07-10 10:14:12 +08:00
Jason Young
881a151d30
test: add comprehensive unit tests for encrypter module (#22102) 2025-07-10 10:01:15 +08:00
wangsen3
b237113311
Update clean_document_task.py (#22090) 2025-07-10 09:18:50 +08:00
jyong
8b97551f1a r2 2025-07-09 18:50:13 +08:00
-LAN-
4cb50f1809
feat(libs): Introduce extract_tenant_id (#22086) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-07-09 17:45:56 +08:00
jyong
bd33b9ffec r2 2025-07-09 17:34:42 +08:00
jyong
b538eee5dd r2 2025-07-09 17:28:52 +08:00
twwu
258c965bd0 Merge branch 'feat/rag-2' of https://github.com/langgenius/dify into feat/rag-2 2025-07-09 15:55:31 +08:00
twwu
9e44f2b805 Merge branch 'main' into feat/rag-2 2025-07-09 15:54:57 +08:00
wlleiiwang
89b52471fb
Optimize the memory usage of Tencent Vector Database (#22079) 
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
 2025-07-09 15:53:06 +08:00
jyong
9dcba51225 r2 2025-07-09 15:48:08 +08:00
Minamiyama
3643ed1014
Feat: description field for env variables (#21556) 2025-07-09 15:18:23 +08:00
jyong
b5e4ce6c68 r2 2025-07-09 14:27:49 +08:00
Yongtao Huang
521488f926
Remove tow unused files (#22022) 2025-07-09 09:28:26 +08:00
Jason Young
d61ea5a2de
test: add comprehensive unit tests for UrlSigner (#22030) 2025-07-08 21:22:37 +08:00
Davide Delbianco
816210d744
Expose LLM usage in workflows (#21766) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-07-08 21:18:00 +08:00
jyong
bc1a517a97 r2 2025-07-08 17:16:10 +08:00
jyong
db886ae3fb r2 2025-07-08 14:04:44 +08:00
Jason Young
5c0cb7f912
test: add unit tests for password validation and hashing (#22003) 2025-07-08 10:00:00 +08:00
NeatGuyCoding
2ffbf5435d
minro fix: fix duplicate local import of ToolProviderType (#22013) 
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
 2025-07-08 09:49:53 +08:00
NeatGuyCoding
53c4912cbb
feat: add unit tests and validation for aliyun tracing (#22012) 
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
 2025-07-08 09:32:30 +08:00
NeatGuyCoding
1760179093
minro fix: fix a typo for aliyun (#22001) 
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
 2025-07-07 22:04:38 +08:00
Yongtao Huang
de54f8d0ef
Chore: remove unreachable code (#21986) 2025-07-07 21:55:34 +08:00
quicksand
5b0b64c7e5
fix: document delete image files check file exist (#21991) 2025-07-07 21:53:40 +08:00
-LAN-
8f723697ef
refactor(graph_engine): Take GraphRuntimeState out of GraphEngine (#21882) 2025-07-07 13:15:18 +08:00
baonudesifeizhai
b9f56852dc
fix: resolve JSON.parse precision issue causing 'list index out of ra… (#21253) 2025-07-07 10:05:54 +08:00
baonudesifeizhai
108cc3486f
fix(agent): show agent run steps, fixes #21718 (#21945) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-07-07 09:59:47 +08:00
NeatGuyCoding
ac69b8b191
refactor: extract common url validator for config_entity.py (#21934) 
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
 2025-07-07 09:34:13 +08:00
heyszt
a201e9faee
feat: Add Aliyun LLM Observability Integration (#21471) 2025-07-04 21:54:33 +08:00
jyong
1fb59adba9 r2 2025-07-04 19:09:40 +08:00
jyong
9c6eb95700 r2 2025-07-04 18:49:37 +08:00
jyong
a8b676ade0 r2 2025-07-04 18:05:58 +08:00
NeatGuyCoding
2639f950cc
minor fix: removes the duplicated handling logic for TracingProviderEnum.ARIZE and TracingProviderEnum.PHOENIX from the OpsTraceProviderConfigMap (#21927) 
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
 2025-07-04 16:46:48 +08:00
Bowen Liang
6663187eca
test:add unit test for api version config (#21919) 2025-07-04 15:33:20 +08:00
Ganondorf
c9c49200e0
use repair_json fix json parse error of HTTPRequestNode (#21909) 
Co-authored-by: lizb <lizb@sugon.com>
 2025-07-04 14:01:17 +08:00
jyong
44c2efcfe4 r2 2025-07-03 18:56:42 +08:00
非法操作
a79f37b686
fix: tts tool must choose a voice (#21877) 2025-07-03 17:10:01 +08:00
baonudesifeizhai
1c7404099d
fix: prevent timeout in file encoding detection for large files (#21453) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-07-03 17:06:49 +08:00
jyong
798d0880d6 r2 2025-07-03 15:15:01 +08:00
cutiechi
47954aa284
feat(api): validate and reject external datasets in document update (#21783) 2025-07-03 14:50:53 +08:00
Novice
f3c8625fe2
fix: The statistics page cannot display the tokens consumed by agent node (#21861) 2025-07-03 14:40:47 +08:00
jyong
76c418c0b7 r2 2025-07-03 14:03:06 +08:00
NeatGuyCoding
ebc4fdc4b2
moving the MessageStatus class from the models.model module to models.enums module (#21867) 
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
 2025-07-03 13:56:23 +08:00
Ali Saleh
1af3d40c1a
feat: Improve Observability with Arize & Phoenix Integration (#19840) 
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Gu <guchenhe@gmail.com>
 2025-07-03 13:52:14 +08:00
jiangbo721
31eb8548ef
fix: Before publish the app, preview the voice of tts, it raise an er… (#21821) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-07-03 10:53:14 +08:00
Yeuoly
980b0188d2
feat(tests): add structured output parser tests for LLM responses (#21838) 2025-07-03 09:10:04 +08:00
jiangbo721
e17b33e004
chore: add message status enum (#21825) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-07-02 21:22:28 +08:00
Yeuoly
5487463385
fix: add list contents handling in structured LLM output (#21837) 2025-07-02 19:14:21 +08:00
jyong
38d895ab5f r2 2025-07-02 18:46:36 +08:00
jyong
a6ff9b224b r2 2025-07-02 18:20:41 +08:00
jyong
832bef053f Merge branch 'main' into feat/r2 
# Conflicts:
#	docker/docker-compose.middleware.yaml
#	web/app/components/workflow-app/components/workflow-main.tsx
#	web/app/components/workflow-app/hooks/index.ts
#	web/app/components/workflow/hooks-store/store.ts
#	web/app/components/workflow/hooks/index.ts
#	web/app/components/workflow/nodes/_base/components/variable/var-reference-picker.tsx
 2025-07-02 18:20:05 +08:00
jyong
81b07dc3be r2 2025-07-02 18:15:23 +08:00
Bowen Liang
cc89d7b1a5
remove unused config CURRENT_VERSION (#21832) 
as API module's version code refactored into pyproject.toml file in refactor: define the Dify project version in pyproject.toml #20910, the deprecated CURRENT_VERSION is no longger used and should be removed.
 2025-07-02 17:22:22 +08:00
-LAN-
bb955806e0
chore(version): bump to 1.5.1 (#21808) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-07-02 16:17:40 +08:00
efrey kong
826bf25abf
Fix: prevent SQL errors when metadata filter Constant value is None or blank (#21803) 2025-07-02 14:43:01 +08:00
jyong
e23d7e39ec Merge branch 'feat/datasource' into feat/r2 
# Conflicts:
#	api/services/rag_pipeline/rag_pipeline.py
#	web/app/components/workflow/constants.ts
#	web/app/components/workflow/header/run-and-history.tsx
#	web/app/components/workflow/hooks/use-nodes-interactions.ts
#	web/app/components/workflow/hooks/use-workflow-interactions.ts
#	web/app/components/workflow/hooks/use-workflow.ts
#	web/app/components/workflow/index.tsx
#	web/app/components/workflow/nodes/_base/components/panel-operator/panel-operator-popup.tsx
#	web/app/components/workflow/nodes/_base/panel.tsx
#	web/app/components/workflow/nodes/code/use-config.ts
#	web/app/components/workflow/nodes/llm/default.ts
#	web/app/components/workflow/panel/index.tsx
#	web/app/components/workflow/panel/version-history-panel/index.tsx
#	web/app/components/workflow/store/workflow/index.ts
#	web/app/components/workflow/types.ts
#	web/config/index.ts
#	web/types/workflow.ts
 2025-07-02 14:01:59 +08:00
QuantumGhost
89250a36b7
fix(api): files not returned in the answer node (#21807) 2025-07-02 13:54:10 +08:00
QuantumGhost
c2e599cd85
fix(api): Fix resetting sys var causing internal server error (#21604) 
and sorts draft variables by their creation time, ensures a consist order.
 2025-07-02 13:36:35 +08:00
jiangbo721
71d6cf1b1d
fix: Make the latency and logs of web applications consistent. (#21578) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-07-02 12:04:33 +08:00
jyong
9f14b5db9a r2 2025-07-02 11:55:21 +08:00
jyong
39d3f58082 r2 2025-07-02 11:33:00 +08:00
Davide Delbianco
c4b960cc1a
Improve Langfuse trace readability (#21777) 2025-07-02 09:15:24 +08:00
NeatGuyCoding
a82943a83d
minor fix: add parameters in error msg of Plugin service returned no options (#21662) 2025-07-01 22:58:59 +08:00
jiangbo721
9a4c1fe834
fix: if parameter is not required, continue (#21761) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-07-01 21:25:45 +08:00
Bowen Liang
b9ff716c18
fix: incorrect api module version in pyproject.toml (#21755) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-07-01 17:12:52 +08:00
baonudesifeizhai
8516d15a4e
fix: handle configure button for notion internal integration (#21412) 2025-07-01 16:58:00 +08:00
quicksand
4198a533ad
fix: code Interpreter error handling not work (#21736) 2025-07-01 16:16:34 +08:00
jyong
f33b6c0c73 add online drive 2025-07-01 16:08:54 +08:00
jyong
a4eddd7dc2 r2 2025-07-01 15:16:33 +08:00
jyong
c993a05da7 Merge remote-tracking branch 'origin/feat/r2' into feat/r2 2025-07-01 14:23:58 +08:00
jyong
f44f0fa34c r2 2025-07-01 14:23:46 +08:00
Dongyu Li
bfcf09b684 feat(datasource): fix datasource icon 2025-07-01 14:04:09 +08:00
Bowen Liang
1a7ad195f0
refactor: define the Dify project version in pyproject.toml (#20910) 2025-07-01 12:07:24 +08:00
Qiang Lee
cf2173644e
Release db.session connection before workflow new thread long time operation (#21726) 
Co-authored-by: 李强04 <liqiang04@gaotu.cn>
 2025-07-01 12:05:29 +08:00
Dongyu Li
cdbba1400c feat(datasource): update fetch_datasource_provider 2025-07-01 11:57:06 +08:00
YoungLH
b8b9c3a783
fix: set the func.coalesce() second paramter default value #21239 (#21240) 
Signed-off-by: YoungLH <974840768@qq.com>
 2025-07-01 11:31:14 +08:00
Han
69b6f6f5d2
Fixes issue 21157/20661 extra quote in agent node (#21674) 
Co-authored-by: Wang Han <wanghan@zhejianglab.org>
 2025-07-01 10:43:46 +08:00
Qiang Lee
9ded6f6a40
[fix] #21678 User input of remote file link on the run page form causes conversation/message interface error (#21683) 
Co-authored-by: 李强04 <liqiang04@gaotu.cn>
 2025-07-01 10:40:39 +08:00
Ganondorf
55a6b330ec
Add get document detail service api (#21700) 
Co-authored-by: lizb <lizb@sugon.com>
 2025-06-30 22:13:56 +08:00
jyong
618ad4c291 r2 2025-06-30 15:36:20 +08:00
Harry
1449ed86c4 feat: rename online driver to online drive and update related classes and methods :) 2025-06-27 20:11:28 +08:00
Xin Zhang
37e19de7ab
feat(inner-api/workspace): include tenant details in CreateWorkspace response (#21636) 2025-06-27 18:28:03 +08:00
湛露先生
28f5c37211
Add Env 'CELERY_SENTINEL_PASSWORD' for celery connect redis sentinel. (#21198) 2025-06-27 17:37:11 +08:00
Harry
eee72101f4 feat(online_driver): add online driver plugin, support browsing and downloading 2025-06-27 16:41:39 +08:00
Yeuoly
87efe45240
feat(plugin): Add API endpoint for invoking LLM with structured output (#21624) 2025-06-27 15:57:44 +08:00
Yeuoly
0cb00d5fd2
refactor: move structured output support outside LLM Node (#21565) 
Co-authored-by: Novice <novice12185727@gmail.com>
 2025-06-27 14:55:31 +08:00
wanttobeamaster
cdb9eecbaf
fix: Resolving conflicts caused by tablestore dependency on enum34 (#21605) 
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
 2025-06-27 14:17:52 +08:00
Khoa
a06af88b26
Feat/api validate model provider (#21582) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-27 09:59:44 +08:00
NeatGuyCoding
33f0457a23
fix: wrong token number when using qa_model and answer is updated. (#21574) 2025-06-27 09:11:41 +08:00
Yeuoly
cea6522122
feat: add DYNAMIC_SELECT parameter type for dynamic options in parameter entities (#21425) 2025-06-26 17:44:14 +08:00
jiangbo721
cefb8e4218
chore: Simplify code logic (#21496) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-06-26 10:09:52 +08:00
jiangbo721
90aba77471
chore: remove unused code (#21497) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-06-26 10:08:17 +08:00
NeatGuyCoding
785d4b3de7
feat: refactor: test_dataset unit tests #21499 (#21502) 2025-06-26 10:07:54 +08:00
NeatGuyCoding
6bb82f8ee0
Fix minor comment missing (#21517) 2025-06-26 10:06:49 +08:00
Xiyuan Chen
d454f09e13
feat: add a magic field in the cancel invite api response (#21505) 2025-06-25 18:37:56 +08:00
Dongyu Li
00f0b569cc
Feat/kb index (#20868) 
Co-authored-by: twwu <twwu@dify.ai>
 2025-06-25 17:52:59 +08:00
jyong
efccbe4039 r2 2025-06-25 17:32:26 +08:00
-LAN-
3acaa59885
fix(update_provider_when_message_created): Fix db transaction (#21503) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-25 17:23:45 +08:00
-LAN-
2d5cdbe79c
chore(version): Bump to 1.5.0 (#21415) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-25 16:54:44 +08:00
-LAN-
8f15341f1e
fix(event_handlers): DB dead lock (#21468) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-25 16:20:37 +08:00
Maries
1dd2607dfd
feat(oauth): refactor proxy context (#21483) 2025-06-25 15:10:45 +08:00
jyong
540096a8d8 Merge branch 'main' into feat/r2 
# Conflicts:
#	api/core/plugin/impl/oauth.py
#	api/core/workflow/entities/variable_pool.py
#	api/models/workflow.py
#	api/services/dataset_service.py
 2025-06-25 14:35:23 +08:00
Maries
164e5481c5
feat(oauth): plugin oauth service (#21480) 2025-06-25 14:14:30 +08:00
AuditAIH
a098825fcc
Update smtp.py (#21335) 2025-06-25 13:50:35 +08:00
jyong
7b7cdad1d8 r2 2025-06-25 13:28:08 +08:00
QuantumGhost
268da31332
fix(api): adding variable to variable pool recursively while loading draft variables. (#21478) 
This PR fix the issue that `ObjectSegment` are not recursively added to the draft variable pool while loading draft variables from database. It also fixes an issue about loading variables with more than two elements in the its selector.

Enhances #19735.
Closes #21477.
 2025-06-25 12:39:22 +08:00
NeatGuyCoding
94f8e48647
Refactor update dataset (fix #21401) (#21402) 
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-06-25 11:44:35 +08:00
-LAN-
c7ee0f2a93
fix(knowledge_base): Unchecked metadata name length (#21454) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-25 10:18:20 +08:00
jiangbo721
9de552cb42
fix: first message query error (#21444) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-06-24 20:32:50 +08:00
QuantumGhost
501d3b6203
feat(api): Explicitly define version method for all BaseNode subclasses (#21443) 
This PR addresses issue #21441 by implementing explicit `version` method definitions for all `BaseNode` subclasses to improve code maintainability.

### Changes

Added explicit `version` method definitions for all `BaseNode` subclasses:

- `QuestionClassifierNode`
- `KnowledgeRetrievalNode` 
- `AgentNode`

Added comprehensive test suite to validate:

1. All subclasses of `BaseNode` have explicitly defined `version` method
2. All subclasses have required `_node_type` property
3. The `(node_type, node_version)` combination is unique across all subclasses
 2025-06-24 20:27:22 +08:00
Dongyu Li
6aba39a2dd feat(datasource): add datasource content preview api 2025-06-24 17:43:25 +08:00
Dongyu Li
49bb15fae1 feat(datasource): add datasource content preview api 2025-06-24 17:14:31 +08:00
Dongyu Li
e165f4a102 feat(datasource): add datasource content preview api 2025-06-24 17:14:16 +08:00
Jyong
d60287621a
add dataset info in response (#21413) 2025-06-24 16:07:31 +08:00
quicksand
45146edb31
fix(document_extractor): xlsx file column int type error (#21408) 2025-06-24 13:42:13 +08:00
Jyong
973b3854b4
add dataset info in response (#21406) 2025-06-24 11:13:56 +08:00
QuantumGhost
10b738a296
feat: Persist Variables for Enhanced Debugging Workflow (#20699) 
This pull request introduces a feature aimed at improving the debugging experience during workflow editing. With the addition of variable persistence, the system will automatically retain the output variables from previously executed nodes. These persisted variables can then be reused when debugging subsequent nodes, eliminating the need for repetitive manual input.

By streamlining this aspect of the workflow, the feature minimizes user errors and significantly reduces debugging effort, offering a smoother and more efficient experience.

Key highlights of this change:

- Automatic persistence of output variables for executed nodes.
- Reuse of persisted variables to simplify input steps for nodes requiring them (e.g., `code`, `template`, `variable_assigner`).
- Enhanced debugging experience with reduced friction.

Closes #19735.
 2025-06-24 09:05:29 +08:00
jyong
83cc484c24 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-23 17:12:26 +08:00
jyong
1ff9c07a92 fix notion dataset rule not found 2025-06-23 17:12:08 +08:00
Dongyu Li
b77081a19e feat(datasource): update datasource icon 2025-06-23 15:57:37 +08:00
Dongyu Li
0a6dbf6ee2 Merge remote-tracking branch 'origin/deploy/rag-dev' into deploy/rag-dev 2025-06-23 15:21:15 +08:00
Dongyu Li
ca0979dd43 feat(datasource): update fetch_datasource_provider 2025-06-23 15:18:15 +08:00
Yeuoly
3113350e51
fix(migrate/tools): Correct parameter name in tool_builtin_providers migration function (#21358) 2025-06-23 14:56:34 +08:00
twwu
af64f29e87 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 2025-06-23 13:59:39 +08:00
NeatGuyCoding
a0a89b562c
Feature：Refactor batch update document status for #21324 (#21325) 2025-06-23 09:49:13 +08:00
Jin
3e7f8bad56
fix: markdown_extractor lost chunks if it starts without a header(#21308) (#21309) 2025-06-21 23:10:00 +08:00
GuanMu
870e73c03b
Knowledge base API supports status updates #18147 (#18235) 2025-06-21 11:18:48 +08:00
Jyong
57f7368a0e
fix notion dataset rule not found (#21236) 2025-06-20 20:05:01 +08:00
椰子汁
77be115f09
critical! insert_explore_app_list_api (#21277) 2025-06-20 20:03:30 +08:00
QuantumGhost
3f9ced5374
Revert "feat:conversation variable support file array" (#21273) 2025-06-20 19:57:28 +08:00
Dongyu Li
b12a8eeb90 feat(datasource): change datasource result type to event-stream 2025-06-20 10:09:47 +08:00
NeatGuyCoding
d34795fc08
bug: fix minor exception msg missing (#21255) 2025-06-20 09:23:41 +08:00
-LAN-
6b1ad634f1
fix(workflow_run): sequence_number race. (#21228) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-19 17:53:49 +08:00
Xiyuan Chen
8f64327d57
feat: use default access mode when importing dsl (#21231) 2025-06-19 17:14:28 +08:00
Good Wood
0cfdb8c043
fix: fix load_balancing_config save error (#21213) 2025-06-19 15:41:36 +08:00
jyong
725fc72c6f Merge branch 'feat/r2' into deploy/rag-dev 2025-06-19 15:31:03 +08:00
jyong
b618f3bd9e r2 2025-06-19 15:30:46 +08:00
jyong
f4e1ea9011 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-19 14:30:05 +08:00
jyong
3d0e288e85 r2 2025-06-19 14:29:39 +08:00
jyong
9620d6bcd8 Merge branch 'feat/r2' into deploy/rag-dev 
# Conflicts:
#	web/i18n/zh-Hans/app.ts
 2025-06-19 13:32:49 +08:00
jyong
f7fbded8b9 Merge branch 'main' into feat/r2 2025-06-19 13:32:07 +08:00
Yeuoly
2020a31785
fix(plugin/migrations) refactor data migration to use specific provider ID classes. (#21187) 2025-06-19 13:02:39 +08:00
QuantumGhost
2c04a16eaa
Revert "bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047" (#21207) 2025-06-19 12:05:44 +08:00
ZalterCitty
6325129761
fix wrongly remove reset nodes (#20880) 
Co-authored-by: zhuqingchao <zhuqingchao@xiaomi.com>
 2025-06-19 11:37:07 +08:00
Dongyu Li
0c5706b3f6 Merge remote-tracking branch 'origin/deploy/rag-dev' into deploy/rag-dev 2025-06-19 11:10:43 +08:00
Jyong
9a18a98b58
fix keyword search top-k not initial (#21202) 2025-06-19 11:10:41 +08:00
Dongyu Li
82d0a70cb4 feat(datasource): change datasource result type to event-stream 2025-06-19 11:10:24 +08:00
jyong
cc2cd85ff5 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-19 10:46:15 +08:00
jyong
6ec742539a r2 2025-06-19 10:45:59 +08:00
jyong
09e0a54070 r2 2025-06-19 10:38:10 +08:00
André de Matteo
7b9e01aa07
Feat/support sendgrid (#21011) 
Co-authored-by: André de Matteo <andre.matteo@accenture.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-06-19 10:27:38 +08:00
kinoooolu
2bb19f85c6
feat:conversation variable support file array (#21174) 
Co-authored-by: kino.lu <kino.lu@vipshop.com>
 2025-06-19 10:26:38 +08:00
LiuBo
17fe62cf91
feat: add support for Matrixone database (#20714) 2025-06-19 10:20:12 +08:00
Ganondorf
e99861d4fe
Add Filter of Get Workflow Logs (#21172) 
Co-authored-by: lizb <lizb@sugon.com>
 2025-06-19 10:10:16 +08:00
NeatGuyCoding
9835730278
Translation fix (#21194) 2025-06-19 09:36:56 +08:00
湛露先生
8331b63baa
add func args missing in apps chat. (#21085) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 20:42:33 +08:00
NeatGuyCoding
2eae7503e1
Minor Improvements for File Validation and Configuration Handling #21179 (#21171) 
Co-authored-by: tech <cto@sb>
 2025-06-18 18:33:28 +08:00
jyong
643efc5d85 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-18 17:11:52 +08:00
Dongyu Li
43e5798e13 feat(datasource): change datasource result type to event-stream 2025-06-18 16:27:10 +08:00
Xin Zhang
30cfc9c172
Feat/plugin install scope management (#19963) 2025-06-18 16:25:00 +08:00
NeatGuyCoding
918bb9a2f7
bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047 (#21153) 2025-06-18 16:10:11 +08:00
Dongyu Li
2cf980026e feat(datasource): change datasource result type to event-stream 2025-06-18 16:04:47 +08:00
Dongyu Li
224111081b feat(datasource): change datasource result type to event-stream 2025-06-18 16:04:40 +08:00
jyong
6f67a34349 r2 qa index 2025-06-18 14:37:18 +08:00
Ademílson Tonato
9e73e8b9e8
feat: add search endpoint for Firecrawl Integration (#20521) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-18 14:37:03 +08:00
HyaCinth
d4be356ffb
fix(api): add support for "image" icon when duplicate app (#20744) (#20761) 2025-06-18 14:35:42 +08:00
Rain Wang
47e0f92c0f
Fixes #20748 KnowledgeRetrievalNode return all external documents when reranker disabled even top-k configed (#20762) 2025-06-18 14:35:12 +08:00
湛露先生
6d033d4064
clean duplicate validate for dataset_configs (#20775) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 14:34:58 +08:00
湛露先生
ab290ed968
unreachable-code for lb model fetch. (#20797) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 14:33:49 +08:00
-LAN-
879f839d75
refactor(graph_engine): Merge duplicated if block (#20784) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-18 14:33:29 +08:00
Jyong
787a556bd7
add service api ratelimit check (#20878) 2025-06-18 14:05:28 +08:00
He Wang
37f26c412f
add healthcheck to oceanbase container (#20989) 2025-06-18 14:00:59 +08:00
zxhlyh
e51d308312 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 2025-06-18 13:47:36 +08:00
kazuya-awano
45c89bd6de
feat: add pagenation to notion extractor (#20919) 2025-06-18 11:30:55 +08:00
jyong
ac917bb56d r2 2025-06-18 11:05:52 +08:00
jyong
f7a4e5d1a6 Merge branch 'main' into feat/r2 2025-06-18 10:57:44 +08:00
NeatGuyCoding
61526c027d
[Bug] fix misusing ACCESS_TOKEN_EXPIRE_MINUTES in jwt on exp (#21030) 
Co-authored-by: tech <cto@sb>
 2025-06-18 09:37:49 +08:00
kurokobo
4689e8953e
fix: shorten connection timeout to pypi.org for deprecation check for weaviate client (#21131) 2025-06-18 09:25:52 +08:00
jyong
66de2e1f0a Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/workflow/graph_engine/entities/event.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-17 19:07:15 +08:00
jyong
7f7ea92a45 r2 2025-06-17 19:06:17 +08:00
Dongyu Li
cf66d111ba feat(datasource): change datasource result type to event-stream 2025-06-17 18:29:02 +08:00
Dongyu Li
739ebf2117 feat(datasource): change datasource result type to event-stream 2025-06-17 18:24:09 +08:00
jyong
7c41f71248 r2 2025-06-17 18:11:38 +08:00
W_OOD
0476937f55
fix(agent_node):Fix spelling errors. (#21094) 2025-06-17 17:48:43 +08:00
-LAN-
0dcacdf83d
feat: add a flask_context_manager. (#21061) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-17 16:31:29 +08:00
jyong
1d2ee9020c r2 2025-06-17 14:04:55 +08:00
Dongyu Li
f37e28a368 feat(datasource): Comment out the datasource_file_manager. 2025-06-17 13:54:25 +08:00
Dongyu Li
c5976f5a09 feat(datasource): change datasource result type to event-stream 2025-06-17 13:51:41 +08:00
-LAN-
2440ac43b1
fix: Replace GenericProviderID with ToolProviderID (#21064) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-16 17:35:46 +08:00
-LAN-
809a0ab6bf
chore: bump version to 1.4.3 (#21045) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-16 15:29:53 +08:00
jyong
b277acc298 Merge branch 'main' into feat/r2 2025-06-16 14:08:02 +08:00
jyong
8d47d8ce4f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/website_crawl/website_crawl_plugin.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-16 13:50:33 +08:00
jyong
41fef8a21f r2 2025-06-16 13:48:43 +08:00
yihong
909259da37
fix: delete some dead code using vulture (#20999) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-06-16 12:07:41 +08:00
Bowen Liang
366ddb05ae
test: run vdb test of oceanbase with docker compose in CI tests (#20945) 2025-06-16 11:05:19 +08:00
徐海兴
f6aa2498a3
document indexing not bound to a Session (#21015) 
Co-authored-by: xuhaixing <xuhaixing@itiger.com>
 2025-06-14 17:44:35 +02:00
Harry
5ccb8d9736 feat: online document 2025-06-13 18:22:15 +08:00
Harry
0908f310fc feat: webcrawl 2025-06-13 17:47:51 +08:00
quicksand
3a628bc671
chore: app info add author_name (#20973) 2025-06-13 10:17:35 +02:00
sayThQ199
175571e740
fix(auth): Clear login rate limit after password reset (#20948) 2025-06-13 10:17:12 +02:00
jyong
b2b95412b9 r2 2025-06-13 15:04:22 +08:00
-LAN-
c05e47ebc0
refactor(sqlalchemy_workflow_execution_repository): Use the max funtion for getting next_sequence_number. (#20966) 2025-06-13 09:42:02 +08:00
Takuya Ono
af83120832
🐛 Fix(Gemini LLM): Support Gemini 0.2.x plugin on agent app (#20794) 
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
 2025-06-12 00:49:38 +08:00
-LAN-
1e03c97663
fix(llm_node): missing parameters for structure outputs (#20915) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-11 18:56:07 +08:00
jyong
da3a3ce165 r2 2025-06-11 18:07:06 +08:00
jyong
14dc3e8642 r2 2025-06-11 18:03:21 +08:00
jyong
9eb8597957 r2 2025-06-11 17:29:14 +08:00
jyong
1d8b390584 Merge branch 'main' into feat/r2 
# Conflicts:
#	docker/docker-compose.middleware.yaml
 2025-06-11 17:16:27 +08:00
jyong
5f08a9314c r2 2025-06-11 17:10:20 +08:00
湛露先生
41e3ecc837
fix remote ip header CF-Connecting-IP (#20846) 2025-06-11 16:57:24 +08:00
jyong
66fa68fa18 r2 2025-06-11 16:36:36 +08:00
-LAN-
acb2488fc8
chore(package): Bump version to 1.4.2 (#20897) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-11 16:28:36 +08:00
Yeuoly
d6d8cca053
refactor: replace compact response generation with length-prefixed response for backwards invocation api (#20903) 2025-06-11 16:01:50 +08:00
jyong
a6f7560d2f r2 2025-06-11 14:03:32 +08:00
jyong
874e1bc41d r2 2025-06-11 13:12:18 +08:00
jyong
2972a06f16 r2 2025-06-11 11:21:17 +08:00
Bowen Liang
0f3d4d0b6e
chore: bump mypy to 1.16 (#20608) 2025-06-11 01:01:33 +08:00
jyong
127a77d807 r2 2025-06-10 19:22:08 +08:00
jyong
95a24156de r2 2025-06-10 18:20:32 +08:00
jyong
e934503fa0 r2 2025-06-10 18:16:30 +08:00
jyong
80b219707e r2 2025-06-10 17:11:49 +08:00
Jyong
21a50e22d2
fix auto metadata filter (#20845) 2025-06-10 10:46:17 +02:00
jyong
58b5daeef3 r2 2025-06-10 15:56:28 +08:00
jyong
a7ff2ab470 r2 2025-06-10 14:53:07 +08:00
jyong
4d967544f3 r2 2025-06-10 14:13:10 +08:00
QuantumGhost
c439e82038
refactor(api): Decouple ParameterExtractorNode from LLMNode (#20843) 
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
 2025-06-10 11:47:50 +08:00
jyong
65873aa411 r2 2025-06-10 11:44:52 +08:00
jyong
c0d3452494 r2 2025-06-10 10:59:44 +08:00
jyong
ad3d9cf782 r2 2025-06-10 10:00:20 +08:00
QuantumGhost
a97ff587d2
fix(api): Resolve error encountered when executing QuestionClassifieNode (#20829) 
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
 2025-06-10 00:34:51 +08:00
Xiyuan Chen
0720bc7408
Feat/webapp verified sso main (#20494) 2025-06-09 17:19:53 +09:00
jyong
47664f8fd3 r2 2025-06-09 14:00:34 +08:00
yihong
65c7c01d90
fix: clean up two unreachable code (#20773) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-06-07 23:06:46 +08:00
Bharat Ramanathan
e6e76852d5
Add support for W&B dedicated cloud instances in Weave tracing integration (#20765) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-07 23:06:23 +08:00
QuantumGhost
930c4cb609
feat(api): Adjust WorkflowDraftVariable and WorkflowNodeExecutionModel (#20746) 
- Add `node_execution_id` column to `WorkflowDraftVariable`, allowing efficient implementation of 
  the "Reset to last run value" feature.
- Add additional index for `WorkflowNodeExecutionModel` to improve the performance of last run lookup.

Closes #20745.
 2025-06-06 21:03:59 +08:00
jyong
fcbd5febeb r2 2025-06-06 17:47:06 +08:00
jyong
21a3509bef r2 2025-06-06 17:14:43 +08:00
jefferyvvv
37c3283450
fix: opensearch vector search falls back to keyword search (#20723) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
 2025-06-06 16:29:15 +08:00
jyong
1aa13bd20d r2 2025-06-06 16:05:49 +08:00
jyong
d2d5fc62ae r2 2025-06-06 15:19:53 +08:00
jyong
0ca38d8215 r2 2025-06-06 15:06:26 +08:00
jyong
d2750f1a02 r2 2025-06-06 14:22:00 +08:00
Bowen Liang
c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 2025-06-06 10:48:28 +08:00
jyong
70432952fd r2 2025-06-06 10:40:06 +08:00
jefferyvvv
4271602cfc
fix: opensearch metadata filtering returns empty (#20701) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-06 09:10:01 +08:00
Bowen Liang
4f14d7c0ca
chore: bump uv to 0.7.x (#20692) 2025-06-06 09:09:31 +08:00
Yeuoly
38554c5f3e
fix(inner_api/plugin/wraps): refresh user model after creation in get user function (#20704) 2025-06-05 23:36:33 +08:00
jefferyvvv
138ad6e8b3
fix: opensearch fulltext search with metadata filtering dsl error (#20702) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
 2025-06-05 23:09:00 +08:00
湛露先生
f76f70f0b6
Fix builtin_providers for tools. (#20697) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-05 23:05:50 +08:00
jyong
b8ef1d9585 r2 2025-06-05 16:43:47 +08:00
jyong
c084b57933 r2 2025-06-05 15:28:44 +08:00
HaiyangP
3fb9b41fe5
A more concise and effective extractor for excel and csv files (#20625) 
Co-authored-by: haiyangpengai <xxxx>
 2025-06-05 14:59:55 +08:00
jyong
9e84a5321d r2 2025-06-05 14:55:09 +08:00
jyong
8a86a2c817 r2 2025-06-05 14:09:50 +08:00
jyong
3e0a10b7ed r2 2025-06-05 11:45:53 +08:00
jyong
5fe5da7c1d r2 2025-06-05 11:12:06 +08:00
Eric Guo
822298f69d
Fix 500 error (#20614) 2025-06-05 10:29:13 +08:00
Arcaner
ad2f25875e
fix(llm_node): update file variable mapping to use vision configs (#20417) 2025-06-05 09:58:24 +08:00
Abdullah AlOsaimi
ad8e79c440
assign dataset indexing_technique to args if not explicitly provided (#20597) 2025-06-05 09:47:57 +08:00
-LAN-
5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-04 19:56:54 +08:00
Dongyu Li
92614765ff
Feat/queue monitor (#20647) 2025-06-04 19:56:34 +08:00
jyong
fbca9010f3 r2 2025-06-04 17:39:31 +08:00
jyong
8a147a00e8 r2 2025-06-04 17:29:39 +08:00
jyong
a82ab1d152 r2 2025-06-04 16:51:23 +08:00
jyong
133193e7d0 r2 2025-06-04 16:23:12 +08:00
jyong
c09c8c6e5b r2 2025-06-04 15:12:05 +08:00
Abdullah AlOsaimi
006496f24e
raise error when process_rule is required but missing (#20599) 2025-06-04 14:19:35 +08:00
kenwoodjw
01d500db14
fix: autocorrect everything in web (#20605) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
 2025-06-04 14:12:24 +08:00
Novice
4ac3600f81
fix: update app tag error (#20618) 2025-06-04 13:55:00 +08:00
jyong
abcca11479 r2 2025-06-03 19:10:40 +08:00
jyong
9cdd2cbb27 r2 2025-06-03 19:02:57 +08:00
jyong
309fffd1e4 Merge branch 'main' into feat/r2 
# Conflicts:
#	api/core/repositories/sqlalchemy_workflow_node_execution_repository.py
#	api/core/workflow/entities/node_entities.py
#	api/core/workflow/enums.py
 2025-06-03 18:56:49 +08:00
-LAN-
275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 18:56:38 +08:00
jyong
4130c50643 r2 2025-06-03 18:32:39 +08:00
非法操作
ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 2025-06-03 18:17:34 +08:00
jyong
7b7f8ef51d r2 2025-06-03 18:12:24 +08:00
Bowen Liang
888cd86afd
chore: prepare the plugin daemon base url to yarl URL ahead intstead of in every invocation (#20541) 2025-06-03 17:01:35 +08:00
jyong
573cd15e77 r2 2025-06-03 16:52:21 +08:00
jyong
ab1730bbaa r2 2025-06-03 16:51:21 +08:00
Anshuman Saini
e40e9db39a
fixes #19634 (#20545) 2025-06-03 16:38:48 +08:00
-LAN-
36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:36:18 +08:00
-LAN-
257bf13fef
refactor: Removes unused LLMMode value_of method (#20575) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:36:10 +08:00
-LAN-
957f5b212e
fix: Upgrade Flask-Cors (#20577) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:35:34 +08:00
-LAN-
72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:16:06 +08:00
jyong
270edd43ab r2 2025-06-03 15:53:17 +08:00
jyong
b8f3b23b1a r2 2025-06-03 15:51:31 +08:00
jyong
0486aa3445 r2 2025-06-03 13:30:51 +08:00
zhaobingshuang
3f7aa38d77
fix: #20560 When elasticsearch is used as the vector database, the Retrieval Test fails to filter the data after setting the Score Threshold, and the score of the recalled results is empty (#20561) 2025-06-03 13:24:26 +08:00
Contrail
a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 2025-06-03 12:47:39 +08:00
不如归去
c29cb503be
Fix #20536: Force header in custom tool be string (#20537) 
Co-authored-by: Peter Xin <iami@Artemis.local>
 2025-06-02 18:09:01 +08:00
不如归去
8025ad0661
Fixes #20534: Allow $ref in parameter for custom tools (#20535) 
Co-authored-by: Peter Xin <iami@Artemis.local>
 2025-06-02 18:08:53 +08:00
Cheney Zhang
b4b59148dc
check zilliz cloud of full-text search (#20519) 2025-06-02 18:04:13 +08:00
湛露先生
b33f8b47ca
nacos config init , and force add ts parms. (#20526) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-01 10:17:40 +08:00
kurokobo
c26e1929d6
fix(housekeeping): exclude files that are used as app icons or avatar images from being removed (#20532) 2025-05-31 23:27:47 +08:00
jyong
3fb02a7933 r2 2025-05-30 17:28:09 +08:00
-LAN-
92528360f9
fix: fetch tenant_id in other trace providers besides langfuse (#20495) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 17:15:49 +08:00
jyong
631768ea1d r2 2025-05-30 15:42:36 +08:00
Ganondorf
51f64797cd
Add APIs for Knowledge Base Tag Management and Dataset Binding (#20023) 
Co-authored-by: lizb <lizb@sugon.com>
 2025-05-30 14:48:00 +08:00