opensource
/
dify
mirror of https://github.com/langgenius/dify.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,999 Commits 327 Branches 162 Tags 717 MiB
Commit Graph

3984 Commits

Author SHA1 Message Date
-LAN- 8f15341f1e
fix(event_handlers): DB dead lock (#21468) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-25 16:20:37 +08:00
Maries 1dd2607dfd
feat(oauth): refactor proxy context (#21483) 2025-06-25 15:10:45 +08:00
jyong 540096a8d8 Merge branch 'main' into feat/r2 
# Conflicts:
#	api/core/plugin/impl/oauth.py
#	api/core/workflow/entities/variable_pool.py
#	api/models/workflow.py
#	api/services/dataset_service.py
 2025-06-25 14:35:23 +08:00
Maries 164e5481c5
feat(oauth): plugin oauth service (#21480) 2025-06-25 14:14:30 +08:00
AuditAIH a098825fcc
Update smtp.py (#21335) 2025-06-25 13:50:35 +08:00
jyong 7b7cdad1d8 r2 2025-06-25 13:28:08 +08:00
QuantumGhost 268da31332
fix(api): adding variable to variable pool recursively while loading draft variables. (#21478) 
This PR fix the issue that `ObjectSegment` are not recursively added to the draft variable pool while loading draft variables from database. It also fixes an issue about loading variables with more than two elements in the its selector.

Enhances #19735.
Closes #21477.
 2025-06-25 12:39:22 +08:00
NeatGuyCoding 94f8e48647
Refactor update dataset (fix #21401) (#21402) 
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-06-25 11:44:35 +08:00
-LAN- c7ee0f2a93
fix(knowledge_base): Unchecked metadata name length (#21454) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-25 10:18:20 +08:00
jiangbo721 9de552cb42
fix: first message query error (#21444) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2025-06-24 20:32:50 +08:00
QuantumGhost 501d3b6203
feat(api): Explicitly define version method for all BaseNode subclasses (#21443) 
This PR addresses issue #21441 by implementing explicit `version` method definitions for all `BaseNode` subclasses to improve code maintainability.

### Changes

Added explicit `version` method definitions for all `BaseNode` subclasses:

- `QuestionClassifierNode`
- `KnowledgeRetrievalNode` 
- `AgentNode`

Added comprehensive test suite to validate:

1. All subclasses of `BaseNode` have explicitly defined `version` method
2. All subclasses have required `_node_type` property
3. The `(node_type, node_version)` combination is unique across all subclasses
 2025-06-24 20:27:22 +08:00
Dongyu Li 6aba39a2dd feat(datasource): add datasource content preview api 2025-06-24 17:43:25 +08:00
Dongyu Li 49bb15fae1 feat(datasource): add datasource content preview api 2025-06-24 17:14:31 +08:00
Dongyu Li e165f4a102 feat(datasource): add datasource content preview api 2025-06-24 17:14:16 +08:00
Jyong d60287621a
add dataset info in response (#21413) 2025-06-24 16:07:31 +08:00
quicksand 45146edb31
fix(document_extractor): xlsx file column int type error (#21408) 2025-06-24 13:42:13 +08:00
Jyong 973b3854b4
add dataset info in response (#21406) 2025-06-24 11:13:56 +08:00
QuantumGhost 10b738a296
feat: Persist Variables for Enhanced Debugging Workflow (#20699) 
This pull request introduces a feature aimed at improving the debugging experience during workflow editing. With the addition of variable persistence, the system will automatically retain the output variables from previously executed nodes. These persisted variables can then be reused when debugging subsequent nodes, eliminating the need for repetitive manual input.

By streamlining this aspect of the workflow, the feature minimizes user errors and significantly reduces debugging effort, offering a smoother and more efficient experience.

Key highlights of this change:

- Automatic persistence of output variables for executed nodes.
- Reuse of persisted variables to simplify input steps for nodes requiring them (e.g., `code`, `template`, `variable_assigner`).
- Enhanced debugging experience with reduced friction.

Closes #19735.
 2025-06-24 09:05:29 +08:00
jyong 83cc484c24 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-23 17:12:26 +08:00
jyong 1ff9c07a92 fix notion dataset rule not found 2025-06-23 17:12:08 +08:00
Dongyu Li b77081a19e feat(datasource): update datasource icon 2025-06-23 15:57:37 +08:00
Dongyu Li 0a6dbf6ee2 Merge remote-tracking branch 'origin/deploy/rag-dev' into deploy/rag-dev 2025-06-23 15:21:15 +08:00
Dongyu Li ca0979dd43 feat(datasource): update fetch_datasource_provider 2025-06-23 15:18:15 +08:00
Yeuoly 3113350e51
fix(migrate/tools): Correct parameter name in tool_builtin_providers migration function (#21358) 2025-06-23 14:56:34 +08:00
twwu af64f29e87 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 2025-06-23 13:59:39 +08:00
NeatGuyCoding a0a89b562c
Feature：Refactor batch update document status for #21324 (#21325) 2025-06-23 09:49:13 +08:00
Jin 3e7f8bad56
fix: markdown_extractor lost chunks if it starts without a header(#21308) (#21309) 2025-06-21 23:10:00 +08:00
GuanMu 870e73c03b
Knowledge base API supports status updates #18147 (#18235) 2025-06-21 11:18:48 +08:00
Jyong 57f7368a0e
fix notion dataset rule not found (#21236) 2025-06-20 20:05:01 +08:00
椰子汁 77be115f09
critical! insert_explore_app_list_api (#21277) 2025-06-20 20:03:30 +08:00
QuantumGhost 3f9ced5374
Revert "feat:conversation variable support file array" (#21273) 2025-06-20 19:57:28 +08:00
Dongyu Li b12a8eeb90 feat(datasource): change datasource result type to event-stream 2025-06-20 10:09:47 +08:00
NeatGuyCoding d34795fc08
bug: fix minor exception msg missing (#21255) 2025-06-20 09:23:41 +08:00
-LAN- 6b1ad634f1
fix(workflow_run): sequence_number race. (#21228) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-19 17:53:49 +08:00
Xiyuan Chen 8f64327d57
feat: use default access mode when importing dsl (#21231) 2025-06-19 17:14:28 +08:00
Good Wood 0cfdb8c043
fix: fix load_balancing_config save error (#21213) 2025-06-19 15:41:36 +08:00
jyong 725fc72c6f Merge branch 'feat/r2' into deploy/rag-dev 2025-06-19 15:31:03 +08:00
jyong b618f3bd9e r2 2025-06-19 15:30:46 +08:00
jyong f4e1ea9011 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-19 14:30:05 +08:00
jyong 3d0e288e85 r2 2025-06-19 14:29:39 +08:00
jyong 9620d6bcd8 Merge branch 'feat/r2' into deploy/rag-dev 
# Conflicts:
#	web/i18n/zh-Hans/app.ts
 2025-06-19 13:32:49 +08:00
jyong f7fbded8b9 Merge branch 'main' into feat/r2 2025-06-19 13:32:07 +08:00
Yeuoly 2020a31785
fix(plugin/migrations) refactor data migration to use specific provider ID classes. (#21187) 2025-06-19 13:02:39 +08:00
QuantumGhost 2c04a16eaa
Revert "bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047" (#21207) 2025-06-19 12:05:44 +08:00
ZalterCitty 6325129761
fix wrongly remove reset nodes (#20880) 
Co-authored-by: zhuqingchao <zhuqingchao@xiaomi.com>
 2025-06-19 11:37:07 +08:00
Dongyu Li 0c5706b3f6 Merge remote-tracking branch 'origin/deploy/rag-dev' into deploy/rag-dev 2025-06-19 11:10:43 +08:00
Jyong 9a18a98b58
fix keyword search top-k not initial (#21202) 2025-06-19 11:10:41 +08:00
Dongyu Li 82d0a70cb4 feat(datasource): change datasource result type to event-stream 2025-06-19 11:10:24 +08:00
jyong cc2cd85ff5 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-19 10:46:15 +08:00
jyong 6ec742539a r2 2025-06-19 10:45:59 +08:00
jyong 09e0a54070 r2 2025-06-19 10:38:10 +08:00
André de Matteo 7b9e01aa07
Feat/support sendgrid (#21011) 
Co-authored-by: André de Matteo <andre.matteo@accenture.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-06-19 10:27:38 +08:00
kinoooolu 2bb19f85c6
feat:conversation variable support file array (#21174) 
Co-authored-by: kino.lu <kino.lu@vipshop.com>
 2025-06-19 10:26:38 +08:00
LiuBo 17fe62cf91
feat: add support for Matrixone database (#20714) 2025-06-19 10:20:12 +08:00
Ganondorf e99861d4fe
Add Filter of Get Workflow Logs (#21172) 
Co-authored-by: lizb <lizb@sugon.com>
 2025-06-19 10:10:16 +08:00
NeatGuyCoding 9835730278
Translation fix (#21194) 2025-06-19 09:36:56 +08:00
湛露先生 8331b63baa
add func args missing in apps chat. (#21085) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 20:42:33 +08:00
NeatGuyCoding 2eae7503e1
Minor Improvements for File Validation and Configuration Handling #21179 (#21171) 
Co-authored-by: tech <cto@sb>
 2025-06-18 18:33:28 +08:00
jyong 643efc5d85 Merge branch 'feat/r2' into deploy/rag-dev 2025-06-18 17:11:52 +08:00
Dongyu Li 43e5798e13 feat(datasource): change datasource result type to event-stream 2025-06-18 16:27:10 +08:00
Xin Zhang 30cfc9c172
Feat/plugin install scope management (#19963) 2025-06-18 16:25:00 +08:00
NeatGuyCoding 918bb9a2f7
bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047 (#21153) 2025-06-18 16:10:11 +08:00
Dongyu Li 2cf980026e feat(datasource): change datasource result type to event-stream 2025-06-18 16:04:47 +08:00
Dongyu Li 224111081b feat(datasource): change datasource result type to event-stream 2025-06-18 16:04:40 +08:00
jyong 6f67a34349 r2 qa index 2025-06-18 14:37:18 +08:00
Ademílson Tonato 9e73e8b9e8
feat: add search endpoint for Firecrawl Integration (#20521) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-18 14:37:03 +08:00
HyaCinth d4be356ffb
fix(api): add support for "image" icon when duplicate app (#20744) (#20761) 2025-06-18 14:35:42 +08:00
Rain Wang 47e0f92c0f
Fixes #20748 KnowledgeRetrievalNode return all external documents when reranker disabled even top-k configed (#20762) 2025-06-18 14:35:12 +08:00
湛露先生 6d033d4064
clean duplicate validate for dataset_configs (#20775) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 14:34:58 +08:00
湛露先生 ab290ed968
unreachable-code for lb model fetch. (#20797) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 14:33:49 +08:00
-LAN- 879f839d75
refactor(graph_engine): Merge duplicated if block (#20784) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-18 14:33:29 +08:00
Jyong 787a556bd7
add service api ratelimit check (#20878) 2025-06-18 14:05:28 +08:00
He Wang 37f26c412f
add healthcheck to oceanbase container (#20989) 2025-06-18 14:00:59 +08:00
zxhlyh e51d308312 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 2025-06-18 13:47:36 +08:00
kazuya-awano 45c89bd6de
feat: add pagenation to notion extractor (#20919) 2025-06-18 11:30:55 +08:00
jyong ac917bb56d r2 2025-06-18 11:05:52 +08:00
jyong f7a4e5d1a6 Merge branch 'main' into feat/r2 2025-06-18 10:57:44 +08:00
NeatGuyCoding 61526c027d
[Bug] fix misusing ACCESS_TOKEN_EXPIRE_MINUTES in jwt on exp (#21030) 
Co-authored-by: tech <cto@sb>
 2025-06-18 09:37:49 +08:00
kurokobo 4689e8953e
fix: shorten connection timeout to pypi.org for deprecation check for weaviate client (#21131) 2025-06-18 09:25:52 +08:00
jyong 66de2e1f0a Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/workflow/graph_engine/entities/event.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-17 19:07:15 +08:00
jyong 7f7ea92a45 r2 2025-06-17 19:06:17 +08:00
Dongyu Li cf66d111ba feat(datasource): change datasource result type to event-stream 2025-06-17 18:29:02 +08:00
Dongyu Li 739ebf2117 feat(datasource): change datasource result type to event-stream 2025-06-17 18:24:09 +08:00
jyong 7c41f71248 r2 2025-06-17 18:11:38 +08:00
W_OOD 0476937f55
fix(agent_node):Fix spelling errors. (#21094) 2025-06-17 17:48:43 +08:00
-LAN- 0dcacdf83d
feat: add a flask_context_manager. (#21061) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-17 16:31:29 +08:00
jyong 1d2ee9020c r2 2025-06-17 14:04:55 +08:00
Dongyu Li f37e28a368 feat(datasource): Comment out the datasource_file_manager. 2025-06-17 13:54:25 +08:00
Dongyu Li c5976f5a09 feat(datasource): change datasource result type to event-stream 2025-06-17 13:51:41 +08:00
-LAN- 2440ac43b1
fix: Replace GenericProviderID with ToolProviderID (#21064) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-16 17:35:46 +08:00
-LAN- 809a0ab6bf
chore: bump version to 1.4.3 (#21045) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-16 15:29:53 +08:00
jyong b277acc298 Merge branch 'main' into feat/r2 2025-06-16 14:08:02 +08:00
jyong 8d47d8ce4f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/website_crawl/website_crawl_plugin.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-16 13:50:33 +08:00
jyong 41fef8a21f r2 2025-06-16 13:48:43 +08:00
yihong 909259da37
fix: delete some dead code using vulture (#20999) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-06-16 12:07:41 +08:00
Bowen Liang 366ddb05ae
test: run vdb test of oceanbase with docker compose in CI tests (#20945) 2025-06-16 11:05:19 +08:00
徐海兴 f6aa2498a3
document indexing not bound to a Session (#21015) 
Co-authored-by: xuhaixing <xuhaixing@itiger.com>
 2025-06-14 17:44:35 +02:00
Harry 5ccb8d9736 feat: online document 2025-06-13 18:22:15 +08:00
Harry 0908f310fc feat: webcrawl 2025-06-13 17:47:51 +08:00
quicksand 3a628bc671
chore: app info add author_name (#20973) 2025-06-13 10:17:35 +02:00
sayThQ199 175571e740
fix(auth): Clear login rate limit after password reset (#20948) 2025-06-13 10:17:12 +02:00
jyong b2b95412b9 r2 2025-06-13 15:04:22 +08:00
-LAN- c05e47ebc0
refactor(sqlalchemy_workflow_execution_repository): Use the max funtion for getting next_sequence_number. (#20966) 2025-06-13 09:42:02 +08:00
Takuya Ono af83120832
🐛 Fix(Gemini LLM): Support Gemini 0.2.x plugin on agent app (#20794) 
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
 2025-06-12 00:49:38 +08:00
-LAN- 1e03c97663
fix(llm_node): missing parameters for structure outputs (#20915) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-11 18:56:07 +08:00
jyong da3a3ce165 r2 2025-06-11 18:07:06 +08:00
jyong 14dc3e8642 r2 2025-06-11 18:03:21 +08:00
jyong 9eb8597957 r2 2025-06-11 17:29:14 +08:00
jyong 1d8b390584 Merge branch 'main' into feat/r2 
# Conflicts:
#	docker/docker-compose.middleware.yaml
 2025-06-11 17:16:27 +08:00
jyong 5f08a9314c r2 2025-06-11 17:10:20 +08:00
湛露先生 41e3ecc837
fix remote ip header CF-Connecting-IP (#20846) 2025-06-11 16:57:24 +08:00
jyong 66fa68fa18 r2 2025-06-11 16:36:36 +08:00
-LAN- acb2488fc8
chore(package): Bump version to 1.4.2 (#20897) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-11 16:28:36 +08:00
Yeuoly d6d8cca053
refactor: replace compact response generation with length-prefixed response for backwards invocation api (#20903) 2025-06-11 16:01:50 +08:00
jyong a6f7560d2f r2 2025-06-11 14:03:32 +08:00
jyong 874e1bc41d r2 2025-06-11 13:12:18 +08:00
jyong 2972a06f16 r2 2025-06-11 11:21:17 +08:00
Bowen Liang 0f3d4d0b6e
chore: bump mypy to 1.16 (#20608) 2025-06-11 01:01:33 +08:00
jyong 127a77d807 r2 2025-06-10 19:22:08 +08:00
jyong 95a24156de r2 2025-06-10 18:20:32 +08:00
jyong e934503fa0 r2 2025-06-10 18:16:30 +08:00
jyong 80b219707e r2 2025-06-10 17:11:49 +08:00
Jyong 21a50e22d2
fix auto metadata filter (#20845) 2025-06-10 10:46:17 +02:00
jyong 58b5daeef3 r2 2025-06-10 15:56:28 +08:00
jyong a7ff2ab470 r2 2025-06-10 14:53:07 +08:00
jyong 4d967544f3 r2 2025-06-10 14:13:10 +08:00
QuantumGhost c439e82038
refactor(api): Decouple `ParameterExtractorNode` from `LLMNode` (#20843) 
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
 2025-06-10 11:47:50 +08:00
jyong 65873aa411 r2 2025-06-10 11:44:52 +08:00
jyong c0d3452494 r2 2025-06-10 10:59:44 +08:00
jyong ad3d9cf782 r2 2025-06-10 10:00:20 +08:00
QuantumGhost a97ff587d2
fix(api): Resolve error encountered when executing `QuestionClassifieNode` (#20829) 
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
 2025-06-10 00:34:51 +08:00
Xiyuan Chen 0720bc7408
Feat/webapp verified sso main (#20494) 2025-06-09 17:19:53 +09:00
jyong 47664f8fd3 r2 2025-06-09 14:00:34 +08:00
yihong 65c7c01d90
fix: clean up two unreachable code (#20773) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-06-07 23:06:46 +08:00
Bharat Ramanathan e6e76852d5
Add support for W&B dedicated cloud instances in Weave tracing integration (#20765) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-07 23:06:23 +08:00
QuantumGhost 930c4cb609
feat(api): Adjust `WorkflowDraftVariable` and `WorkflowNodeExecutionModel` (#20746) 
- Add `node_execution_id` column to `WorkflowDraftVariable`, allowing efficient implementation of 
  the "Reset to last run value" feature.
- Add additional index for `WorkflowNodeExecutionModel` to improve the performance of last run lookup.

Closes #20745.
 2025-06-06 21:03:59 +08:00
jyong fcbd5febeb r2 2025-06-06 17:47:06 +08:00
jyong 21a3509bef r2 2025-06-06 17:14:43 +08:00
jefferyvvv 37c3283450
fix: opensearch vector search falls back to keyword search (#20723) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
 2025-06-06 16:29:15 +08:00
jyong 1aa13bd20d r2 2025-06-06 16:05:49 +08:00
jyong d2d5fc62ae r2 2025-06-06 15:19:53 +08:00
jyong 0ca38d8215 r2 2025-06-06 15:06:26 +08:00
jyong d2750f1a02 r2 2025-06-06 14:22:00 +08:00
Bowen Liang c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 2025-06-06 10:48:28 +08:00
jyong 70432952fd r2 2025-06-06 10:40:06 +08:00
jefferyvvv 4271602cfc
fix: opensearch metadata filtering returns empty (#20701) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-06 09:10:01 +08:00
Bowen Liang 4f14d7c0ca
chore: bump uv to 0.7.x (#20692) 2025-06-06 09:09:31 +08:00
Yeuoly 38554c5f3e
fix(inner_api/plugin/wraps): refresh user model after creation in get user function (#20704) 2025-06-05 23:36:33 +08:00
jefferyvvv 138ad6e8b3
fix: opensearch fulltext search with metadata filtering dsl error (#20702) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
 2025-06-05 23:09:00 +08:00
湛露先生 f76f70f0b6
Fix builtin_providers for tools. (#20697) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-05 23:05:50 +08:00