opensource/dify
2
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-03-30 00:50:08 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,995 Commits 431 Branches 169 Tags 607 MiB
f677f2f71b
Commit Graph

2631 Commits

Author SHA1 Message Date
湛露先生
6d033d4064
clean duplicate validate for dataset_configs (#20775) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 14:34:58 +08:00
湛露先生
ab290ed968
unreachable-code for lb model fetch. (#20797) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-18 14:33:49 +08:00
-LAN-
879f839d75
refactor(graph_engine): Merge duplicated if block (#20784) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-18 14:33:29 +08:00
zxhlyh
e51d308312 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 2025-06-18 13:47:36 +08:00
kazuya-awano
45c89bd6de
feat: add pagenation to notion extractor (#20919) 2025-06-18 11:30:55 +08:00
jyong
ac917bb56d r2 2025-06-18 11:05:52 +08:00
jyong
f7a4e5d1a6 Merge branch 'main' into feat/r2 2025-06-18 10:57:44 +08:00
kurokobo
4689e8953e
fix: shorten connection timeout to pypi.org for deprecation check for weaviate client (#21131) 2025-06-18 09:25:52 +08:00
jyong
66de2e1f0a Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/workflow/graph_engine/entities/event.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-17 19:07:15 +08:00
jyong
7f7ea92a45 r2 2025-06-17 19:06:17 +08:00
Dongyu Li
cf66d111ba feat(datasource): change datasource result type to event-stream 2025-06-17 18:29:02 +08:00
Dongyu Li
739ebf2117 feat(datasource): change datasource result type to event-stream 2025-06-17 18:24:09 +08:00
W_OOD
0476937f55
fix(agent_node):Fix spelling errors. (#21094) 2025-06-17 17:48:43 +08:00
-LAN-
0dcacdf83d
feat: add a flask_context_manager. (#21061) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-17 16:31:29 +08:00
jyong
1d2ee9020c r2 2025-06-17 14:04:55 +08:00
Dongyu Li
f37e28a368 feat(datasource): Comment out the datasource_file_manager. 2025-06-17 13:54:25 +08:00
Dongyu Li
c5976f5a09 feat(datasource): change datasource result type to event-stream 2025-06-17 13:51:41 +08:00
jyong
b277acc298 Merge branch 'main' into feat/r2 2025-06-16 14:08:02 +08:00
jyong
8d47d8ce4f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/website_crawl/website_crawl_plugin.py
#	api/services/rag_pipeline/rag_pipeline.py
 2025-06-16 13:50:33 +08:00
jyong
41fef8a21f r2 2025-06-16 13:48:43 +08:00
yihong
909259da37
fix: delete some dead code using vulture (#20999) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-06-16 12:07:41 +08:00
Bowen Liang
366ddb05ae
test: run vdb test of oceanbase with docker compose in CI tests (#20945) 2025-06-16 11:05:19 +08:00
Harry
5ccb8d9736 feat: online document 2025-06-13 18:22:15 +08:00
Harry
0908f310fc feat: webcrawl 2025-06-13 17:47:51 +08:00
jyong
b2b95412b9 r2 2025-06-13 15:04:22 +08:00
-LAN-
c05e47ebc0
refactor(sqlalchemy_workflow_execution_repository): Use the max funtion for getting next_sequence_number. (#20966) 2025-06-13 09:42:02 +08:00
Takuya Ono
af83120832
🐛 Fix(Gemini LLM): Support Gemini 0.2.x plugin on agent app (#20794) 
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
 2025-06-12 00:49:38 +08:00
-LAN-
1e03c97663
fix(llm_node): missing parameters for structure outputs (#20915) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-11 18:56:07 +08:00
jyong
1d8b390584 Merge branch 'main' into feat/r2 
# Conflicts:
#	docker/docker-compose.middleware.yaml
 2025-06-11 17:16:27 +08:00
jyong
5f08a9314c r2 2025-06-11 17:10:20 +08:00
jyong
66fa68fa18 r2 2025-06-11 16:36:36 +08:00
Yeuoly
d6d8cca053
refactor: replace compact response generation with length-prefixed response for backwards invocation api (#20903) 2025-06-11 16:01:50 +08:00
Bowen Liang
0f3d4d0b6e
chore: bump mypy to 1.16 (#20608) 2025-06-11 01:01:33 +08:00
jyong
95a24156de r2 2025-06-10 18:20:32 +08:00
jyong
e934503fa0 r2 2025-06-10 18:16:30 +08:00
Jyong
21a50e22d2
fix auto metadata filter (#20845) 2025-06-10 10:46:17 +02:00
QuantumGhost
c439e82038
refactor(api): Decouple ParameterExtractorNode from LLMNode (#20843) 
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
 2025-06-10 11:47:50 +08:00
jyong
ad3d9cf782 r2 2025-06-10 10:00:20 +08:00
QuantumGhost
a97ff587d2
fix(api): Resolve error encountered when executing QuestionClassifieNode (#20829) 
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
 2025-06-10 00:34:51 +08:00
jyong
47664f8fd3 r2 2025-06-09 14:00:34 +08:00
yihong
65c7c01d90
fix: clean up two unreachable code (#20773) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-06-07 23:06:46 +08:00
Bharat Ramanathan
e6e76852d5
Add support for W&B dedicated cloud instances in Weave tracing integration (#20765) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-07 23:06:23 +08:00
jyong
21a3509bef r2 2025-06-06 17:14:43 +08:00
jefferyvvv
37c3283450
fix: opensearch vector search falls back to keyword search (#20723) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
 2025-06-06 16:29:15 +08:00
jyong
0ca38d8215 r2 2025-06-06 15:06:26 +08:00
jyong
d2750f1a02 r2 2025-06-06 14:22:00 +08:00
Bowen Liang
c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 2025-06-06 10:48:28 +08:00
jefferyvvv
4271602cfc
fix: opensearch metadata filtering returns empty (#20701) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-06-06 09:10:01 +08:00
jefferyvvv
138ad6e8b3
fix: opensearch fulltext search with metadata filtering dsl error (#20702) 
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
 2025-06-05 23:09:00 +08:00
湛露先生
f76f70f0b6
Fix builtin_providers for tools. (#20697) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-06-05 23:05:50 +08:00
HaiyangP
3fb9b41fe5
A more concise and effective extractor for excel and csv files (#20625) 
Co-authored-by: haiyangpengai <xxxx>
 2025-06-05 14:59:55 +08:00
jyong
9e84a5321d r2 2025-06-05 14:55:09 +08:00
jyong
8a86a2c817 r2 2025-06-05 14:09:50 +08:00
jyong
5fe5da7c1d r2 2025-06-05 11:12:06 +08:00
Arcaner
ad2f25875e
fix(llm_node): update file variable mapping to use vision configs (#20417) 2025-06-05 09:58:24 +08:00
-LAN-
5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-04 19:56:54 +08:00
jyong
133193e7d0 r2 2025-06-04 16:23:12 +08:00
jyong
c09c8c6e5b r2 2025-06-04 15:12:05 +08:00
kenwoodjw
01d500db14
fix: autocorrect everything in web (#20605) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
 2025-06-04 14:12:24 +08:00
jyong
abcca11479 r2 2025-06-03 19:10:40 +08:00
jyong
9cdd2cbb27 r2 2025-06-03 19:02:57 +08:00
jyong
309fffd1e4 Merge branch 'main' into feat/r2 
# Conflicts:
#	api/core/repositories/sqlalchemy_workflow_node_execution_repository.py
#	api/core/workflow/entities/node_entities.py
#	api/core/workflow/enums.py
 2025-06-03 18:56:49 +08:00
-LAN-
275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 18:56:38 +08:00
jyong
4130c50643 r2 2025-06-03 18:32:39 +08:00
非法操作
ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 2025-06-03 18:17:34 +08:00
jyong
7b7f8ef51d r2 2025-06-03 18:12:24 +08:00
Bowen Liang
888cd86afd
chore: prepare the plugin daemon base url to yarl URL ahead intstead of in every invocation (#20541) 2025-06-03 17:01:35 +08:00
jyong
ab1730bbaa r2 2025-06-03 16:51:21 +08:00
-LAN-
36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:36:18 +08:00
-LAN-
257bf13fef
refactor: Removes unused LLMMode value_of method (#20575) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:36:10 +08:00
-LAN-
72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-06-03 16:16:06 +08:00
jyong
b8f3b23b1a r2 2025-06-03 15:51:31 +08:00
jyong
0486aa3445 r2 2025-06-03 13:30:51 +08:00
zhaobingshuang
3f7aa38d77
fix: #20560 When elasticsearch is used as the vector database, the Retrieval Test fails to filter the data after setting the Score Threshold, and the score of the recalled results is empty (#20561) 2025-06-03 13:24:26 +08:00
Contrail
a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 2025-06-03 12:47:39 +08:00
不如归去
c29cb503be
Fix #20536: Force header in custom tool be string (#20537) 
Co-authored-by: Peter Xin <iami@Artemis.local>
 2025-06-02 18:09:01 +08:00
不如归去
8025ad0661
Fixes #20534: Allow $ref in parameter for custom tools (#20535) 
Co-authored-by: Peter Xin <iami@Artemis.local>
 2025-06-02 18:08:53 +08:00
Cheney Zhang
b4b59148dc
check zilliz cloud of full-text search (#20519) 2025-06-02 18:04:13 +08:00
-LAN-
92528360f9
fix: fetch tenant_id in other trace providers besides langfuse (#20495) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 17:15:49 +08:00
jyong
631768ea1d r2 2025-05-30 15:42:36 +08:00
Dongyu Li
1ea4459d9f
update knowledge base api (#20426) 2025-05-30 14:45:30 +08:00
Yasuhiro Ohno
55371e5abf
Improve CONVERSATION_TITLE_PROMPT to correctly handle Japanese and input (#20351) 2025-05-30 14:43:51 +08:00
-LAN-
a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 14:36:44 +08:00
yihong
5a991295e0
fix: drop some type fixme (#20344) 2025-05-30 14:10:09 +08:00
-LAN-
db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 11:05:08 +08:00
-LAN-
f2e0d161a1
fix(ops_trace_manager): Adds app_id to TraceTask initialization (#20461) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 09:00:05 +08:00
-LAN-
f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:56:37 +08:00
-LAN-
32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:47:56 +08:00
-LAN-
482e50aae9
Refactor/remove db from cycle manager (#20455) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-30 04:34:13 +08:00
jyong
69529fb16d r2 2025-05-30 00:37:27 +08:00
jyong
cb5cfb2dae r2 2025-05-30 00:03:43 +08:00
jyong
a826879cf7 Merge branch 'main' into feat/r2 2025-05-29 23:04:38 +08:00
jyong
e7c48c0b69 r2 2025-05-29 23:04:04 +08:00
Yeuoly
d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 2025-05-29 17:55:20 +08:00
Bowen Liang
eee88a8012
chore: improve error logging for requests to plugin daemon (#20328) 2025-05-29 17:12:27 +08:00
jyong
a025db137d Merge branch 'main' into feat/r2 2025-05-29 09:54:28 +08:00
jyong
797d044714 r2 2025-05-29 09:53:42 +08:00
Novice
b2ab401279
chore: remove agent turn limits (#19930) 2025-05-29 09:51:56 +08:00
Novice
9bbd646f40
fix: inner invoke llm token too long (#20391) 2025-05-29 09:49:44 +08:00
-LAN-
f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-28 19:56:17 +08:00
jyong
7f59ffe7af r2 2025-05-28 17:56:04 +08:00
teawoong Kim
400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 2025-05-28 17:04:38 +08:00
-LAN-
eaaf551497
fix: Instance <Account> is not bound to a Session (#20347) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-28 16:36:08 +08:00
-LAN-
f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 22:41:07 +08:00
rouxiaomin
4c4887c5fc
feat(qdrant):add replication_factor when create collection in qdrant (#20133) 
Co-authored-by: 刘敏 <min.liu@tongdun.net>
 2025-05-27 14:46:04 +08:00
-LAN-
d3bfcd498b
fix: Refactor web reader to use readabilipy (#19789) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 14:17:32 +08:00
-LAN-
9c9d3d7bd0
feat: document extractor chardet encoding (#20269) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 13:27:46 +08:00
Good Wood
756f35f480
feat: add pagination for plugin page (#20151) 2025-05-27 12:54:52 +08:00
-LAN-
55503ce771
fix: persist workflow execution status on partial success and failure (#20264) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 11:24:08 +08:00
-LAN-
b357eca307
fix: Copy request context and current user in app generators. (#20240) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 10:56:23 +08:00
非法操作
acd4b9a8ac
fix: not save workflow_run_id of chatflow message (#20257) 2025-05-27 10:43:22 +08:00
jyong
5fc2bc58a9 r2 2025-05-27 00:01:23 +08:00
cooper.wu
2cad98f01f
fix: #18132 when deepseek llm model, auto_generate name can't work (#18646) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-05-26 18:04:52 +08:00
Yeuoly
83ca7f8deb feat: add datasource support to PluginDeclaration and PluginCategory 2025-05-26 17:32:25 +08:00
jyong
678d6ffe2b r2 2025-05-26 17:00:16 +08:00
Heyang Wang
b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193) 
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-26 16:41:57 +08:00
jyong
ef0e41de07 r2 2025-05-26 16:02:11 +08:00
jyong
35be8721b9 Merge branch 'main' into feat/r2 2025-05-26 14:50:33 +08:00
jyong
665ffbdc10 r2 2025-05-26 14:49:59 +08:00
jyong
ec1c4efca9 r2 2025-05-25 23:09:01 +08:00
jyong
0f10852b6b Merge remote-tracking branch 'origin/feat/r2' into feat/r2 2025-05-23 19:30:59 +08:00
jyong
6d547447d3 r2 2025-05-23 19:30:48 +08:00
Yeuoly
6123f1ab21 refactor: reorganize imports and fix datasource endpoint URL 2025-05-23 19:22:50 +08:00
Yeuoly
a15bf8e8fe remove output schema 2025-05-23 17:35:26 +08:00
jyong
70d2c78176 r2 2025-05-23 17:13:09 +08:00
jyong
42fcda3dc8 r2 2025-05-23 17:11:56 +08:00
jyong
64d997fdb0 r2 2025-05-23 15:55:41 +08:00
Yeuoly
a49942b949 fix: rename first_step_parameters 2025-05-23 15:12:31 +08:00
Yeuoly
4460d96e58 feat: add oauth schema 2025-05-23 15:11:40 +08:00
Yeuoly
a7d5f2f53b apply ruff 2025-05-23 15:10:56 +08:00
Yeuoly
4300ebc8aa fix: remove provide type 2025-05-23 15:10:16 +08:00
jyong
b93d26ee9f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/entities/datasource_entities.py
 2025-05-23 00:06:51 +08:00
jyong
b82b26bba5 r2 2025-05-23 00:05:57 +08:00
Boris Feld
c939f04b1a
Add support for tracking conversation with Opik Tracer (#20063) 2025-05-22 16:11:50 +08:00
jameshui1997
648393cc7b
fix: improve tracing provider validation logic in OpsTraceManager (#20042) 2025-05-22 14:08:36 +08:00
He Huang
6f48af2610
Refactor OpenSearch config to separate use_ssl and verify_certs flags (#20075) 
Co-authored-by: he.huang <he.huang1@outlook.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-22 10:14:38 +08:00
zhudongwork
adca981eee
fix: uninitialized variable error on empty knowledge retrieval(agent) (#20025) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-22 10:09:07 +08:00
-LAN-
6b3666f826
feat: Split WorkflowCycleManager (#20071) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-22 09:49:25 +08:00
heyszt
02929b2cce
Fix/fix trace provider delete err (#20070) 2025-05-21 23:51:42 +08:00
-LAN-
d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 22:01:53 +08:00
Yeuoly
3bfc602561 refactor: update datasource entity structure and parameter handling 
- Renamed and split parameters in DatasourceEntity into first_step_parameters and second_step_parameters.
- Updated validation methods for new parameter structure.
- Adjusted datasource_node to reference first_step_parameters.
- Cleaned up unused imports and improved type hints in workflow.py.
 2025-05-21 20:36:26 +08:00
Yeuoly
5fa2aca2c8 feat: add oauth schema to datasource 2025-05-21 20:29:59 +08:00
wlleiiwang
7d230acf40
tencent vectordb compatible with version 1.1.3 and below (#20056) 
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
 2025-05-21 20:24:05 +08:00
QuantumGhost
13dc1c8795
Simplify execution_metadata Handling for WorkflowNodeExecution (#20062) 
Currently, `WorkflowNodeExecution.execution_metadata_dict` returns `None` when metadata is absent in the database. This requires all callers to perform `None` checks when processing metadata, leading to more complex caller-side logic.

This pull request updates the `execution_metadata_dict` method to return an empty dictionary instead of `None` when metadata is absent. This change would simplify the caller logic, as it removes the need for explicit `None` checks and provides a more consistent data structure to work with.
 2025-05-21 18:38:16 +08:00
-LAN-
57bcb616bc
fix(sqlalchemy_workflow_node_execution_repository): Missing triggered_from while querying WorkflowNodeExecution (#20044) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 16:37:44 +08:00
-LAN-
3196dc2d61
refactor: Use typed SQLAlchemy base model and fix type errors (#19980) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 15:38:03 +08:00
Panpan
ef3569e667
feat: support chatflow start node custom input field hidden (#19678) 2025-05-21 13:52:21 +08:00
俊晨
36b321735e
fix create_tracing_app_config error (#19884) (#20004) 
Co-authored-by: codly <codly.fun@gmail.com>
 2025-05-21 10:45:10 +08:00
luckylhb90
c58678d84d
chore: Reduce the invocation of the plugin interface (#19629) 
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-20 16:55:21 +08:00
Zihe JI
87f9d11d65
fix: ensure Decimal values in metadata are JSON serializable (fixes #19936) (#19955) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-20 15:38:31 +08:00