opensource
/
dify
mirror of https://github.com/langgenius/dify.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,014 Commits 295 Branches 160 Tags 521 MiB
Commit Graph

2475 Commits

Author SHA1 Message Date
-LAN- 9c9d3d7bd0
feat: document extractor chardet encoding (#20269) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 13:27:46 +08:00
Good Wood 756f35f480
feat: add pagination for plugin page (#20151) 2025-05-27 12:54:52 +08:00
-LAN- 55503ce771
fix: persist workflow execution status on partial success and failure (#20264) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 11:24:08 +08:00
-LAN- b357eca307
fix: Copy request context and current user in app generators. (#20240) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-27 10:56:23 +08:00
非法操作 acd4b9a8ac
fix: not save workflow_run_id of chatflow message (#20257) 2025-05-27 10:43:22 +08:00
jyong 5fc2bc58a9 r2 2025-05-27 00:01:23 +08:00
cooper.wu 2cad98f01f
fix: #18132 when deepseek llm model, auto_generate name can't work (#18646) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2025-05-26 18:04:52 +08:00
Yeuoly 83ca7f8deb feat: add datasource support to PluginDeclaration and PluginCategory 2025-05-26 17:32:25 +08:00
jyong 678d6ffe2b r2 2025-05-26 17:00:16 +08:00
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193) 
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-26 16:41:57 +08:00
jyong ef0e41de07 r2 2025-05-26 16:02:11 +08:00
jyong 35be8721b9 Merge branch 'main' into feat/r2 2025-05-26 14:50:33 +08:00
jyong 665ffbdc10 r2 2025-05-26 14:49:59 +08:00
jyong ec1c4efca9 r2 2025-05-25 23:09:01 +08:00
jyong 0f10852b6b Merge remote-tracking branch 'origin/feat/r2' into feat/r2 2025-05-23 19:30:59 +08:00
jyong 6d547447d3 r2 2025-05-23 19:30:48 +08:00
Yeuoly 6123f1ab21 refactor: reorganize imports and fix datasource endpoint URL 2025-05-23 19:22:50 +08:00
Yeuoly a15bf8e8fe remove output schema 2025-05-23 17:35:26 +08:00
jyong 70d2c78176 r2 2025-05-23 17:13:09 +08:00
jyong 42fcda3dc8 r2 2025-05-23 17:11:56 +08:00
jyong 64d997fdb0 r2 2025-05-23 15:55:41 +08:00
Yeuoly a49942b949 fix: rename first_step_parameters 2025-05-23 15:12:31 +08:00
Yeuoly 4460d96e58 feat: add oauth schema 2025-05-23 15:11:40 +08:00
Yeuoly a7d5f2f53b apply ruff 2025-05-23 15:10:56 +08:00
Yeuoly 4300ebc8aa fix: remove provide type 2025-05-23 15:10:16 +08:00
jyong b93d26ee9f Merge remote-tracking branch 'origin/feat/r2' into feat/r2 
# Conflicts:
#	api/core/datasource/entities/datasource_entities.py
 2025-05-23 00:06:51 +08:00
jyong b82b26bba5 r2 2025-05-23 00:05:57 +08:00
Boris Feld c939f04b1a
Add support for tracking conversation with Opik Tracer (#20063) 2025-05-22 16:11:50 +08:00
jameshui1997 648393cc7b
fix: improve tracing provider validation logic in OpsTraceManager (#20042) 2025-05-22 14:08:36 +08:00
He Huang 6f48af2610
Refactor OpenSearch config to separate use_ssl and verify_certs flags (#20075) 
Co-authored-by: he.huang <he.huang1@outlook.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-22 10:14:38 +08:00
zhudongwork adca981eee
fix: uninitialized variable error on empty knowledge retrieval(agent) (#20025) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-22 10:09:07 +08:00
-LAN- 6b3666f826
feat: Split WorkflowCycleManager (#20071) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-22 09:49:25 +08:00
heyszt 02929b2cce
Fix/fix trace provider delete err (#20070) 2025-05-21 23:51:42 +08:00
-LAN- d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 22:01:53 +08:00
Yeuoly 3bfc602561 refactor: update datasource entity structure and parameter handling 
- Renamed and split parameters in DatasourceEntity into first_step_parameters and second_step_parameters.
- Updated validation methods for new parameter structure.
- Adjusted datasource_node to reference first_step_parameters.
- Cleaned up unused imports and improved type hints in workflow.py.
 2025-05-21 20:36:26 +08:00
Yeuoly 5fa2aca2c8 feat: add oauth schema to datasource 2025-05-21 20:29:59 +08:00
wlleiiwang 7d230acf40
tencent vectordb compatible with version 1.1.3 and below (#20056) 
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
 2025-05-21 20:24:05 +08:00
QuantumGhost 13dc1c8795
Simplify `execution_metadata` Handling for `WorkflowNodeExecution` (#20062) 
Currently, `WorkflowNodeExecution.execution_metadata_dict` returns `None` when metadata is absent in the database. This requires all callers to perform `None` checks when processing metadata, leading to more complex caller-side logic.

This pull request updates the `execution_metadata_dict` method to return an empty dictionary instead of `None` when metadata is absent. This change would simplify the caller logic, as it removes the need for explicit `None` checks and provides a more consistent data structure to work with.
 2025-05-21 18:38:16 +08:00
-LAN- 57bcb616bc
fix(sqlalchemy_workflow_node_execution_repository): Missing `triggered_from` while querying WorkflowNodeExecution (#20044) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 16:37:44 +08:00
-LAN- 3196dc2d61
refactor: Use typed SQLAlchemy base model and fix type errors (#19980) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-21 15:38:03 +08:00
Panpan ef3569e667
feat: support chatflow start node custom input field hidden (#19678) 2025-05-21 13:52:21 +08:00
俊晨 36b321735e
fix create_tracing_app_config error (#19884) (#20004) 
Co-authored-by: codly <codly.fun@gmail.com>
 2025-05-21 10:45:10 +08:00
luckylhb90 c58678d84d
chore: Reduce the invocation of the plugin interface (#19629) 
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-20 16:55:21 +08:00
Zihe JI 87f9d11d65
fix: ensure Decimal values in metadata are JSON serializable (fixes #19936) (#19955) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-20 15:38:31 +08:00
Darlewo 8cb3b4aef2
fix: multiple retrieve reranking_enabled switch (#19958) 2025-05-20 15:22:03 +08:00
jyong 82be119fec Merge branch 'main' into feat/r2 2025-05-20 15:18:52 +08:00
jyong ba52bf27c1 r2 2025-05-20 14:57:26 +08:00
Amir Mohsen Asaran c9ee60e197
Feat(WaterCrawl error handling): add custom exceptions and error handling (#19948) 2025-05-20 10:25:16 +08:00
QuantumGhost 6a9e0b1005
feat(api): Introduce `WorkflowDraftVariable` Model (#19737) 
- Introduce `WorkflowDraftVariable` model and the corresponding migration.
- Implement `EnumText`,  a custom column type for SQLAlchemy designed
  to work seamlessly with enumeration classes based on `StrEnum`.
 2025-05-19 22:59:56 +08:00
非法操作 bbebf9ad3e
fix: db_model save to _node_execution_cache (#19911) 2025-05-19 17:17:43 +08:00
heyszt 11146b6bae
fix create_tracing_app_config error (#19884) 2025-05-19 10:09:21 +08:00
-LAN- 7d0106b220
fix: correct type mismatch in WorkflowService node execution handling (#19846) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-17 12:31:27 +08:00
-LAN- 4977bb21ec
feat(workflow): domain model for workflow node execution (#19430) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-17 00:56:16 +08:00
Yeuoly c5a2f43ceb refactor: replace BuiltinToolManageService with RagPipelineManageService for datasource management and remove unused datasource engine and related code 2025-05-16 18:42:07 +08:00
jyong 4ff971c8a3 r2 2025-05-16 11:26:56 +08:00
jyong 93ac6d37e9 r2 2025-05-15 16:44:55 +08:00
jyong e710a8402c r2 2025-05-15 16:07:17 +08:00
jyong 360f8a3375 Merge branch 'main' into feat/r2 2025-05-15 15:15:23 +08:00
jyong 818eb46a8b r2 2025-05-15 15:14:52 +08:00
Yeuoly ff0feaf34e
fix: handle EndpointSetupFailedError in BasePluginClient (#19613) 2025-05-15 13:59:43 +08:00
k-kayashima b292990075
Fix: Ensure unique index names for pgvector knowledge tables (#19672) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-15 11:43:44 +08:00
zhaobingshuang 303c6ecc1d
fix: The init_azure_openai() method in the core/hosting_configuration.py file doesn't work (#19704) (#19705) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-15 10:02:59 +08:00
satohk 1b4fea1794
fix: Referencing Metadata in the response of the External Knowledge A… (#19637) (#19644) 
Co-authored-by: satou.kazuhiro <satou.kazuhiro@fanuc.co.jp>
 2025-05-14 15:05:28 +08:00
jiangbo721 fabfc7d4d8
fix: remove error message $ symbol (#19587) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-05-13 16:20:29 +08:00
SSebo 57b3912227
fix: common prerequisite node workflow remove reachable node that failed to streaming llm… (#19552) 
Co-authored-by: zhangshibo <zhangshibo@didiglobal.com>
 2025-05-13 13:47:29 +08:00
Bowen Liang 0b22e8b544
chore: speed up api service startup time by defering the imports for trace services (#19504) 2025-05-13 09:13:25 +08:00
非法操作 085bd1aa93
chore: model.query change to db.session.query (#19551) 
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
 2025-05-13 09:13:12 +08:00
非法操作 14cd71ed0a
chore: all model.query replace to db.session.query (#19521) 2025-05-12 15:19:41 +08:00
非法操作 b00f94df64
fix: replace all dataset.Model.query to db.session.query(Model) (#19509) 2025-05-12 13:52:33 +08:00
LeanDeR c720e0dd04
refactor(workflow): revamp logging module for loop & iteration nodes (#19484) 2025-05-12 09:32:41 +08:00
湛露先生 1119790b02
clean rag word_extractor. (#19397) 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
 2025-05-09 16:39:16 +08:00
Bowen Liang cbc8ebd8f5
chore: bump pydantic to 2.11 and pydantic-settings to 2.9 (#15049) 2025-05-08 17:39:51 +08:00
Will 58d9d35515
fix: inconsistent metadata definitions (#19343) 2025-05-08 16:33:28 +08:00
Yeuoly 3258a91d5d
Feat/add repo to plugin manifest (#19337) 2025-05-07 17:28:38 +08:00
Will 0358859467
fix: llm_usage.total_tokens stat (#19177) 2025-05-07 16:42:49 +08:00
jyong 3f1363503b r2 2025-05-07 16:19:09 +08:00
Will bfa652f2d0
fix: metadata filtering condition variable unassigned; fix External K… (#19208) 2025-05-07 14:52:09 +08:00
-LAN- f23cf98317
refactor: Remove RepositoryFactory (#19176) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-05-06 21:14:51 +08:00
jyong a998022c12 r2 2025-05-06 16:18:34 +08:00
jyong a25cc4e8af r2 2025-05-06 13:56:13 +08:00
Novice 0cfc82d731
fix(structured-output): reasoning model's json format parsing (#19261) 2025-05-06 13:16:08 +08:00
Bowen Liang 8537abfff8
chore: avoid repeated type ignore noqa by adding flask_restful and flask_login in mypy import exclusions (#19224) 2025-05-06 11:58:49 +08:00
kenwoodjw c5568f756f
fix basic auth if not base64 encode (#19242) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
 2025-05-06 09:18:37 +08:00
Bowen Liang 22f5af9987
fix: support non-ascii charactors in filename of the tool files (#19228) 2025-05-06 09:18:11 +08:00
Hao Cheng 9bcf837f17
fix: use only supported operators in metadata filter system prompts (#19195) 2025-05-03 20:08:08 +08:00
Will a212a63e6a
fix: time type metadata filtering error (#19192) 2025-05-03 20:07:37 +08:00
非法操作 1ca6dbcdc8
fix: file name incorrect when download file (#19183) 2025-04-30 22:47:59 +08:00
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372) 
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2025-04-30 17:28:02 +08:00
Bowen Liang 12c96b93d9
immediately return initialed tiktokenizer instance and remove dead code in usage of tiktokenizer (#17957) 2025-04-30 16:07:20 +08:00
-LAN- bcc95e520b
feat: support remove first and remove last in variable assigner (#19144) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-04-30 15:50:00 +08:00
Will 69b43a955f
fix: inconsistent case expression in _process_metadata_filter_func (#19146) 2025-04-30 15:14:01 +08:00
kingpc 65b7a783fe
fix: metadata filter not work (#19020) 
Co-authored-by: 金鹏程 <jinpengcheng01@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2025-04-30 11:06:03 +08:00
QuantumGhost bd1bbfee4b
Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
feiyang_deepnova 226afd4550
Fix: the issue of getting empty environment variables. (#19085) 2025-04-29 18:01:11 +08:00
Ahmad Zidan 8266815cda
feat: add AWS Managed IAM auth for OpenSearch vector DB (#18963) 2025-04-29 15:10:08 +08:00
Ethan 8b4ea01810
feat: support access milvus with token (#19034) 2025-04-29 14:52:13 +08:00
Panpan 83187b30c0
fix: fix rerank model runner usage (#19008) 2025-04-29 14:51:21 +08:00
Ganondorf a147d2a200
feat(api): use `json_repair` to fix invalid json while generating structured output (#18977) 
When generating JSON schema using an LLM in the structured output feature,
models may occasionally return invalid JSON, which prevents clients from correctly 
parsing the response and can lead to UI breakage.

This commit addresses the issue by introducing `json_repair` to automatically 
fix invalid JSON strings returned by the LLM, ensuring smoother functionality 
and better client-side handling of structured outputs.


Co-authored-by: lizb <lizb@sugon.com>
 2025-04-29 12:39:13 +08:00
Kevin9703 94cc0b7a12
fix(workflow_cycle_manage): failed nodes were not updated in workflow_node_executions (#18994) 2025-04-29 10:31:08 +08:00
Jyong b8bb45b106
remove unstructured api key check (#18989) 2025-04-28 17:26:30 +08:00