Commit Graph

444 Commits

Author SHA1 Message Date
Yeuoly 83ca7f8deb feat: add datasource support to PluginDeclaration and PluginCategory 2025-05-26 17:32:25 +08:00
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193)
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
2025-05-26 16:41:57 +08:00
jyong 35be8721b9 Merge branch 'main' into feat/r2 2025-05-26 14:50:33 +08:00
jyong 665ffbdc10 r2 2025-05-26 14:49:59 +08:00
jyong ec1c4efca9 r2 2025-05-25 23:09:01 +08:00
jyong 6d547447d3 r2 2025-05-23 19:30:48 +08:00
jyong 64d997fdb0 r2 2025-05-23 15:55:41 +08:00
Yeuoly a49942b949 fix: rename first_step_parameters 2025-05-23 15:12:31 +08:00
jyong b93d26ee9f Merge remote-tracking branch 'origin/feat/r2' into feat/r2
# Conflicts:
#	api/core/datasource/entities/datasource_entities.py
2025-05-23 00:06:51 +08:00
jyong b82b26bba5 r2 2025-05-23 00:05:57 +08:00
-LAN- 6b3666f826
feat: Split WorkflowCycleManager (#20071)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-05-22 09:49:25 +08:00
-LAN- d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-05-21 22:01:53 +08:00
Yeuoly 3bfc602561 refactor: update datasource entity structure and parameter handling
- Renamed and split parameters in DatasourceEntity into first_step_parameters and second_step_parameters.
- Updated validation methods for new parameter structure.
- Adjusted datasource_node to reference first_step_parameters.
- Cleaned up unused imports and improved type hints in workflow.py.
2025-05-21 20:36:26 +08:00
jyong 82be119fec Merge branch 'main' into feat/r2 2025-05-20 15:18:52 +08:00
jyong ba52bf27c1 r2 2025-05-20 14:57:26 +08:00
-LAN- 4977bb21ec
feat(workflow): domain model for workflow node execution (#19430)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-17 00:56:16 +08:00
Yeuoly c5a2f43ceb refactor: replace BuiltinToolManageService with RagPipelineManageService for datasource management and remove unused datasource engine and related code 2025-05-16 18:42:07 +08:00
jyong 4ff971c8a3 r2 2025-05-16 11:26:56 +08:00
jyong 93ac6d37e9 r2 2025-05-15 16:44:55 +08:00
jyong 360f8a3375 Merge branch 'main' into feat/r2 2025-05-15 15:15:23 +08:00
jyong 818eb46a8b r2 2025-05-15 15:14:52 +08:00
satohk 1b4fea1794
fix: Referencing Metadata in the response of the External Knowledge A… (#19637) (#19644)
Co-authored-by: satou.kazuhiro <satou.kazuhiro@fanuc.co.jp>
2025-05-14 15:05:28 +08:00
jiangbo721 fabfc7d4d8
fix: remove error message $ symbol (#19587)
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: crazywoola <427733928@qq.com>
2025-05-13 16:20:29 +08:00
SSebo 57b3912227
fix: common prerequisite node workflow remove reachable node that failed to streaming llm… (#19552)
Co-authored-by: zhangshibo <zhangshibo@didiglobal.com>
2025-05-13 13:47:29 +08:00
非法操作 b00f94df64
fix: replace all dataset.Model.query to db.session.query(Model) (#19509) 2025-05-12 13:52:33 +08:00
LeanDeR c720e0dd04
refactor(workflow): revamp logging module for loop & iteration nodes (#19484) 2025-05-12 09:32:41 +08:00
Bowen Liang cbc8ebd8f5
chore: bump pydantic to 2.11 and pydantic-settings to 2.9 (#15049) 2025-05-08 17:39:51 +08:00
Will 58d9d35515
fix: inconsistent metadata definitions (#19343) 2025-05-08 16:33:28 +08:00
jyong 3f1363503b r2 2025-05-07 16:19:09 +08:00
Will bfa652f2d0
fix: metadata filtering condition variable unassigned; fix External K… (#19208) 2025-05-07 14:52:09 +08:00
-LAN- f23cf98317
refactor: Remove RepositoryFactory (#19176)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-05-06 21:14:51 +08:00
jyong a25cc4e8af r2 2025-05-06 13:56:13 +08:00
Novice 0cfc82d731
fix(structured-output): reasoning model's json format parsing (#19261) 2025-05-06 13:16:08 +08:00
kenwoodjw c5568f756f
fix basic auth if not base64 encode (#19242)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
2025-05-06 09:18:37 +08:00
Hao Cheng 9bcf837f17
fix: use only supported operators in metadata filter system prompts (#19195) 2025-05-03 20:08:08 +08:00
Will a212a63e6a
fix: time type metadata filtering error (#19192) 2025-05-03 20:07:37 +08:00
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372)
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2025-04-30 17:28:02 +08:00
-LAN- bcc95e520b
feat: support remove first and remove last in variable assigner (#19144)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-30 15:50:00 +08:00
Will 69b43a955f
fix: inconsistent case expression in _process_metadata_filter_func (#19146) 2025-04-30 15:14:01 +08:00
QuantumGhost bd1bbfee4b
Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
feiyang_deepnova 226afd4550
Fix: the issue of getting empty environment variables. (#19085) 2025-04-29 18:01:11 +08:00
Jyong b8bb45b106
remove unstructured api key check (#18989) 2025-04-28 17:26:30 +08:00
jyong 3c386c63a6 Merge remote-tracking branch 'origin/feat/r2' into feat/r2 2025-04-28 16:19:29 +08:00
jyong 49d1846e63 r2 2025-04-28 16:19:12 +08:00
quicksand 5de01c1444
feat (document_extractor): support .properties file (#18969) 2025-04-28 15:28:11 +08:00
crazywoola 2c2af1d117
feat: add VTT data transform to Document extractor (#18936) 2025-04-28 13:45:15 +08:00
-LAN- d9aa2b155a
refactor: Refactors repository imports structure (#18901)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-27 17:29:03 +08:00
Yeuoly c2d02f8f4d Merge branch 'main' into feat/r2 2025-04-27 14:31:19 +08:00
Yeuoly abafa68647
refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 2025-04-27 14:22:25 +08:00
非法操作 c1559a7c8e
fix: LLMResultChunk cause concatenate str and list exception (#18852) 2025-04-27 11:32:14 +08:00
Jyong e2cb7006c4
check metadata_filtering_conditions could be None in auto mode (#18548) 2025-04-22 17:09:33 +08:00
ZalterCitty a1158cc946
fix: Update prompt message content types to use Literal and add union type for content (#17136)
Co-authored-by: 朱庆超 <zhuqingchao@xiaomi.com>
Co-authored-by: crazywoola <427733928@qq.com>
2025-04-22 16:17:55 +08:00
Novice da9269ca97
feat: structured output (#17877) 2025-04-18 16:33:53 +08:00
jyong 5c4bf2a9e4 r2 2025-04-17 15:07:23 +08:00
Novice c91045a9d0
fix(fail-branch): prevent streaming output in exception branches (#17153) 2025-04-16 22:34:07 +08:00
呆萌闷油瓶 8cc37f3115
fix:the extraction function of the list operation node received 0 that should not be received (#18170) 2025-04-16 16:26:24 +08:00
Ganondorf b006b9ac0c
Http requests node add ssl verify (#18125)
Co-authored-by: lizb <lizb@sugon.com>
2025-04-16 15:59:34 +08:00
kenwoodjw dfc123819e
fix basic auth encoding (#18047)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
2025-04-15 11:34:50 +08:00
Novice cd7fd100a7
fix(langfuse): qusetion classify node can't see cost in langfuse (#17982) 2025-04-14 15:28:26 +08:00
Yongtao Huang 5d72003ebb
Remove dead code (#17899) 2025-04-11 20:33:52 +08:00
briqt 91cfa90503
Fix external knowledge Issues: (#17685) (#17843) 2025-04-11 15:37:27 +08:00
Xu Song 1e1d457548
fix: make prompt consistent with few-show examples (#11538) 2025-04-11 09:16:26 +08:00
zxfishhack 5541a1f80e
robust for json parser (#17687) 2025-04-10 22:18:26 +08:00
-LAN- ec29bcf013
feat(graph_engine): yield control to other threads before node run. (#17689)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-09 17:02:47 +08:00
Yongtao Huang e1304dc0c3
Chore: fix some wrong annotations (#17413) 2025-04-03 17:27:07 +08:00
Novice dcdec98c8e
feat: agent node add memory (#15976) 2025-04-03 16:40:58 +08:00
Good Wood b3f4e90862
feat: remove file and file[] restriction in code node (#17382) 2025-04-03 16:23:19 +08:00
Dongyu Li 8c77f2dc03
Feat/loop node (#17273) 2025-04-02 13:53:26 +08:00
非法操作 44f911a0a8
chore: docstring not match the function parameter (#17162) 2025-03-31 13:19:15 +08:00
Arcaner becd03a4aa
fix: enhance file extension condition check for if-else node (#17060) 2025-03-29 14:20:18 +08:00
Jyong 30792a1e1a
install pandoc (#16825) 2025-03-26 22:34:10 +08:00
Jyong 6a857e01f6
fix multiple metadata filter's confusing setting (#16771) 2025-03-26 14:16:21 +08:00
Jyong 86a1859d02
Metadata variable value fix (#16665) 2025-03-25 09:07:11 +08:00
Ron bf682302ee
fix error with literal_eval (#16297)
Co-authored-by: Novice <novice12185727@gmail.com>
2025-03-21 09:30:24 +08:00
Novice 437dcbdd68
fix: exclude additional unreachable nodes (#16329) 2025-03-20 16:53:56 +08:00
Jyong b8ef3149ef
metadata expect value check error (#16210) 2025-03-19 17:48:01 +08:00
cyflhn 1789437cc5
reopen PR for #14411 (#16148) 2025-03-19 10:24:35 +08:00
Jyong fa9b767bf2
fix chatflow metadata field name (#16130) 2025-03-18 19:40:42 +08:00
Jyong abeaea4f79
Support knowledge metadata filter (#15982) 2025-03-18 16:42:19 +08:00
kurokobo 86d3fff666
fix: respect resolution settings for vision for basic chatbot, text generator, and parameter extractor node (#16041) 2025-03-18 14:37:07 +08:00
Gen Sato 475b8d731e
Fix HTTP Request node to give priority to file extension of content-disposition (#12653) 2025-03-18 11:00:20 +08:00
Novice fe0d932f50
fix: fail-branch stream output error (#13401)
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
2025-03-17 19:35:37 +08:00
Bowen Liang 9e782d4c1e
chore: bump ruff to 0.11.0 and fix linting violations (#15953) 2025-03-17 16:13:11 +08:00
QuantumGhost 2b4d1cf1db
fix(api): fix fail branch functionality for `WorkflowTool` (#15966) 2025-03-17 11:53:32 +08:00
QuantumGhost 23ed3a520b
chore(api): improve type hints for BaseNode and its subclasses (#15826) 2025-03-14 18:09:11 +08:00
jiangbo721 5646442931
fix: iteration total tokens calculate error (#15813)
Co-authored-by: 刘江波 <jiangbo721@163.com>
2025-03-14 17:44:24 +08:00
RookieAgent 8165d0b469
fix: http_request node form-data support array[file] (#15731) 2025-03-14 09:58:18 +08:00
Arcaner 12fa517297
fix: if-else-node handles missing optional file variables (#15693) 2025-03-13 13:11:49 +08:00
Novice b817036343
fix: nesting of conditional branches causing streaming output error (#14065) 2025-03-11 20:30:03 +08:00
heyszt a58b990855
fix agent_execution_metadata (#15444) 2025-03-11 14:35:08 +08:00
Jacky Wu ed5596a8f4
fix: avoid llm node result var not init issue while do retry. (#14286) 2025-03-11 12:43:24 +08:00
Jyong 9b2a9260ef
Feat/new saas billing (#14996) 2025-03-10 19:50:11 +08:00
非法操作 99dc8c7871
fix: http node request detect text/xml as file (#15174) 2025-03-07 12:12:06 +08:00
Novice 778861f461
fix: agent node can't use in parallel (#15047) 2025-03-06 13:13:24 +08:00
Wood 2c17bb2c36
Feature/newnew workflow loop node (#14863)
Co-authored-by: arkunzz <4873204@qq.com>
2025-03-05 17:41:15 +08:00
LeanDeR 4f6a4f244c
fix(llm/nodes.py): Ensure that the output returns without any exceptions (#14880) 2025-03-05 14:35:08 +08:00
Novice 24d80000ac
chore: Restore the parts that were overwritten during conflict resolution. (#14141) 2025-03-04 11:21:16 +08:00
Novice bb4fecf3d1
fix(agent node): tool setting and workflow tool. (#14461) 2025-02-27 16:09:13 +08:00
yuhaowin 1e3197a1ea
Fixes 14217: database retrieve api and chat-messages api response doc_metadata (#14219) 2025-02-27 14:56:46 +08:00
Bowen Liang 21e1443ed5
chore: cleanup unchanged overridden method in subclasses of BaseNode (#14281) 2025-02-26 09:41:38 +08:00