349c3cf7b8
feat(api): Add image multimodal support for LLMNode ( #17372 )
...
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.
This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.
To integrate file outputs into workflows, adjustments to the frontend code
are necessary.
For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.
Close #15814 .
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2025-04-30 17:28:02 +08:00
12c96b93d9
immediately return initialed tiktokenizer instance and remove dead code in usage of tiktokenizer ( #17957 )
2025-04-30 16:07:20 +08:00
bcc95e520b
feat: support remove first and remove last in variable assigner ( #19144 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-30 15:50:00 +08:00
69b43a955f
fix: inconsistent case expression in _process_metadata_filter_func ( #19146 )
2025-04-30 15:14:01 +08:00
65b7a783fe
fix: metadata filter not work ( #19020 )
...
Co-authored-by: 金鹏程 <jinpengcheng01@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
2025-04-30 11:06:03 +08:00
bd1bbfee4b
Enhance Code Consistency Across Repository with `.editorconfig` ( #19023 )
2025-04-29 18:04:33 +08:00
226afd4550
Fix: the issue of getting empty environment variables. ( #19085 )
2025-04-29 18:01:11 +08:00
8266815cda
feat: add AWS Managed IAM auth for OpenSearch vector DB ( #18963 )
2025-04-29 15:10:08 +08:00
8b4ea01810
feat: support access milvus with token ( #19034 )
2025-04-29 14:52:13 +08:00
83187b30c0
fix: fix rerank model runner usage ( #19008 )
2025-04-29 14:51:21 +08:00
a147d2a200
feat(api): use `json_repair` to fix invalid json while generating structured output ( #18977 )
...
When generating JSON schema using an LLM in the structured output feature,
models may occasionally return invalid JSON, which prevents clients from correctly
parsing the response and can lead to UI breakage.
This commit addresses the issue by introducing `json_repair` to automatically
fix invalid JSON strings returned by the LLM, ensuring smoother functionality
and better client-side handling of structured outputs.
Co-authored-by: lizb <lizb@sugon.com>
2025-04-29 12:39:13 +08:00
94cc0b7a12
fix(workflow_cycle_manage): failed nodes were not updated in workflow_node_executions ( #18994 )
2025-04-29 10:31:08 +08:00
b8bb45b106
remove unstructured api key check ( #18989 )
2025-04-28 17:26:30 +08:00
5de01c1444
feat (document_extractor): support .properties file ( #18969 )
2025-04-28 15:28:11 +08:00
f86e2edc54
refactor(plugin/backwards_invocation/app): Remove unnecessary .value from StrEnum ( #18896 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-28 14:50:59 +08:00
2c2af1d117
feat: add VTT data transform to Document extractor ( #18936 )
2025-04-28 13:45:15 +08:00
7a62202392
fix: when cot_agent call tool like searxng lost some response content ( #16781 )
2025-04-28 09:27:46 +08:00
d9aa2b155a
refactor: Refactors repository imports structure ( #18901 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-27 17:29:03 +08:00
0e0ec4691a
feat: add interfaces of OAuth handler methods for authorization ( #18889 )
2025-04-27 16:00:37 +08:00
abafa68647
refactor: rename plugin manager to plugin client and rename path from manager to impl ( #18876 )
2025-04-27 14:22:25 +08:00
c1559a7c8e
fix: LLMResultChunk cause concatenate str and list exception ( #18852 )
2025-04-27 11:32:14 +08:00
b62eb61400
fix depth param issue for WaterCrawl ( #18839 )
2025-04-27 11:04:56 +08:00
0a20210a59
feat: Add W&B Weave Tracing Integration ( #14262 )
...
Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
Signed-off-by: ChengZi <chen.zhang@zilliz.com>
Signed-off-by: cl <cailue@apache.org>
Co-authored-by: Yu Chun Chang <changyuchun159630@gmail.com>
Co-authored-by: Kyle Chang <kylechang@91app.com>
Co-authored-by: Lick-liu <51771897+Lick-liu@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Yuichiro Utsumi <81412151+utsumi-fj@users.noreply.github.com>
Co-authored-by: NFish <douxc512@gmail.com>
Co-authored-by: Yeuoly <45712896+Yeuoly@users.noreply.github.com>
Co-authored-by: Wu Tianwei <30284043+WTW0313@users.noreply.github.com>
Co-authored-by: DDDDD12138 <43703884+DDDDD12138@users.noreply.github.com>
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Novice <857526207@qq.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Kalo Chin <91766386+fdb02983rhy@users.noreply.github.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: jiangbo721 <365065261@qq.com>
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: Lam <scau_ljw@126.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Mars <524574386@qq.com>
Co-authored-by: mars <linjx2@by-health.com>
Co-authored-by: Joe <79627742+ZhouhaoJiang@users.noreply.github.com>
Co-authored-by: Rafael Carvalho <r.carvalho@me.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: 非法操作 <hjlarry@163.com>
Co-authored-by: kenwoodjw <blackxin55+@gmail.com>
Co-authored-by: codingjaguar <codingjaguar@gmail.com>
Co-authored-by: ChengZi <chen.zhang@zilliz.com>
Co-authored-by: Fei He <droxer.he@gmail.com>
Co-authored-by: Arcaner <52057416+lrhan321@users.noreply.github.com>
Co-authored-by: Xiyuan Chen <52963600+GareArc@users.noreply.github.com>
Co-authored-by: KVOJJJin <jzongcode@gmail.com>
Co-authored-by: XiaoBa <94062266+XiaoBa-Yu@users.noreply.github.com>
Co-authored-by: Xiaoba Yu <xb1823725853@gmail.com>
Co-authored-by: zhangyuhang <2827528315@qq.com>
Co-authored-by: yuhang2.zhang <yuhang2.zhang@ly.com>
Co-authored-by: 诗浓 <nyaashino@gmail.com>
Co-authored-by: RookieAgent <42060616+Sakura4036@users.noreply.github.com>
Co-authored-by: sho-takano-dev <shota.takano.dev@gmail.com>
Co-authored-by: 過世秋風 <1040926235@qq.com>
Co-authored-by: Yi Feng <66539215+bigyifeng@users.noreply.github.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
Co-authored-by: Yongtao Huang <99629139+hyongtao-db@users.noreply.github.com>
Co-authored-by: ShadowJobs <794878115@qq.com>
Co-authored-by: LinYing <linying@momenta.ai>
Co-authored-by: Benjamin <benjaminx@gmail.com>
Co-authored-by: LiuBodong <liubodong2010@126.com>
Co-authored-by: huangzhuo1949 <167434202+huangzhuo1949@users.noreply.github.com>
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
Co-authored-by: csurong <csurong1@gmail.com>
Co-authored-by: 傻笑zz <43721571+shaxiaozz@users.noreply.github.com>
Co-authored-by: L8ng <straydragonl@foxmail.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
Co-authored-by: GuanMu <ballmanjq@gmail.com>
Co-authored-by: LittleFish-15 <58618983+LittleFish-15@users.noreply.github.com>
Co-authored-by: 诗浓 <844670992@qq.com>
Co-authored-by: luckylhb90 <luckylhb90@gmail.com>
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: Gen Sato <52241300+halogen22@users.noreply.github.com>
Co-authored-by: twwu <twwu@dify.ai>
Co-authored-by: StoneFancyX <53338920+StoneFancyX@users.noreply.github.com>
Co-authored-by: StoneFancyX <kindbin@qq.com>
Co-authored-by: Naoki KOBAYASHI <naotama@gmail.com>
Co-authored-by: kurokobo <kuro664@gmail.com>
Co-authored-by: cyflhn <cyflhn@163.com>
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: jimmyfen <757343258@qq.com>
Co-authored-by: Xuetao Song <xuetaomagicsong@gmail.com>
Co-authored-by: Panpan <wurui.dev@gmail.com>
Co-authored-by: wyy-holding <59436937+wyy-holding@users.noreply.github.com>
Co-authored-by: リイノ Lin <sorphwer@gmail.com>
Co-authored-by: Ning <accelerator314@gmail.com>
Co-authored-by: Linh Nguyen <55907715+batman0911@users.noreply.github.com>
Co-authored-by: Junjie.M <118170653@qq.com>
Co-authored-by: Ron <svcvit@gmail.com>
Co-authored-by: Novice <novice12185727@gmail.com>
Co-authored-by: NanoNova <kid1412621@gmail.com>
Co-authored-by: JaydenZhou <380774082@qq.com>
Co-authored-by: dotdotdot <823150982@qq.com>
Co-authored-by: Good Wood <slm_1990@126.com>
Co-authored-by: Ryosei Karaki <38310693+karamaru-alpha@users.noreply.github.com>
Co-authored-by: chenhuan0728 <54611342+chenhuan0728@users.noreply.github.com>
Co-authored-by: chenhuan <huan.chen0728@foxmail>
Co-authored-by: lenbo <islenbo@qq.com>
Co-authored-by: Jiang <65766008+AlwaysBluer@users.noreply.github.com>
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
Co-authored-by: Yongtao Huang <yongtaoh2022@gmail.com>
Co-authored-by: zhangkun-21 <sephiroth0932@gmail.com>
Co-authored-by: hsiong <37357447+hsiong@users.noreply.github.com>
Co-authored-by: 李远军 <4842@9ji.com>
Co-authored-by: yourchanges <yourchanges@gmail.com>
Co-authored-by: David <guyuezhuying@126.com>
Co-authored-by: liuzhenghua <1090179900@qq.com>
Co-authored-by: taokuizu <taokuizu@qq.com>
Co-authored-by: Hanqing Zhao <sherry9277@gmail.com>
Co-authored-by: JimintheBox <gjwlals111@gmail.com>
Co-authored-by: wlleiiwang <1025164922@qq.com>
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
Co-authored-by: Alex <32982705+AlexYuan997@users.noreply.github.com>
Co-authored-by: yuanlong <yuanlong@boco.com.cn>
Co-authored-by: wanttobeamaster <45583625+wanttobeamaster@users.noreply.github.com>
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
Co-authored-by: tyounami <vkbo@qq.com>
Co-authored-by: bo.zhao <bo.zhao@iglooinsure.com>
Co-authored-by: ClSlaid <cailue@apache.org>
Co-authored-by: adru <106513264+adpanru@users.noreply.github.com>
Co-authored-by: horochx <32632779+horochx@users.noreply.github.com>
2025-04-26 04:28:30 -07:00
c104febf63
refactor: Apply DI to WorkflowNodeExecutionRepository. ( #18794 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-25 18:05:36 +08:00
9bcc8041e9
fix : #18744 The model order defined in position.yaml in the Model Plugin is not taking effect. ( #18756 )
2025-04-25 16:45:48 +08:00
2627e221f2
fix: buildin tool provider credentials_for_provider ( #18725 )
...
Co-authored-by: hobo.l <hobo.l@binance.com>
2025-04-25 10:08:16 +08:00
5e2b3b34e5
issue: #17056 : Add a reason field to the message_replace event ( #17195 )
...
Co-authored-by: 聂政 <niezheng@pjlab.org.cn>
2025-04-25 10:08:06 +08:00
37e2f73909
[Lindorm VDB] Add the QUERY_TIMEOUT parameter to force the search query to fail. ( #18613 )
...
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
2025-04-25 09:42:58 +08:00
0babdffe3e
feat: support vastbase vector database ( #16308 )
2025-04-24 18:04:57 +08:00
d242e4b95b
fix agentflow error if first variable is num ( #18660 )
...
Co-authored-by: lizb <lizb@sugon.com>
2025-04-24 11:55:29 +08:00
2266001d19
Fix some prompt typos ( #18645 )
2025-04-24 10:36:45 +08:00
e2cb7006c4
check metadata_filtering_conditions could be None in auto mode ( #18548 )
2025-04-22 17:09:33 +08:00
a1158cc946
fix: Update prompt message content types to use Literal and add union type for content ( #17136 )
...
Co-authored-by: 朱庆超 <zhuqingchao@xiaomi.com>
Co-authored-by: crazywoola <427733928@qq.com>
2025-04-22 16:17:55 +08:00
eb1ce3dd6b
feat: support huawei cloud vector database ( #16141 )
2025-04-22 13:03:35 +08:00
7b6523e54d
Update Oracle db connection library and change connection pool to single connection ( #18466 )
2025-04-21 17:56:57 +08:00
f191d372f0
fix(promptMessage): correct field_serializer implementation for content serialization ( #18458 )
2025-04-21 15:09:49 +08:00
cb69cb2d64
fix weird syntax error ( #18454 )
2025-04-21 14:18:32 +08:00
44a2eca449
refactor: Refactors workflow node execution handling ( #18382 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-18 20:06:24 +08:00
da9269ca97
feat: structured output ( #17877 )
2025-04-18 16:33:53 +08:00
d2e3744ca3
Switching from CONSOLE_API_URL to FILES_URL in word_extractor.py ( #18249 )
2025-04-18 16:05:48 +08:00
dc9c5a4bc7
make repository type be private ( #18304 )
...
Co-authored-by: lizb <lizb@sugon.com>
2025-04-17 18:49:22 +08:00
e90c532c3a
fix retrival resource miss in chatflow ( #18307 )
2025-04-17 18:05:15 +08:00
defd5520ea
fix: invalid new tool call creation logic during response handling in OAI-Compat model ( #17781 )
2025-04-17 16:52:49 +08:00
22a1bc337f
fix: perferred model provider not match with provider. ( #18282 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-17 15:44:00 +08:00
83f1aeec1d
Fix ORDER BY (score, id) error in api/core/rag/datasource/vdb/analyticdb/analyticdb_vector_sql.py line 249 ( #18252 )
2025-04-17 14:15:05 +08:00
6d9dd3109e
feat: add a abstract layer for WorkflowNodeExcetion ( #18026 )
2025-04-17 12:48:52 +09:00
6d66e3f680
fix(follow_ups): handle empty LLM responses in context ( #18237 )
2025-04-17 10:41:56 +08:00
e8d98e3d89
Add analyzer_params config for milvus vectordb ( #18180 )
2025-04-17 10:38:56 +08:00
c91045a9d0
fix(fail-branch): prevent streaming output in exception branches ( #17153 )
2025-04-16 22:34:07 +08:00
358fd28c28
feat: fetch app info in plugins ( #18202 )
2025-04-16 20:27:29 +08:00
QuantumGhost