dify/web/app
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372)
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2025-04-30 17:28:02 +08:00
..
(commonLayout) Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
(shareLayout) Chore: frontend infrastructure upgrade (#16420) 2025-03-21 17:41:03 +08:00
account Feat/loop break node (#17268) 2025-04-01 16:52:07 +08:00
activate chore: independent page style update (#17176) 2025-03-31 15:44:04 +08:00
components feat(api): Add image multimodal support for LLMNode (#17372) 2025-04-30 17:28:02 +08:00
dev-only feat: add i18n checker (ui) (#17283) 2025-04-02 13:58:31 +08:00
dev-preview feat/TanStack-Form (#18346) 2025-04-18 15:54:22 +08:00
education-apply refactor: type improvements that doesn't modify functionality (#17970) 2025-04-14 16:06:10 +08:00
forgot-password feat: add base path to resources (#17655) 2025-04-15 17:05:50 +08:00
init feat: add base path to resources (#17655) 2025-04-15 17:05:50 +08:00
install Added the missing path of the webpath prefix and the prefix basepath + of static resources to remove the bug of adding more basepath. (#18658) 2025-04-24 17:14:26 +08:00
repos/[owner]/[repo]/releases Introduce Plugins (#13836) 2025-02-17 17:05:13 +08:00
reset-password fix: update reset password token when email code verify success (#18364) 2025-04-18 17:14:51 +08:00
signin Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
styles Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
layout.tsx feat: add missing switches (#18619) 2025-04-23 18:02:18 +08:00
page.module.css Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
page.tsx Chore: frontend infrastructure upgrade (#16420) 2025-03-21 17:41:03 +08:00
routePrefixHandle.tsx feat: add base path to resources (#17655) 2025-04-15 17:05:50 +08:00