opensource/dify
2
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-09-01 13:47:18 +08:00
Code Issues Packages Projects Releases Wiki Activity
12,971 Commits 816 Branches 177 Tags 1.3 GiB
stack/integration-tests-04-code-node
Commit Graph

675 Commits

Author SHA1 Message Date
Asuka Minato
51a8f79d67
chore: DocumentSegment to Typebase (#35635) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-05-12 07:02:17 +00:00
Asuka Minato
1a011dc14a
refactor: port DatasetProcessRule (#31004) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-05-11 03:37:26 +00:00
FFXN
f720a3bed2
fix: Image rendering in the knowledge base failed. (#35914) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
 2026-05-09 10:06:01 +00:00
kien duong
1f29565673
fix(rag): use doc_id dedup key for any provider, not only dify (#35759) 
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-05-05 06:42:18 +00:00
Prince Pal
4b7dc17546
fix: skip empty documents before vector embedding (#35763) 
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-05-04 13:06:58 +00:00
zyssyz123
949f930698
fix: keep cleanup tasks resilient to billing API failures (#35600) 2026-04-27 08:51:09 +00:00
Asuka Minato
ef7ff3356d
refactor: port ChildChunk (#30920) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-26 00:59:22 +00:00
tmimmanuel
ed8d3f3e8d
refactor(api): fix pyright errors in jieba, milvus, couchbase, oracle, and router (#34938) 
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
 2026-04-23 22:30:28 +00:00
tmimmanuel
77f8f2babb
refactor(api): tighten core rag typing batch 1 (#35210) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-21 04:32:43 +00:00
99
3e876e173a
chore(api): adapt Graphon 0.2.2 upgrade (#35377) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-18 11:16:24 +00:00
Yunlu Wen
3193e8a712
chore: reorg imports (#35308) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-16 08:50:02 +00:00
Ayush Baluni
54e51be665
fix: apply score threshold after reranking in hybrid search (#35263) 2026-04-16 06:21:11 +00:00
tmimmanuel
ef28a63ad3
refactor(api): add null safety to extractor_processor and firecrawl (#35209) 
Co-authored-by: tmimmanuel <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>
 2026-04-14 18:23:20 +00:00
dataCenter430
fbedb60371
refactor: replace bare dict with typed annotations in core rag module (#35097) 2026-04-14 06:16:16 +00:00
wdeveloper16
eeebedcfe8
refactor: replace bare dict with dict[str, Any] in core provider services and misc modules (#35124) 2026-04-14 03:03:08 +00:00
wdeveloper16
9ed8a5ed73
refactor: replace bare dict with dict[str, Any] in model_manager and … (#35083) 2026-04-13 17:14:08 +00:00
wdeveloper16
06b63d65d1
refactor: replace bare dict with dict[str, Any] in rag extractors (#35068) 2026-04-13 14:05:21 +00:00
wdeveloper16
1b935a367f
refactor: replace bare dict with dict[str, Any] in watercrawl client (#35063) 2026-04-13 13:01:32 +00:00
Yunlu Wen
ae898652b2
refactor: move vdb implementations to workspaces (#34900) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: wangxiaolei <fatelei@gmail.com>
 2026-04-13 08:56:43 +00:00
wangxiaolei
fc64427ae1
fix: fix qdrant delete size is too large (#35042) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-13 07:59:06 +00:00
corevibe555
2108c44c8b
refactor(api): consolidate duplicate RerankingModelConfig and WeightedScoreConfig definitions (#34747) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-13 05:53:45 +00:00
sxxtony
7dd507af04
refactor: migrate SegmentAttachmentBinding to TypeBase (#34810) 2026-04-13 05:22:43 +00:00
XHamzaX
596559efc9
fix(rag): include is_summary and original_chunk_id in default vector projection (#34950) 
Co-authored-by: VFootball Dev <vfootball@example.com>
 2026-04-13 03:11:08 +00:00
wdeveloper16
12814b55d2
refactor(api): migrate core RAG layer to SQLAlchemy 2.0 select() API (#34965) 2026-04-11 16:32:20 +00:00
volcano303
c41b62f47e
refactor(api): type format_preview returns with TypedDicts in index processors (#34893) 2026-04-10 05:01:01 +00:00
carlos4s
86fd94767c
refactor(api): use sessionmaker in relyt & tidb_vector VDB services (#34848) 2026-04-10 03:16:25 +00:00
corevibe555
d826ac7099
refactor(models): replace Any with precise types in Tenant and MCPToo… (#34880) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-10 03:12:38 +00:00
dataCenter430
c5c5c71d15
refactor(api): type OpenSearch/Lindorm/Huawei VDB config params dicts with TypedDicts (#34870) 2026-04-10 00:34:34 +00:00
carlos4s
d360929af1
refactor(api): use sessionmaker in pgvecto_rs VDB service (#34818) 2026-04-09 05:49:03 +00:00
tmimmanuel
1a4eb47e1d
refactor(api): tighten types in trivial lint and config fixes (#34773) 
Co-authored-by: tmimmanuel <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>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-08 23:14:44 +00:00
carlos4s
4c70bfa8b8
refactor(api): use sessionmaker in trigger provider service & dataset… (#34774) 2026-04-08 23:13:38 +00:00
corevibe555
5cd267d755
refactor(api): deduplicate RAG index entities and consolidate import paths (#34690) 2026-04-08 02:49:40 +00:00
corevibe555
c825d5dcf6
refactor(api): tighten types for Tenant.custom_config_dict and MCPToolProvider.headers (#34698) 2026-04-08 01:36:42 +00:00
corevibe555
624db69f12
refactor(api): remove duplicated RAG entities from services layer (#34689) 2026-04-07 23:36:59 +00:00
corevibe555
80a7843f45
refactor(api): migrate consumers to shared RAG domain entities from core/rag/entities/ (#34692) 2026-04-07 23:22:56 +00:00
corevibe555
d2ee486900
refactor(api): extract shared RAG domain entities into core/rag/entity (#34685) 2026-04-07 22:43:37 +00:00
Statxc
c44ddd9831
refactor(api): type Chroma and AnalyticDB config params dicts with TypedDicts (#34678) 2026-04-07 13:27:12 +00:00
Statxc
e645cbd8f8
refactor(api): type VDB config params dicts with TypedDicts (#34677) 2026-04-07 13:23:42 +00:00
Statxc
597a0b4d9f
refactor(api): type indexing result with IndexingResultDict TypedDict (#34672) 2026-04-07 13:17:39 +00:00
Statxc
779cce3c61
refactor(api): type gen_index_struct_dict with VectorIndexStructDict TypedDict (#34675) 2026-04-07 13:17:20 +00:00
Statxc
b5d9a71cf9
refactor(api): type VDB to_index_struct with VectorIndexStructDict TypedDict (#34674) 2026-04-07 13:17:04 +00:00
Renzo
72adb5468c
refactor: migrate session.query to select API in retrieval_service (#34638) 2026-04-07 04:46:30 +00:00
dependabot[bot]
5b862a43e0
chore(deps-dev): bump the dev group in /api with 6 updates (#34579) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
 2026-04-06 11:49:54 +00:00
99
8f9dbf269e
chore(api): align Python support with 3.12 (#34419) 
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
 2026-04-02 05:07:32 +00:00
jimmyzhuu
b23ea0397a
fix: apply Baidu Vector DB connection timeout when initializing Mochow client (#34328) 2026-04-01 06:16:09 +00:00
Dream
c51cd42cb4
refactor(api): replace json.loads with Pydantic validation in controllers and infra layers (#34277) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-01 05:41:44 +00:00
Full Stack Engineer
09ee8ea1f5
fix: support qa_preview shape in IndexProcessor preview formatting (#34151) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Crazywoola <100913391+crazywoola@users.noreply.github.com>
 2026-04-01 04:22:23 +00:00
wangxiaolei
57f358a96b
perf: use global httpx client instead of per request create new one (#34311) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-04-01 01:19:32 +00:00
99
f27d669f87
chore: normalize frozenset literals and myscale typing (#34327) 2026-03-31 08:21:22 +00:00
Renzo
456684dfc3
refactor: core/rag docstore, datasource, embedding, rerank, retrieval (#34203) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
 2026-03-30 08:09:49 +00:00
99
40591a7c50
refactor(api): use standalone graphon package (#34209) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-27 21:05:32 +00:00
Achieve3318
5341cd015b
fix: dataset query created_by empty UUID in iteration subgraph (#34004) (#34044) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-26 14:57:19 +08:00
99
52e7492cbc
refactor(api): rename dify_graph to graphon (#34095) 2026-03-25 21:58:56 +08:00
-LAN-
56593f20b0
refactor(api): continue decoupling dify_graph from API concerns (#33580) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: WH-2099 <wh2099@pm.me>
 2026-03-25 20:32:24 +08:00
tmimmanuel
d87263f7c3
refactor: select in console datasets document controller (#34029) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-25 12:47:25 +09:00
Rajat Agarwal
6f137fdb00
test: unit test cases for rag.cleaner, rag.data_post_processor and rag.datasource (#32521) 2026-03-25 02:19:15 +08:00
tmimmanuel
cc17c8e883
refactor: use EnumText for TidbAuthBinding.status and MessageFile.type (#33975) 2026-03-24 05:38:29 +09:00
kurokobo
30deeb6f1c
feat(firecrawl): follow pagination when crawl status is completed (#33864) 
Co-authored-by: Crazywoola <100913391+crazywoola@users.noreply.github.com>
 2026-03-23 21:19:32 +08:00
letterbeezps
56e0907548
fix: do not block upsert for baidu vdb (#33280) 
Co-authored-by: zhangping24 <zhangping24@baidu.com>
Co-authored-by: Crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-23 20:42:57 +08:00
wangxiaolei
40846c262c
perf: tidb_on_qdrant_vector delete_by_ids use batch delete (#33846) 2026-03-22 21:09:43 +09:00
BitToby
f40f6547b4
refactor(api): type bare dict/list annotations in remaining rag folder (#33775) 2026-03-20 03:31:06 +09:00
tmimmanuel
e4f1d3c63a
refactor: use EnumText(StorageType) for UploadFile.storage_type (#33728) 2026-03-19 15:15:32 +09:00
BitToby
9ff0d9df88
refactor(api): type WaterCrawl API responses with TypedDict (#33700) 2026-03-19 10:35:44 +09:00
BitToby
b2a388b7bf
refactor(api): type Firecrawl API responses with TypedDict (#33691) 2026-03-19 04:00:06 +09:00
BitToby
25ab5e46b3
refactor(api): type default_retrieval_model with DefaultRetrievalModelDict in core/rag (#33676) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-18 22:47:51 +09:00
wangxiaolei
a87b928079
feat: remove weaviate client __del__ method (#33593) 
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-18 17:39:59 +08:00
BitToby
3454224ff9
refactor(api): replace dict with SummaryIndexSettingDict TypedDict in core/rag (#33633) 2026-03-18 13:26:49 +09:00
BitToby
485da15a4d
refactor(api): replace dict/Mapping with TypedDict in core/rag retrieval_service.py (#33615) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-18 11:49:09 +09:00
tmimmanuel
3870b2ad2d
refactor: use EnumText for dataset and replace string literals 4 (#33606) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-18 09:18:08 +09:00
Sage
3920d67b8e
feat(api): Making WeaviateClient a singleton 
Co-authored-by: lijiezhao <lijiezhao@perfect99.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-16 13:38:28 +08:00
eason
551df6ee9c
fix: use parameterized queries to prevent SQL injection in vector stores (#33421) 
Co-authored-by: easonysliu <easonysliu@tencent.com>
Co-authored-by: Claude (claude-opus-4-6) <noreply@anthropic.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-16 09:41:57 +08:00
Tyson Cung
98d9fb4aff
fix: downgrade image download failure log from ERROR to WARNING (#33429) 2026-03-15 23:04:09 +08:00
Ye Ding
f795d24151
feat: Add Hologres as a VDB & FullText DB choice (#32830) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Crazywoola <100913391+crazywoola@users.noreply.github.com>
 2026-03-15 20:55:02 +08:00
RickDamon
ac8021fe27
fix: add doc_type to Weaviate properties and default Vector attributes (#33398) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-15 19:25:24 +08:00
-LAN-
fb41b215c8
refactor(api): move workflow knowledge nodes and trigger nodes (#33445) 2026-03-15 15:24:59 +08:00
tmimmanuel
e64f4d6039
refactor: replace sa.String with EnumText in mapped_column for type s… (#33332) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-14 13:38:27 +09:00
wangxiaolei
54637144c5
fix: fix parse mailto / http link in table cell (#33224) 
Co-authored-by: Oz <oz-agent@warp.dev>
 2026-03-11 10:02:33 +08:00
wangxiaolei
27f9cdedad
fix: fix failed test (#33241) 2026-03-11 09:37:19 +08:00
wangxiaolei
db627e75f6
fix: fix request.metadata_model_config param check (#33189) 2026-03-10 15:09:35 +08:00
Lovish Arora
f751864ab3
fix(api): return inserted ids from Chroma and Clickzetta add_texts (#33065) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-03-06 09:49:53 +08:00
-LAN-
4fd6b52808
refactor(api): move model_runtime into dify_graph (#32858) 2026-03-02 20:15:32 +08:00
-LAN-
c917838f9c
refactor: move workflow package to dify_graph (#32844) 2026-03-02 18:42:30 +08:00
wangxiaolei
707bf20c29
refactor: knowledge index node decouples business logic (#32274) 2026-03-02 17:54:33 +08:00
wangxiaolei
5c7a293ba7
feat: ensure document id is not missing (#32765) 2026-03-02 16:28:31 +08:00
-LAN-
ef2b5d6107
refactor(api): move llm quota deduction to app graph layer (#32786) 2026-03-01 23:25:36 +08:00
盐粒 Yanli
bc6fd0b5dd
chore: remove ty from backend type-check pipeline (#32782) 2026-03-01 19:10:24 +08:00
Br1an
d4c508cf8e
fix(api): add explicit return type annotations to clean() methods (#32772) 2026-03-01 17:09:43 +09:00
FFXN
de4dac89ae
fix: Fixed the adaptation issue of response formats for different mod… (#32326) 2026-03-01 10:23:17 +08:00
-LAN-
a694533fc9
refactor(workflow): inject credential/model access ports into LLM nodes (#32569) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2026-02-27 14:36:41 +08:00
longway
a1991c51e4
fix: add explicit return type annotations to BaseVector abstract methods (#32516) 2026-02-24 21:17:55 +09:00
木之本澪
f76ee7cfa4
fix: add return type annotation to BaseVector.create (#32475) 
Co-authored-by: KinomotoMio <200703522+KinomotoMio@users.noreply.github.com>
 2026-02-23 22:28:40 +09:00
99
7656d514b9
refactor(workflow-file): move core.file to core.workflow.file (#32252) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-02-16 22:38:19 +08:00
Conner Mo
16df9851a2
feat(api): optimize OceanBase vector store performance and configurability (#32263) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-02-13 09:48:55 +08:00
wangxiaolei
3348b89436
refactor: decouple database operations from knowledge retrieval nodes (#31981) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-02-09 13:56:55 +08:00
FFXN
41177757e6
fix: summary index bug (#31810) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: Yansong Zhang <916125788@qq.com>
Co-authored-by: hj24 <mambahj24@gmail.com>
Co-authored-by: CodingOnStar <hanxujiang@dify.ai>
Co-authored-by: CodingOnStar <hanxujiang@dify.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-02 09:45:17 +08:00
盐粒 Yanli
dbfc47e8b0
fix: SSRF in WordExtractor URL download (credit to @EaEa0001 ) (#31678) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-29 14:01:21 +08:00
FFXN
c2473d85dc
feat: Add summary index for knowledge. (#31625) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: Yansong Zhang <916125788@qq.com>
Co-authored-by: hj24 <mambahj24@gmail.com>
Co-authored-by: CodingOnStar <hanxujiang@dify.ai>
Co-authored-by: CodingOnStar <hanxujiang@dify.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-29 13:47:35 +08:00
eux
b48a10d7ec
feat(qdrant): implement full-text search with multi-keyword support (#31658) 2026-01-29 11:12:18 +08:00
TomoOkuyama
0772d49257
fix(api): fix IRIS hybrid search returning zero results (#31309) 
Co-authored-by: Tomo Okuyama <tomo.okuyama@intersystems.com>
 2026-01-24 10:29:19 +08:00
Sara Rasool
4f0fb6df2b
chore: use from __future__ import annotations (#30254) 
Co-authored-by: Dev <dev@Devs-MacBook-Pro-4.local>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2026-01-06 23:57:20 +09:00