opensource
/
dify
mirror of https://github.com/langgenius/dify.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,198 Commits 288 Branches 160 Tags 496 MiB
Commit Graph

183 Commits

Author SHA1 Message Date
Jyong d8f57bf899
Feat/new saas billing (#12591) 2025-01-12 14:50:46 +08:00
Jyong 14ee51aead
Feat/add knowledge include all filter (#12537) 2025-01-09 20:21:25 +08:00
Jyong bee32d960a
fix #12453 #12482 (#12495) 2025-01-08 18:26:05 +08:00
Hiroshi Fujita d2586278d6
Feat elasticsearch japanese (#12194) 2025-01-08 12:35:41 +08:00
Jyong 84ac004772
py lint (#12102) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-12-26 00:16:35 +08:00
-LAN- d5f33212ac
fix: add type ignore comments for shared_task imports and clean up re… (#12099) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-25 21:24:06 +08:00
Jyong 9231fdbf4c
Feat/support parent child chunk (#12092) 2024-12-25 19:49:07 +08:00
yihong 56e15d09a9
feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
-LAN- 259cff9f22
fix(api/ops_trace): avoid raise exception directly (#11732) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-17 13:38:57 +08:00
Hiroshi Fujita 1d8385f7ac
Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230) 2024-12-02 15:29:25 +08:00
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 2024-11-24 13:28:46 +08:00
Garfield Dai c2ce2f88c7
feat: add license. (#10403) 2024-11-15 17:59:36 +08:00
Bowen Liang 51db59622c
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 2024-11-15 15:41:40 +08:00
Jyong d52c750942
embedding model check when init the knowledge (#10463) 2024-11-08 17:14:56 +08:00
Bowen Liang 574c4a264f
chore(lint): Use logging.exception instead of logging.error (#10415) 2024-11-07 21:13:02 +08:00
Jiang 0c9e79cd67
Add Lindorm as a VDB choice (#10202) 
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
 2024-11-04 09:10:26 +08:00
-LAN- 9ac2bb30f4
Feat/add-remote-file-upload-api (#9906) 2024-11-01 15:51:22 +08:00
powerfool 878d13ef42
Added OceanBase as an option for the vector store in Dify (#10010) 2024-10-29 21:10:18 +08:00
roadgoat19 c8ef9223e5
feat: couchbase integration (#6165) 
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Elliot Scribner <elliot.scribner@couchbase.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
 2024-10-29 15:00:23 +08:00
Jyong 18106a4fc6
add tidb on qdrant type (#9831) 
Co-authored-by: Zhaofeng Miao <522856232@qq.com>
 2024-10-25 13:57:03 +08:00
郭伟伟 90769ac709
feat: create_empty_dataset api add the description parameter and update api docs (#9824) 2024-10-25 10:50:15 +08:00
ice yao ceb2c4f3ef
chore: reuse existing test functions with upstash vdb (#9679) 2024-10-23 10:42:11 +08:00
Zven 8e7a752b2a
feat: add upstash as a new vector database provider (#9644) 2024-10-23 09:16:35 +08:00
-LAN- 36f66d40e5
refactor(api): simplify limit retrieval and return types (#9641) 2024-10-22 16:34:16 +08:00
-LAN- 8d8a8fe295
feat(file-upload): add support for optional file source parameter (#9554) 2024-10-21 17:46:24 +08:00
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
Summer-Gu 8501af298f
feat: added dataset recall testing API (#9300) 2024-10-14 17:26:04 +08:00
ice yao d15ba3939d
Add Volcengine VikingDB as new vector provider (#9287) 2024-10-13 21:26:05 +08:00
Shili Cao 2ec6ffe478
feat:support baidu vector db (#9185) 2024-10-12 23:24:17 +08:00
Jyong 42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 2024-10-11 19:21:03 +08:00
Jyong 9d221a5e19
external knowledge api (#8913) 
Co-authored-by: Yi <yxiaoisme@gmail.com>
 2024-09-30 15:38:43 +08:00
Zhaofeng Miao 369e1e6f58
feat(website-crawl): add jina reader as additional alternative for website crawling (#8761) 2024-09-30 09:57:19 +08:00
ice yao 27e33fb15c
chore: fix wrong VectorType match case (#8857) 2024-09-28 10:54:04 +08:00
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2024-09-13 22:42:08 +08:00
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2024-09-13 14:24:49 +08:00
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2024-09-12 15:50:49 +08:00
Jyong 85ff82a694
code merge error (#8183) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-09-10 12:52:50 +08:00
Nam Vu 2d7954c7da
Fix variable typo (#8084) 2024-09-08 13:14:11 +08:00
crazywoola c441bea4d1
fix: datasets permission is missing (#7787) 2024-08-29 12:46:33 +08:00
Garfield Dai 54b693d5b1
feat: update saas billing hint. (#7760) 2024-08-28 18:55:47 +08:00
Jiakun Xu e38334cfd2
fix: doc_language return null when document segment settings (#7719) 2024-08-28 08:45:51 +08:00
-LAN- 13be84e4d4
chore(api/controllers): Apply Ruff Formatter. (#7645) 2024-08-26 15:29:10 +08:00
crazywoola 2c427e04be
Feat/7134 use dataset api create a dataset with permission (#7508) 2024-08-21 20:25:45 +08:00
Jyong 0f90e6df75
add pgvector full text search settting (#7427) 2024-08-20 13:20:19 +08:00
feng0 2fe2e350ce
add secondary sort_key when using `order_by` and `paginate` at the same time (#7225) 2024-08-13 17:39:51 +08:00
miendinh f104b930cf
feat: support elasticsearch vector database (#3558) 
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2024-08-13 17:36:20 +08:00
TzuxinChen f0d10553b4
Fixed a bug where permission was clearly displaye… (#6934) 2024-08-05 13:19:01 +08:00
liuzhenghua ef616c604a
fix: The permissions issue of the editor role accessing some backend … (#6945) 
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
 2024-08-05 12:55:55 +08:00
Jyong 048bc4c06e
fix update dataset failed when embedding model is not exist (#6920) 2024-08-02 20:30:22 +08:00
tmuife 06fc1bce9e
Add search by full text when using Oracle23ai as vector DB (#6559) 2024-07-23 15:03:21 +08:00
Shoya SHIRAKI c57b3931d5
refactor(api): switch to dify_config in controllers/console (#6485) 2024-07-21 01:11:40 +08:00
Bowen Liang 7943f7f697
chore: fix legacy API usages of Query.get() by Session.get() in SqlAlchemy 2 (#6340) 2024-07-17 13:54:35 +08:00
Jyong 0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2024-07-16 19:09:04 +08:00
Zhuo Qiu 63e34e5227
feat: support MyScale vector database (#6092) 2024-07-11 15:21:59 +08:00
Joe ce930f19b9
fix dataset operator (#6064) 
Co-authored-by: JzoNg <jzongcode@gmail.com>
 2024-07-09 17:47:54 +08:00
8bitpd 7c70eb87bc
feat: support AnalyticDB vector store (#5586) 
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
 2024-07-09 13:32:04 +08:00
takatost 79df8825c8
Revert "feat: knowledge admin role" (#6018) 2024-07-05 21:31:34 +08:00
Joe 5d9ad430af
feat: knowledge admin role (#5965) 
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
 2024-07-04 16:21:40 +08:00
Jyong 71bcf75d9a
Feat/add delete knowledge confirm (#5810) 2024-07-01 17:06:51 +08:00
Jyong 43335b5c87
delete the deprecated method (#5612) 2024-06-26 12:51:50 +08:00
kurokobo c5d64baba4
fix: correct typos (#5510) 2024-06-22 23:01:02 +08:00
tmuife 6a09409ec9
Add Oracle23ai as a vector datasource (#5342) 
Co-authored-by: walter from vm <walter.jin@oracle.com>
 2024-06-22 01:48:07 +08:00
Bowen Liang c923684edd
chore: extract retrival method literal values into enum (#5060) 2024-06-19 16:05:27 +08:00
baojingyu d160d1ed02
feat: support opensearch approximate k-NN (#5322) 2024-06-19 12:44:33 +08:00
Jyong ba5f8afaa8
Feat/firecrawl data source (#5232) 
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
 2024-06-15 02:46:02 +08:00
Charles Zhou 8bcc5a36bb
feat: new editor user permission profile (#4435) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2024-06-14 20:34:25 +08:00
quicksand 4080f7b8ad
feat: support tencent vector db (#3568) 2024-06-14 19:25:17 +08:00
Summer-Gu 7f98c2ea3f
refactor: Delete the dataset to verify whether it is in use (#5112) 2024-06-14 03:25:38 +08:00
Bowen Liang cdc08a434f
feat: support Chroma vector store (#5015) 2024-06-13 18:02:18 +08:00
Bowen Liang bdad993901
improve: generalize vector factory classes and vector type (#5033) 2024-06-08 22:29:24 +08:00
Weaxs 0797f9bc05
feat: support tidb vector (#4588) 2024-06-05 18:19:53 +08:00
Jyong 4e3b0c5aea
support rename document (#4915) 2024-06-04 20:07:40 +08:00
Moonlit 86e7c7321f
Fixed a bug where any content in the 'fetch' was converted to True (#4400) 2024-06-04 13:27:23 +08:00
LiuVaayne 875249eb00
Feat/vector db pgvector (#3879) 2024-05-10 17:20:30 +08:00
Jyong 3e9dbe3e0a
add pgvecto_rs support and upgrade SQLAlchemy (#3833) 2024-04-29 11:58:17 +08:00
羊羽 975b2fb79e
delete duplicate check get_dataset (#3966) 
Co-authored-by: baxiang <baxiang@lixiang.com>
 2024-04-29 11:57:26 +08:00
Jingpan Xiong 1be222af2e
fix: using api can not execute relyt vector database (#3766) 
Co-authored-by: jingsi <jingsi@leadincloud.com>
 2024-04-25 19:46:20 +08:00
Jyong f257f2c396
Knowledge optimization (#3755) 
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
 2024-04-24 15:02:29 +08:00
Jyong 394ceee141
optimize question classifier prompt and support keyword hit test (#3565) 2024-04-17 17:40:40 +08:00
LIU HONGWEI c227f3d985
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416) 2024-04-12 16:22:24 +08:00
Jyong e12a0c154c
add segment function billing check for SAAS env (#3082) 
Co-authored-by: jyong <jyong@dify.ai>
 2024-04-02 17:55:49 +08:00
Garfield Dai 8e66b96221
Feat: Add documents limitation (#2662) 2024-03-03 12:45:06 +08:00
Jyong 5b953c1ef2
Fix some RAG bugs (#2570) 
Co-authored-by: jyong <jyong@dify.ai>
 2024-02-27 11:39:05 +08:00
Jyong 6c4e6bf1d6
Feat/dify rag (#2528) 
Co-authored-by: jyong <jyong@dify.ai>
 2024-02-22 23:31:57 +08:00
Bowen Liang 063191889d
chore: apply ruff's pyupgrade linter rules to modernize Python code with targeted version (#2419) 2024-02-09 15:21:33 +08:00
Bowen Liang 14a19a3da9
chore: apply ruff's pyflakes linter rules (#2420) 2024-02-08 14:11:10 +08:00
Bowen Liang 843280f82b
enhancement: introduce Ruff for Python linter for reordering and removing unused imports with automated pre-commit and sytle check (#2366) 2024-02-06 13:21:13 +08:00
takatost 9f637ead38
bump version to 0.5.3 (#2306) 2024-02-01 18:11:57 +08:00
crazywoola 828822243a
fix: multiple rows were found correctly (#2219) 2024-01-26 12:47:42 +08:00
crazywoola 1f48e3d44a
feat: support legacy doc (#2100) 2024-01-20 22:21:51 +08:00
crazywoola ec1659cba0
fix: saving error in empty dataset (#2098) 2024-01-19 20:12:04 +08:00
Bowen Liang cc9e74123c
improve: introduce isort for linting Python imports (#1983) 2024-01-12 12:34:01 +08:00
Jyong 5e75f7022f
fix data_source_detail_dict parameter error (#2000) 
Co-authored-by: jyong <jyong@dify.ai>
 2024-01-11 17:49:20 +08:00
Jyong 4d99c689f0
prohibit enable and disable function when segment is not completed (#1954) 
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
 2024-01-05 18:18:38 +08:00
takatost 4562e83b24
fix: hit testing throws errors cause internal server error (#1865) 2024-01-03 08:57:39 +08:00
takatost d069c668f8
Model Runtime (#1858) 
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
 2024-01-02 23:42:00 +08:00
Jyong e91dd28a76
fix file estimate issue (#1860) 
Co-authored-by: jyong <jyong@dify.ai>
 2024-01-02 16:25:59 +08:00
taokuizu 10fc44e2af
fix typo (#1791) 2023-12-19 17:23:49 +08:00
Jyong 5e34f938c1
Feat/add unstructured support (#1780) 
Co-authored-by: jyong <jyong@dify.ai>
 2023-12-18 23:24:06 +08:00
Garfield Dai 7b8a10f3ea
feat: billing enhancement 20231204 (#1691) 
Co-authored-by: jyong <jyong@dify.ai>
 2023-12-05 16:53:55 +08:00