-LAN-
3ff88f4f3c
refactor(api): consolidate allowed extensions handling
...
- Unified allowed extensions into a single `DOCUMENT_EXTENSIONS` reference
- Adjusted checks and imports in controllers and services to use the new constant
- Enhanced text extraction to support additional file types (EPUB, EML, MSG)
2024-09-30 23:32:51 +08:00
-LAN-
584053bc01
feat(api): Enhance multi modal support.
2024-09-30 23:32:51 +08:00
Jyong
9d221a5e19
external knowledge api ( #8913 )
...
Co-authored-by: Yi <yxiaoisme@gmail.com>
2024-09-30 15:38:43 +08:00
Zhaofeng Miao
369e1e6f58
feat(website-crawl): add jina reader as additional alternative for website crawling ( #8761 )
2024-09-30 09:57:19 +08:00
ice yao
27e33fb15c
chore: fix wrong VectorType match case ( #8857 )
2024-09-28 10:54:04 +08:00
Bowen Liang
a1104ab97e
chore: refurish python code by applying Pylint linter rules ( #8322 )
2024-09-13 22:42:08 +08:00
Bowen Liang
6613b8f2e0
chore: fix unnecessary string concatation in single line ( #8311 )
2024-09-13 14:24:49 +08:00
Bowen Liang
40fb4d16ef
chore: refurbish Python code by applying refurb linter rules ( #8296 )
2024-09-12 15:50:49 +08:00
Jyong
85ff82a694
code merge error ( #8183 )
...
Co-authored-by: crazywoola <427733928@qq.com>
2024-09-10 12:52:50 +08:00
Nam Vu
2d7954c7da
Fix variable typo ( #8084 )
2024-09-08 13:14:11 +08:00
crazywoola
c441bea4d1
fix: datasets permission is missing ( #7787 )
2024-08-29 12:46:33 +08:00
Garfield Dai
54b693d5b1
feat: update saas billing hint. ( #7760 )
2024-08-28 18:55:47 +08:00
Jiakun Xu
e38334cfd2
fix: doc_language return null when document segment settings ( #7719 )
2024-08-28 08:45:51 +08:00
-LAN-
13be84e4d4
chore(api/controllers): Apply Ruff Formatter. ( #7645 )
2024-08-26 15:29:10 +08:00
crazywoola
2c427e04be
Feat/7134 use dataset api create a dataset with permission ( #7508 )
2024-08-21 20:25:45 +08:00
Jyong
0f90e6df75
add pgvector full text search settting ( #7427 )
2024-08-20 13:20:19 +08:00
feng0
2fe2e350ce
add secondary sort_key when using `order_by` and `paginate` at the same time ( #7225 )
2024-08-13 17:39:51 +08:00
miendinh
f104b930cf
feat: support elasticsearch vector database ( #3558 )
...
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-08-13 17:36:20 +08:00
TzuxinChen
f0d10553b4
Fixed a bug where permission was clearly displaye… ( #6934 )
2024-08-05 13:19:01 +08:00
liuzhenghua
ef616c604a
fix: The permissions issue of the editor role accessing some backend … ( #6945 )
...
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-05 12:55:55 +08:00
Jyong
048bc4c06e
fix update dataset failed when embedding model is not exist ( #6920 )
2024-08-02 20:30:22 +08:00
tmuife
06fc1bce9e
Add search by full text when using Oracle23ai as vector DB ( #6559 )
2024-07-23 15:03:21 +08:00
Shoya SHIRAKI
c57b3931d5
refactor(api): switch to dify_config in controllers/console ( #6485 )
2024-07-21 01:11:40 +08:00
Bowen Liang
7943f7f697
chore: fix legacy API usages of Query.get() by Session.get() in SqlAlchemy 2 ( #6340 )
2024-07-17 13:54:35 +08:00
Jyong
0de224b153
fix wrong using of RetrievalMethod Enum ( #6345 )
2024-07-16 19:09:04 +08:00
Zhuo Qiu
63e34e5227
feat: support MyScale vector database ( #6092 )
2024-07-11 15:21:59 +08:00
Joe
ce930f19b9
fix dataset operator ( #6064 )
...
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-09 17:47:54 +08:00
8bitpd
7c70eb87bc
feat: support AnalyticDB vector store ( #5586 )
...
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-07-09 13:32:04 +08:00
takatost
79df8825c8
Revert "feat: knowledge admin role" ( #6018 )
2024-07-05 21:31:34 +08:00
Joe
5d9ad430af
feat: knowledge admin role ( #5965 )
...
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2024-07-04 16:21:40 +08:00
Jyong
71bcf75d9a
Feat/add delete knowledge confirm ( #5810 )
2024-07-01 17:06:51 +08:00
Jyong
43335b5c87
delete the deprecated method ( #5612 )
2024-06-26 12:51:50 +08:00
kurokobo
c5d64baba4
fix: correct typos ( #5510 )
2024-06-22 23:01:02 +08:00
tmuife
6a09409ec9
Add Oracle23ai as a vector datasource ( #5342 )
...
Co-authored-by: walter from vm <walter.jin@oracle.com>
2024-06-22 01:48:07 +08:00
Bowen Liang
c923684edd
chore: extract retrival method literal values into enum ( #5060 )
2024-06-19 16:05:27 +08:00
baojingyu
d160d1ed02
feat: support opensearch approximate k-NN ( #5322 )
2024-06-19 12:44:33 +08:00
Jyong
ba5f8afaa8
Feat/firecrawl data source ( #5232 )
...
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-15 02:46:02 +08:00
Charles Zhou
8bcc5a36bb
feat: new editor user permission profile ( #4435 )
...
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-14 20:34:25 +08:00
quicksand
4080f7b8ad
feat: support tencent vector db ( #3568 )
2024-06-14 19:25:17 +08:00
Summer-Gu
7f98c2ea3f
refactor: Delete the dataset to verify whether it is in use ( #5112 )
2024-06-14 03:25:38 +08:00
Bowen Liang
cdc08a434f
feat: support Chroma vector store ( #5015 )
2024-06-13 18:02:18 +08:00
Bowen Liang
bdad993901
improve: generalize vector factory classes and vector type ( #5033 )
2024-06-08 22:29:24 +08:00
Weaxs
0797f9bc05
feat: support tidb vector ( #4588 )
2024-06-05 18:19:53 +08:00
Jyong
4e3b0c5aea
support rename document ( #4915 )
2024-06-04 20:07:40 +08:00
Moonlit
86e7c7321f
Fixed a bug where any content in the 'fetch' was converted to True ( #4400 )
2024-06-04 13:27:23 +08:00
LiuVaayne
875249eb00
Feat/vector db pgvector ( #3879 )
2024-05-10 17:20:30 +08:00
Jyong
3e9dbe3e0a
add pgvecto_rs support and upgrade SQLAlchemy ( #3833 )
2024-04-29 11:58:17 +08:00
羊羽
975b2fb79e
delete duplicate check get_dataset ( #3966 )
...
Co-authored-by: baxiang <baxiang@lixiang.com>
2024-04-29 11:57:26 +08:00
Jingpan Xiong
1be222af2e
fix: using api can not execute relyt vector database ( #3766 )
...
Co-authored-by: jingsi <jingsi@leadincloud.com>
2024-04-25 19:46:20 +08:00
Jyong
f257f2c396
Knowledge optimization ( #3755 )
...
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-04-24 15:02:29 +08:00