Commit Graph

159 Commits

Author SHA1 Message Date
Jiang 0d04cdc323
Lindorm vdb (#11574)
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
2024-12-12 09:43:27 +08:00
-LAN- 8d4bb9b40d
feat: integrate opendal storage (#11508)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-12-11 14:50:54 +08:00
Jyong c58d2fce89
roll back rerank topn setting (#11297) 2024-12-03 17:34:56 +08:00
Hiroshi Fujita 1d8385f7ac
Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230) 2024-12-02 15:29:25 +08:00
Cling_o3 f9c2aa7689
feat: add retireval_top_n to config in env (#11132) 2024-11-30 11:14:45 +08:00
Ethan 0f1133729f
feat: introduce a new environment variable that suppose to disable Scarf analytics (#11179) 2024-11-28 15:21:04 +08:00
liuhaoran 8ff65abbc6
ext_redis.py support redis clusters --- Fixes #9538 (#9789)
Signed-off-by: root <root@localhost.localdomain>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
2024-11-20 13:44:35 +08:00
8bitpd 873e9720e9
feat: AnalyticDB vector store supports invocation via SQL. (#10802)
Co-authored-by: 璟义 <yangshangpo.ysp@alibaba-inc.com>
2024-11-18 19:29:54 +08:00
crazywoola eb6c0b8027
Fix/log tz (#10473) 2024-11-08 20:24:22 +08:00
Jyong 445dcfe4d0
add create tidb serverless job control (#10467)
Co-authored-by: crazywoola <427733928@qq.com>
2024-11-08 18:48:12 +08:00
非法操作 033ab5490b
feat: support LLM understand video (#9828) 2024-11-08 13:22:52 +08:00
Bowen Liang a60133bfb3
fix: config violations when running db migtration ci tests (#10428) 2024-11-08 09:33:12 +08:00
powerfool 12a9e2972a
Adjusted docker manifests and environment variables for OceanBase vector database (#10395) 2024-11-07 13:22:09 +08:00
Summer-Gu ce1f9d935d
feat: The SSRF request timeout configuration item is added (#10292) 2024-11-06 08:50:57 +08:00
-LAN- 6452342222
feat(workflow): add configurable workflow file upload limit (#10176)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-11-04 15:55:34 +08:00
Jiang 0c9e79cd67
Add Lindorm as a VDB choice (#10202)
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
2024-11-04 09:10:26 +08:00
zhuhao c6e54c83c8
chore: add tidb-on-qdrant configuration in env and docker-compose file (#10015) 2024-10-29 21:11:10 +08:00
powerfool 878d13ef42
Added OceanBase as an option for the vector store in Dify (#10010) 2024-10-29 21:10:18 +08:00
roadgoat19 c8ef9223e5
feat: couchbase integration (#6165)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Elliot Scribner <elliot.scribner@couchbase.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
2024-10-29 15:00:23 +08:00
zhuhao eec63b112f
chore: add default value for redis configuration (#9864) 2024-10-25 17:16:07 +08:00
zhuhao c9dfe1ad92
feat: support user-defined configuration of log file size and retention count (#9610) 2024-10-23 17:24:36 +08:00
Zven 8e7a752b2a
feat: add upstash as a new vector database provider (#9644) 2024-10-23 09:16:35 +08:00
Kota-Yamaguchi a7ee51e5d8
feat: add code generator (#9051)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-10-22 21:57:54 +08:00
Joe 90dd91c6cd
fix: TOKEN_EXPIRY_MINUTES (#9557) 2024-10-21 18:14:26 +08:00
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
Joe 4fd2743efa
Feat/new login (#8120)
Co-authored-by: douxc <douxc512@gmail.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
2024-10-21 10:03:40 +08:00
Zven a9fc85027d
chore: update the description for storage_type (#9492) 2024-10-18 20:22:57 +08:00
ice yao d15ba3939d
Add Volcengine VikingDB as new vector provider (#9287) 2024-10-13 21:26:05 +08:00
-LAN- f73751843f
Feat/implement-refresh-tokens (#9233) 2024-10-12 23:46:30 +08:00
Shili Cao 2ec6ffe478
feat:support baidu vector db (#9185) 2024-10-12 23:24:17 +08:00
zhuhao 7a6970e570
feat: add supabase object storage (#9229) 2024-10-11 22:48:57 +08:00
kurokobo c0b71f8286
feat: respect x-* headers for redirections (#9054) 2024-10-09 14:42:30 +08:00
zhuhao 2571b0c4e3
feat: add baidu obs storage (#9024) 2024-10-07 11:09:27 +08:00
zhuhao 55e6123db9
feat: add min-connection and max-connection for pgvector (#8841) 2024-09-27 18:16:20 +08:00
ice yao c8df92d0eb
add volcengine tos storage (#8164) 2024-09-10 09:19:47 +08:00
ChengZi 2060db8e11
fix: change milvus init args from (host, port) to (url, token) (#8019)
Signed-off-by: ChengZi <chen.zhang@zilliz.com>
2024-09-06 17:32:48 +08:00
zhuhao e0d3cd91c6
support huawei cloud obs storage (#7980) (#7981) 2024-09-06 14:00:47 +08:00
Seayon 78989e9049
Add ALIYUN_OSS_PATH configuration for Aliyun OSS (#7864)
Co-authored-by: seayon <zhaoxuyang@shouqianba.com>
2024-09-01 21:30:17 +08:00
crazywoola 2c427e04be
Feat/7134 use dataset api create a dataset with permission (#7508) 2024-08-21 20:25:45 +08:00
Xiyuan Chen 4e7b6aec3a
feat: support pinning, including, and excluding for model providers and tools (#7419)
Co-authored-by: GareArc <chen4851@purude.edu>
2024-08-21 11:16:43 +08:00
Xiyuan Chen c7df6783df
Revert "feat: support pinning, including, and excluding for Model Providers and Tools" (#7324) 2024-08-15 23:51:00 +08:00
Xiyuan Chen 7619850855
feat: support pinning, including, and excluding for Model Providers and Tools (#7283) 2024-08-15 12:58:38 +08:00
miendinh f104b930cf
feat: support elasticsearch vector database (#3558)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-08-13 17:36:20 +08:00
Sangmin Ahn ecb9c311b5
chore: make prompt generator max tokens configurable (#6693) 2024-07-26 10:20:23 +08:00
xielong ebcc07e3e9
feat: support max_retries in jina requests (#6585) 2024-07-25 13:10:39 +08:00
Jyong 7c397f5722
update celery beat scheduler time to env (#6352) 2024-07-17 02:31:30 +08:00
Zhuo Qiu 63e34e5227
feat: support MyScale vector database (#6092) 2024-07-11 15:21:59 +08:00
liuzhenghua 9622fbb62f
feat: app rate limit (#5844)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-10 21:31:35 +08:00
8bitpd 7c70eb87bc
feat: support AnalyticDB vector store (#5586)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-07-09 13:32:04 +08:00
hymvp 1d3e96ffa6
add support oracle oci object storage (#5616) 2024-07-01 17:21:44 +08:00
Pan, Wen-Ming 964f0e1400
fix: Modify the incorrect configuration name for Google storage (#5595)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-26 07:54:22 +08:00
Jyong 756d9a4bc2
add opensearch default value (#5536) 2024-06-24 14:33:31 +08:00
quicksand 147a39b984
feat: support tencent cos storage (#5297) 2024-06-17 19:18:52 +08:00
Jyong ba5f8afaa8
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-15 02:46:02 +08:00
quicksand 4080f7b8ad
feat: support tencent vector db (#3568) 2024-06-14 19:25:17 +08:00
Jyong d7fbae286a
add aws s3 iam check (#5174) 2024-06-14 15:19:59 +08:00
Yeuoly 0cccf9c67d
feat: introduce APP_MAX_EXECUTION_TIME (#5167) 2024-06-13 23:08:05 +08:00
Bowen Liang cdc08a434f
feat: support Chroma vector store (#5015) 2024-06-13 18:02:18 +08:00
Weaxs 0797f9bc05
feat: support tidb vector (#4588) 2024-06-05 18:19:53 +08:00
Yeuoly 7aaa1ff270
chore: increase workflow max steps to 500 (#4835) 2024-05-31 15:16:35 +08:00
Charles Zhou a325a294bd
feat: opportunistic tls flag for smtp (#4794) 2024-05-30 18:56:46 +08:00
majian 72a90074bc
Add WORKFLOW_CALL_MAX_DEPTH env var. (#4713) 2024-05-29 13:39:11 +08:00
Patryk Garstecki f40743183e
🔧 Add env variable for time signature (#4650) 2024-05-27 22:20:49 +08:00
Rain Chen c255a20d7c
allow to config max segmentation tokens length for RAG document using environment variable (#4375) 2024-05-20 13:20:27 +08:00
majian b5204111da
Add UNSTRUCTURED_API_KEY env support (#4369) 2024-05-20 13:14:17 +08:00
LiuVaayne 875249eb00
Feat/vector db pgvector (#3879) 2024-05-10 17:20:30 +08:00
Yeuoly 76bec6ce7f
feat: add http node max size env (#4137) 2024-05-07 12:07:56 +08:00
S96EA 13cd409575
feat: support aliyun oss auth v4 (#3886)
Co-authored-by: owen <owen@owen.hawk-toad.ts.net>
2024-05-06 11:56:04 +08:00
majian 8f2ae51fe5
feat: add support for request timeout settings in the HTTP request node. (#3854)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-04-29 13:59:07 +08:00
Jyong 3e9dbe3e0a
add pgvecto_rs support and upgrade SQLAlchemy (#3833) 2024-04-29 11:58:17 +08:00
呆萌闷油瓶 0940f01634
enhancement:support Qdrant gRPC mode (#3929) 2024-04-28 15:33:32 +08:00
miendinh 9ad489d133
feat: Add google storage support (#3887)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
2024-04-27 18:26:52 +08:00
takatost 8bca908f15
refactor: config file (#3852) 2024-04-25 22:26:45 +08:00
Henrybit 80b9507e7a
feat: add aliyun oss storage (#3690)
Co-authored-by: henrybit <qipenghui3056@sina.com>
2024-04-25 16:57:19 +08:00
YidaHu 777ec64635
feat: add log_file environment variable (#3793) 2024-04-24 21:55:14 +08:00
Jingpan Xiong 33397836a5
feat: support relyt vector database (#3367)
Co-authored-by: jingsi <jingsi@leadincloud.com>
2024-04-15 11:52:34 +08:00
Yeuoly ae1f3780f8
Feat/api tool custom timeout (#3420) 2024-04-12 17:46:39 +08:00
takatost 7753ba2d37
FEAT: NEW WORKFLOW ENGINE (#3160)
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: nite-knite <nkCoding@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2024-04-08 18:51:46 +08:00
Jyong a94d86da6d
add keyword table s3 storage support (#3065)
Co-authored-by: jyong <jyong@dify.ai>
2024-04-01 20:19:30 +08:00
Jyong 86e474fff1
Add azure blob storage support (#2919)
Co-authored-by: jyong <jyong@dify.ai>
2024-03-20 20:49:58 +08:00
takatost 1910178199
fix: default mail type invalid in .env.example (#2628) 2024-02-29 17:29:48 +08:00
Garfield Dai 49da8a23a8
feat: openai llm get trial or paid models from config. (#2546) 2024-02-23 16:48:58 +08:00
Garfield Dai 3ad943a9eb
Feat/openai llm trial paid config (#2545) 2024-02-23 16:12:43 +08:00
Jyong 97fe817186
Fix/upload limit (#2521)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-02-22 17:16:22 +08:00
JonahCui 71e5828d41
feat: add support for smtp when send email (#2409) 2024-02-07 18:08:41 +08:00
Yeuoly bf736bc55d
Feat/show detailed custom api response when testing (#2400) 2024-02-05 18:48:30 +08:00
takatost 0e1163f698
feat: remove deprecated envs (#2078) 2024-01-18 14:44:37 +08:00
takatost 8799c888e3
fix: free quota type apply button missing (#2069)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-01-17 15:02:27 +08:00
Benjamin 1fe4e3afde
Update Resend SDK and resend api url in configuration. (#1963) 2024-01-10 18:15:02 +08:00
Jyong a0a9461f79
Fix/add qdrant timeout default value (#1901)
Co-authored-by: jyong <jyong@dify.ai>
2024-01-04 10:58:47 +08:00
Jyong 5e34f938c1
Feat/add unstructured support (#1780)
Co-authored-by: jyong <jyong@dify.ai>
2023-12-18 23:24:06 +08:00
Garfield Dai 4b1ba2ec21
feat: remove billing config. (#1761) 2023-12-17 13:22:45 +08:00
Garfield Dai 6b499b9a16
remove stripe and anthropic. (#1746) 2023-12-12 17:59:07 +08:00
Garfield Dai 053102f433
Feat/dify billing (#1679)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: takatost <takatost@users.noreply.github.com>
2023-12-03 20:59:29 +08:00
takatost 41d0a8b295
feat: [backend] vision support (#1510)
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
2023-11-13 22:05:46 +08:00
Jyong f191b8b8d1
milvus docker compose env (#1306)
Co-authored-by: jyong <jyong@dify.ai>
2023-10-11 16:05:37 +08:00
Jyong 07aab5e868
Feat/add milvus vector db (#1302)
Co-authored-by: jyong <jyong@dify.ai>
2023-10-10 21:56:24 +08:00
takatost fda937175d
feat: qdrant support in docker compose (#1286) 2023-10-08 12:04:04 -05:00
zxhlyh 227f9fb77d
Feat/api jwt (#1212) 2023-09-25 12:49:16 +08:00
takatost 9adbeadeec
feat: claude paid optimize (#890) 2023-08-17 16:56:20 +08:00