Commit Graph

1715 Commits

Author SHA1 Message Date
Bowen Liang 0bdae34b5e
improve: significantly speed up the server launching time by async preloading tool providers (#9146) 2024-10-31 00:21:01 +08:00
Charlie.Wei f6fecb957e
fix azure chatgpt o1 parameter error (#10067) 2024-10-30 22:08:56 +08:00
-LAN- 3b53e06e0d
fix(workflow): refine variable type checks in LLMNode (#10051) 2024-10-30 16:23:12 +08:00
zhuhao 92a3898540
fix: resolve the incorrect model name of hunyuan-standard-256k (#10052) 2024-10-30 15:43:29 +08:00
zhuhao 7433095240
chore: use dify_config.TIDB_SPEND_LIMIT instead of constant value (#10038) 2024-10-30 15:43:07 +08:00
zhuhao 0095896051
feat: add YAML type in document extractor node (#9997) 2024-10-30 13:47:19 +08:00
Jyong 9ebd453b87
add rerank check when doing mutil-retrieval (#9998) 2024-10-30 11:17:39 +08:00
非法操作 c7fb8a4f20
fix: conversation variable may not change in the answer node (#10034) 2024-10-30 11:10:31 +08:00
-LAN- eb87e690ed
fix(llm-node): handle NoneSegment variables properly (#9978) 2024-10-30 08:46:11 +08:00
Hiroshi Fujita 539fc8b760
Fix content-type header case sensitivity (#9961) 2024-10-30 02:11:18 +08:00
powerfool 878d13ef42
Added OceanBase as an option for the vector store in Dify (#10010) 2024-10-29 21:10:18 +08:00
Jyong 5580bcf870
add tidb spend limit config (#9999) 2024-10-29 17:51:13 +08:00
非法操作 12adcf8925
fix: gemini model use some tools raise error (#9993) 2024-10-29 16:09:29 +08:00
roadgoat19 c8ef9223e5
feat: couchbase integration (#6165)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Elliot Scribner <elliot.scribner@couchbase.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
2024-10-29 15:00:23 +08:00
Jyong f47177ecb4
add top_k for es full text search (#9963) 2024-10-28 23:04:54 +08:00
-LAN- 4da0b70694
feat(http-request-executor): enhance file handling in HTTP requests (#9944) 2024-10-28 17:51:01 +08:00
Xiao Ley 7056009b6a
feat(tools): add Baidu translation tool (#9943) 2024-10-28 17:18:28 +08:00
非法操作 ddb960ddfb
feat: support Vectorizer can be used in workflow (#9932) 2024-10-28 16:52:57 +08:00
方程 0ebd985672
feat: add models for gitee.ai (#9490) 2024-10-28 16:52:12 +08:00
zhuhao aa11141660
feat: add stable-diffusion-3-5-large for the text-to-image tool with siliconflow (#9909) 2024-10-27 21:17:36 +08:00
zhuhao 8bb5b943d7
fix(tools): remove the undefined variable parameter_type (#9908) 2024-10-27 11:56:29 +08:00
ice yao 22776f24ab
chore: Extract common functions of the base model in Azure OpenAI Provider (#9907) 2024-10-27 11:56:17 +08:00
Zixuan Cheng 216442ddc1
feat(workflow): Support JSON type in document extractor node (#9899)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-10-26 20:29:48 +08:00
-LAN- 72ea3d6b98
fix(workflow): Take back LLM streaming output after IF-ELSE (#9875) 2024-10-25 22:33:34 +08:00
virgosoy 17cacf258e
fix: wrong element object (#9868) 2024-10-25 22:32:41 +08:00
非法操作 ace7ffab5f
feat: support comfyui workflow tool image generate image (#9871) 2024-10-25 18:48:07 +08:00
非法操作 1b5adf40da
fix: moonshot response_format raise error (#9847) 2024-10-25 14:59:55 +08:00
Jyong 18106a4fc6
add tidb on qdrant type (#9831)
Co-authored-by: Zhaofeng Miao <522856232@qq.com>
2024-10-25 13:57:03 +08:00
crazywoola 5b7b765090
fix: yuque book id should be string (#9819) 2024-10-25 11:11:18 +08:00
非法操作 ac9f1e9de5
fix: duckduckgo image search not work (#9821) 2024-10-25 10:11:33 +08:00
非法操作 2346b0ab99
chore: make doc extractor node also can extract text by file extension (#9543) 2024-10-24 22:54:48 +08:00
Zixuan Cheng 88dec6ef2b
Added description for .ppt, specify the reason for unstructured.io (#9452)
Co-authored-by: crazywoola <427733928@qq.com>
2024-10-24 22:13:06 +08:00
guogeer 70ddc0ce43
openai compatiable api usage and id (#9800)
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
2024-10-24 21:51:36 +08:00
非法操作 e2710161f6
fix: chart tool can't display chinese (#9686) 2024-10-24 18:49:49 +08:00
Jyong 5f11fe521d
remove unstructured pdf extract (#9794) 2024-10-24 18:13:05 +08:00
-LAN- d018b32d0b
fix(workflow): enhance prompt handling with vision support (#9790) 2024-10-24 17:52:11 +08:00
luckylhb90 400392230b
fixed: variable reference error (#9722)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-10-23 19:17:06 +08:00
-LAN- e11d5ac708
feat(model_runtime): add new model 'claude-3-5-sonnet-20241022' (#9708) 2024-10-23 17:03:30 +08:00
Jyong 3e9d271b52
nltk security issue and upgrade unstructured (#9558) 2024-10-23 16:23:55 +08:00
Pan, Wen-Ming ecc8beef3f
feat: added claude 3.5 sonnet v2 model to Google Cloud Vertex AI (#9688) 2024-10-23 16:13:51 +08:00
ybalbert001 4989d0c904
add bedrock claude 3.5 v2 support (#9685)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-10-23 13:54:21 +08:00
-LAN- 9a5bdae07f
feat(condition): add support for 'exists' and 'not exists' operators (#9687) 2024-10-23 13:25:17 +08:00
ice yao ceb2c4f3ef
chore: reuse existing test functions with upstash vdb (#9679) 2024-10-23 10:42:11 +08:00
-LAN- d5a93a6400
fix(variable_pool): handle invalid attributes in variable lookup (#9646) 2024-10-23 10:19:33 +08:00
Zven 8e7a752b2a
feat: add upstash as a new vector database provider (#9644) 2024-10-23 09:16:35 +08:00
feiyang_deepnova 999d3f1539
fix: add downstream nodes of this branch (#9640) 2024-10-23 01:20:02 +08:00
Kota-Yamaguchi a7ee51e5d8
feat: add code generator (#9051)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-10-22 21:57:54 +08:00
走在修行的大街上 a9db06f5e7
feat(Tools): Refactor the base table plugin (#9182)
Co-authored-by: 黎斌 <libin.23@bytedance.com>
2024-10-22 21:31:34 +08:00
-LAN- 5267f34e76
fix(segments): return empty string instead of "null" for text, log, and markdown properties (#9651) 2024-10-22 17:52:22 +08:00
-LAN- 36f66d40e5
refactor(api): simplify limit retrieval and return types (#9641) 2024-10-22 16:34:16 +08:00
非法操作 5f12616cb9
fix: file type document is not supported (#9618) 2024-10-22 16:33:50 +08:00
-LAN- 7263af13ed
fix(http_request): simplify JSON handling in requests (#9616) 2024-10-22 15:37:37 +08:00
zhuhao d992a809f5
fix: update the default model to gpt-4o-mini for duckduckgo ai chat (#9614) 2024-10-22 15:37:16 +08:00
-LAN- 5f12c17355
fix(core): use CreatedByRole enum for role consistency (#9607) 2024-10-22 13:03:50 +08:00
Bowen Liang 4d9160ca9f
refactor: use dify_config to replace legacy usage of flask app's config (#9089) 2024-10-22 11:01:32 +08:00
-LAN- 8f670f31b8
refactor(variables): replace deprecated 'get_any' with 'get' method (#9584) 2024-10-22 10:49:19 +08:00
-LAN- 5838345f48
fix(entities): add validator for `VisionConfig` to handle None values (#9598) 2024-10-22 10:49:03 +08:00
-LAN- ac24300274
refactor(template_transform): use keyword-only arguments (#9575) 2024-10-22 09:00:21 +08:00
-LAN- 2e657b7b12
fix(workflow): handle NoneSegments in variable extraction (#9585) 2024-10-22 08:59:04 +08:00
-LAN- c063617553
fix(workflow): improve database session handling and variable management (#9581) 2024-10-22 00:42:40 +08:00
-LAN- 38a4f0234d
fix(http_request): handle empty and string data inputs (#9579) 2024-10-21 23:35:25 +08:00
-LAN- 740a723072
fix(validation): improve variable handling and validation (#9578) 2024-10-21 23:33:16 +08:00
-LAN- 4ae0bb83f1
fix(file upload): correct upload method key for image config (#9568) 2024-10-21 20:40:47 +08:00
-LAN- 5459d812e7
fix(iteration): handle empty iterator gracefully (#9565) 2024-10-21 20:16:46 +08:00
-LAN- faad247d85
fix(upload): correct incorrect dictionary key usage (#9563) 2024-10-21 19:42:22 +08:00
ice yao 1e829ceaf3
chore: format get_customizable_model_schema return value (#9335) 2024-10-21 19:05:44 +08:00
AAEE86 9b32bfb3db
feat: Updata tongyi models (#9552) 2024-10-21 19:04:45 +08:00
非法操作 f83ed19dfe
fix: list filter node some operator raise error (#9539) 2024-10-21 15:33:42 +08:00
非法操作 53b14bde4d
fix: list filter node url not work (#9540) 2024-10-21 15:32:28 +08:00
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
非法操作 853b0e84cc
fix: draft run workflow node with image will raise error (#9406) 2024-10-21 09:05:42 +08:00
chzphoenix 42fe208eda
refactor wenxin rerank (#9486)
Co-authored-by: cuihz <cuihz@knowbox.cn>
2024-10-21 09:03:25 +08:00
ice yao 95ce10f23b
feat: Add custom username and avatar define in discord tool (#9514) 2024-10-20 22:06:18 +08:00
Ziyu Huang 660fc3bb34
Resolve 9508 openai compatible rerank (#9511) 2024-10-20 21:59:58 +08:00
Oliver Lee 424a7da470
add yuqye(https://www.yuque.com)tools (#8960)
Co-authored-by: 佐井 <chengwu.lcw@alibaba-inc.com>
2024-10-18 18:15:34 +08:00
Tao Wang b92504bebc
Added Llama 3.2 Vision Models Speech2Text Models for Groq (#9479) 2024-10-18 18:10:33 +08:00
zhuhao e0846792d2
feat: add yi custom llm intergration (#9482) 2024-10-18 17:23:21 +08:00
zhuhao b3cde9900c
feat: add parameter top-k for the llm model provided by openrouter and siliconflow (#9455) 2024-10-18 08:21:54 +08:00
ice yao 2155bba5b0
fix: update mismatch vector type (#9462) 2024-10-18 08:21:41 +08:00
zhuhao 3fc0ebdd51
feat: add yi-lightning llm model for yi (#9458) 2024-10-18 08:19:58 +08:00
chzphoenix 211f416806
feat:add wenxin rerank (#9431)
Co-authored-by: cuihz <cuihz@knowbox.cn>
Co-authored-by: crazywoola <427733928@qq.com>
2024-10-17 19:18:32 +08:00
zhuhao b90ad587c2
refactor: move the embedding to the rag module and abstract the rerank runner for extension (#9423) 2024-10-17 19:12:42 +08:00
zhuhao a45f8969a0
fix: remove the undefined variable line (#9446) 2024-10-17 17:25:14 +08:00
非法操作 d3c06a3f76
feat: add the workflow tool of comfyUI (#9447) 2024-10-17 16:48:42 +08:00
ybalbert001 fdcf87c70c
fix https://github.com/langgenius/dify/issues/9409 (#9433)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-10-17 10:47:56 +08:00
zhuhao 86594851cb
refactor: update the default values of top-k parameter in vdb to be consistent (#9367) 2024-10-16 16:00:21 +08:00
Jyong 50635e9c15
Fix/economical knowledge retrieval (#9396) 2024-10-16 15:13:45 +08:00
zhuhao 7d3dad3d1d
feat: add timezone conversion for time tool (#9393) 2024-10-16 11:17:40 +08:00
ice yao dd22e78515
fix: Deprecated gemma2-9b model in Fireworks AI Provider (#9373) 2024-10-16 10:44:54 +08:00
crazywoola 423df67042
fix: use gpt-4o-mini for validating credentials (#9387) 2024-10-16 10:18:06 +08:00
非法操作 da25b91980
fix: remove the stream option of zhipu and gemini (#9319) 2024-10-15 19:13:43 +08:00
Jason Tan 9b8aa9b75d
feat: add minimax abab6.5t support (#9365) 2024-10-15 19:00:05 +08:00
非法操作 4ffaabcc04
feat: add glm-4-flashx, deprecated chatglm_turbo (#9357) 2024-10-15 17:33:34 +08:00
Warren Wong b597a0d31c
fix: Azure OpenAI o1 max_completion_token and get_num_token_from_messages error (#9326)
Co-authored-by: wwwc <wwwc@outlook.com>
2024-10-15 16:26:44 +08:00
Wei-shun Bao fb32e5ca9a
fix: In the output, the order of 'ta' is sometimes reversed as 'at'. #8015 (#8791) 2024-10-15 16:24:29 +08:00
zhuhao cd7ab6231f
refactor: Add an enumeration type and use the factory pattern to obtain the corresponding class (#9356) 2024-10-15 12:51:13 +08:00
ice yao 5908fd6552
Adapt input type parameter with MiniMax embedding model (#9342) 2024-10-15 09:01:00 +08:00
ice yao 3f9d6759d4
feat: Add qwen2.5 72B Instruct model in Fireworks AI (#9340) 2024-10-14 23:15:34 +08:00
ice yao aba70207ab
feat: Add fireworks custom llm intergration (#9333) 2024-10-14 22:50:31 +08:00
Hash Brown fa47f0c707
chore: disable chat service API passing `parent_message_id` (#8984) 2024-10-14 19:13:16 +08:00
非法操作 ffc3f33670
chore: remove the copied zhipu_ai sdk (#9270) 2024-10-14 10:53:45 +08:00
kurokobo 857055b797
fix: remove the latest message from the user that does not have any answer yet (#9297) 2024-10-13 23:25:50 +08:00
ice yao d15ba3939d
Add Volcengine VikingDB as new vector provider (#9287) 2024-10-13 21:26:05 +08:00
zhuhao d97d3ff5fc
chore: add abstract decorator and output log when query embedding fails (#9264) 2024-10-12 23:58:41 +08:00
Shili Cao 2ec6ffe478
feat:support baidu vector db (#9185) 2024-10-12 23:24:17 +08:00
takatost 23ce1fb1ba
chore: optimize the trace ops slow queries on node executions. (#9282) 2024-10-12 18:30:46 +08:00
takatost 29188e0562
chore: use cache instead of re-querying node record during workflow execution (#9280) 2024-10-12 17:48:59 +08:00
crazywoola 93af87a9e0
fix: move exception to debug mode (#9258) 2024-10-12 09:28:45 +08:00
Jyong 42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 2024-10-11 19:21:03 +08:00
AkisAya d7b8e071dd
fix:#9222 create or update custum tools error (#9228) 2024-10-11 17:12:30 +08:00
Jyong 80b62d50f5
Fix/add es num_candidates (#9225) 2024-10-11 16:04:23 +08:00
AAEE86 fe41e8bc18
feat: add siliconflow custom add model interface (#8745) 2024-10-11 11:56:11 +08:00
Fei He 5c76131d3d
feat: add gte rerank for tongyi (#9153) 2024-10-11 10:35:56 +08:00
Jyong cabdb4ef17
fix retrieval resource positon missed (#9155)
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
2024-10-11 10:32:42 +08:00
zhuhao 05c1ef75c4
feat: add allow_llm_to_see_data flag for vanna (#9156) 2024-10-10 17:39:26 +08:00
Sa Zhang 75f0a5e36a
fix: Typo Correction in jina.yaml (#9161) 2024-10-10 17:00:34 +08:00
takatost 477beae3bb
fix: missing usage of metadata in the chatflow app (#9167) 2024-10-10 16:34:06 +08:00
Charlie.Wei 6b6e94da08
Fix code indentation errors (#9164) 2024-10-10 15:26:38 +08:00
Ziyu Huang fc60b554a1
Fixes #9159: Modify to make it works to llama.cpp rerank API (#9160) 2024-10-10 15:18:07 +08:00
Joe e947103b6d
Feat/add workflow sys params (#9108)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-10-10 11:15:52 +08:00
ronaksingh27 62051d5171
Corrected type annotation to "Any" from "any" all files in "model_providers" folder (#9135) 2024-10-10 10:34:25 +08:00
luckylhb90 2024a6c941
fix: vertex ai remote url error(Error: not enough values to unpack) (#9134)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-10-10 10:16:42 +08:00
呆萌闷油瓶 060897b25b
chore:add azure openai api version 2024-09-01-preview (#9141) 2024-10-10 10:07:49 +08:00
非法操作 499cc57082
fix: response_format of model_parameters will not be removed (#9148) 2024-10-10 10:07:21 +08:00
Hash Brown 511ffa4698
fix: follow-up (suggested questions) does not refer to the most recen… (#9122) 2024-10-09 21:10:55 +08:00
pinsily 7a1da2409d
add generate conversation name error log (#9117) 2024-10-09 21:09:36 +08:00
Charlie.Wei 55679b4389
azure add o1-mini、o1-preview models (#9088)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-10-09 16:15:03 +08:00
Bowen Liang 240b66d737
chore: avoid implicit optional in type annotations of method (#8727) 2024-10-09 14:36:43 +08:00
zhuhao 5fcd614186
feat: output the execution results of tool should only in debug mode (#9104) 2024-10-09 12:53:55 +08:00
zhuhao 4be1aa516c
feat: add tags for vanna tools (#9102) 2024-10-09 12:53:03 +08:00
zhuhao 5e250403d3
chore: add the missing tool names to the _position file (#9099) 2024-10-09 11:04:26 +08:00
SebastjanPrachovskij f8af9c6ad0
refactor: Update countries & languages list for SearchApi engines (#9090) 2024-10-09 10:24:09 +08:00
ybalbert001 57994e4a24
fix s3 presign url check problem, support two versions(v2,v4) (#9093)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-10-09 10:23:21 +08:00
crazywoola 3a0734d94c
Feat/9081 add support for llamaguard through groq provider (#9083) 2024-10-09 01:00:10 +08:00
zhuhao 5b7de7705e
feat: add timestamp conversion and timestamp retrieval for time tool (#9085) 2024-10-08 23:25:11 +08:00
zhuhao 5213650fed
feat: update the xinf tool's API key to optional (#9073) 2024-10-08 19:07:53 +08:00
Infinitnet e741ee2f45
Correct max_tokens for OpenRouter Sonnet 3.5 (#9068) 2024-10-08 16:06:47 +08:00
非法操作 966e65bb66
fix: zhipu ai web_search not work (#9058) 2024-10-08 15:36:31 +08:00
aiscrm 2ab8bc679f
fix: Missing model information in llm span of Langfuse #9029 (#9030)
Co-authored-by: corel <corelchen@qq.com>
2024-10-07 18:03:30 +08:00
zg0d233 fcfa1252a0
fix bug when adding openai or openai-compatible stt model instance (#9006) 2024-10-07 11:06:38 +08:00
Giannis Kepas dc5839b6bb
feat: Update AWS Bedrock supported regions (#8992) 2024-10-03 15:17:28 +08:00
zhaoyi233 4373777871
Update json_in_md_parser.py (#8983)
Co-authored-by: crazywoola <427733928@qq.com>
2024-10-03 10:20:56 +08:00
ice yao 415d27c8bf
feat(Tools): add discord incoming webhook for sending messages (#7852) 2024-10-02 13:18:35 +08:00
zhuhao 24ba9fdf6c
feat: enhance stepfun image generation tool (#8954) 2024-10-01 10:55:54 +08:00
zhuhao 824a0dd63e
feat: add qwen2.5-72b and llama3.2 for openrouter (#8956) 2024-10-01 10:55:51 +08:00
omr 2deaece7e2
refactor: remove unnecessary comment (#8949) 2024-10-01 09:14:49 +08:00
CXwudi 0d84221b2c
chore: sort Gemini models (#8951) 2024-10-01 09:14:36 +08:00
CXwudi cdd7e55a88
chore: add missing models from Voyage (#8950) 2024-10-01 09:14:21 +08:00
Jyong 625e4c4c72
fix multiple retrieval in knowledge node (#8942) 2024-09-30 23:07:04 +08:00
Aurelius Huang 4585cffce1
fix: Compatible with special characters in pg full-text search. (#8921)
Co-authored-by: Aurelius Huang <cm.huang@aftership.com>
2024-09-30 16:32:23 +08:00