Commit Graph

2142 Commits

Author SHA1 Message Date
Nam Vu 8e23e24bd5
feat: Poetry requests timeout (#7086) 2024-08-08 14:17:29 +08:00
orangeclk f288d367ac
Add price info for zhipu models (#7084) 2024-08-08 14:17:05 +08:00
Waffle 5e2fa13126
feat: support glm-4-long (#7070)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-08-08 10:54:39 +08:00
-LAN- 67a2f14cef
fix(api/core/workflow/nodes/tool/tool_node.py): Keep None value in tool params. (#7066) 2024-08-07 19:36:21 +08:00
Joe d7bb422a5c
fix: hunyuan assistant_prompt_message pydantic error (#7062) 2024-08-07 18:31:40 +08:00
8bitpd 40c6f3c724
fix: add redis lock to AnalyticdbVector init (#6859)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-08-07 17:32:06 +08:00
-LAN- df8f8c9a2c
feat(api/core/rag/datasource/vdb/analyticdb/analyticdb_vector.py): Checking config before init analyticdb (#7050) 2024-08-07 17:31:36 +08:00
-LAN- 536c43257b
refactor(*): Update hard-code '[__HIDDEN__]' to the constant. (#7048) 2024-08-07 17:30:56 +08:00
-LAN- 4e8f6b3603
chore(api/core/app/segments/segments.py): Remove todo tags. (#7052) 2024-08-07 17:29:35 +08:00
Jyong 80c94f02e9
add vector field for other vectordb (#7051) 2024-08-07 17:14:03 +08:00
-LAN- aad02113c6
fix(api/core/app/segments): Allow to contains boolean value in object segment (#7047) 2024-08-07 16:20:22 +08:00
chenxu9741 72c75b75cf
feat: Add hyperlink parsing to the DOCX document. (#7017) 2024-08-07 16:01:14 +08:00
Sadegh Ghanbari Shohani ffa992acf7
Add support for i18n Farsi language (fa-IR) (#7044) 2024-08-07 15:44:42 +08:00
majian 99b78dd198
feat: add gpt-4o-2024-08-06 (#7046) 2024-08-07 15:35:57 +08:00
Sangmin Ahn 7f81a86e9e
chore: show non-English characters in exported DSL files (#7042) 2024-08-07 14:03:15 +08:00
Achim a93bc83c8d
Provide output data also in json property of workflow tool (#6924) (#7027) 2024-08-07 08:54:51 +08:00
crazywoola 3516989738
fix: typos in wenxin llm (#7021) 2024-08-06 22:33:03 +08:00
Sa Zhang 26991443ed
fix: Fix incorrect context size for jina-reranker-v2 model (#7006) 2024-08-06 21:08:29 +08:00
Bryan eece50acec
fix: tran list issue (#7009)
Co-authored-by: libing <libing@healink.cn>
2024-08-06 21:01:38 +08:00
Jyong 28d4e5b045
Fix/reranking mode is null (#7012) 2024-08-06 19:12:04 +08:00
yanghx c53875ce8c
fix #6902 .docx handles images within tables and handles cross-column tables (#6951) 2024-08-06 17:14:24 +08:00
灰灰 96dcf0fe8a
fix: code tool fails when null property exists in object (#6988) 2024-08-06 16:11:00 +08:00
Yefori bd3ed89516
feat: add function calling for deepseek models (#6990) 2024-08-06 13:37:27 +08:00
小羽 23ed15d19f
feat:nvidia add nemotron4-340b and microsoft/phi-3 (#6973) 2024-08-06 10:16:41 +08:00
非法操作 312d905c9b
chore: update duckduckgo tool (#6983) 2024-08-06 10:16:04 +08:00
takatost d839f1ada7
version to 0.6.16 (#6972) 2024-08-05 23:33:37 +08:00
takatost 6da14c2d48
security: fix api image security issues (#6971) 2024-08-05 20:21:08 +08:00
Pedro Gomes a34285196b
Revise the wrong pricing of certain LLM models. (#6967) 2024-08-05 18:41:44 +08:00
takatost ea30174057
chore: optimize streaming tts of xinference (#6966) 2024-08-05 18:23:23 +08:00
Sangmin Ahn dd676866aa
chore: exclude .txt extenstion in create_by_text API (#6956) 2024-08-05 15:52:07 +08:00
TzuxinChen f0d10553b4
Fixed a bug where permission was clearly displaye… (#6934) 2024-08-05 13:19:01 +08:00
liuzhenghua ef616c604a
fix: The permissions issue of the editor role accessing some backend … (#6945)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-05 12:55:55 +08:00
Bowen Liang f656e1bae2
fix: ensure db migration in docker entry script running with `upgrade-db` command for proper locking (#6946) 2024-08-05 10:55:26 +08:00
liuzhenghua 141e4e0276
fix: restore xinference secret field (#6941)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-04 22:32:24 +08:00
Pedro Gomes 20d3e1d297
Fix increase_usage of total_price in agent_runner (#6688) 2024-08-04 14:42:22 +08:00
chenxu9741 dff3f41ef6
Workflow TTS playback node filtering issue. (#6877) 2024-08-04 14:28:56 +08:00
Weaxs 5e634a59a2
compatible xinference reranker server (#6927) 2024-08-04 13:49:38 +08:00
Joe 26e46d365c
fix: workflow trace user_id error (#6932) 2024-08-04 03:28:50 +08:00
takatost bcd7c8e921
fix: sending app trace data to other app trace provider (#6931) 2024-08-04 00:05:51 +08:00
Bowen Liang 70283f5b9f
dep: support for Python 3.12 (#6771) 2024-08-02 21:14:36 +08:00
JuHyung Son 2e941bb91c
add new provider Solar (#6884) 2024-08-02 20:48:09 +08:00
zhuhao 541bf1db5a
feat: add the tool Serper for Google search. (#6786) (#6790) 2024-08-02 20:37:04 +08:00
Jyong 048bc4c06e
fix update dataset failed when embedding model is not exist (#6920) 2024-08-02 20:30:22 +08:00
Joe f97a51ce24
fix: reranking disable timer error (#6910) 2024-08-02 16:34:50 +08:00
Bowen Liang 6aa02f8c63
dep: bump pgvecto-rs client from 0.1.x to 0.2.x (#6891) 2024-08-02 15:51:23 +08:00
crazywoola 7ab04e17e7
fix: return code in service api (#6911) 2024-08-02 15:48:58 +08:00
非法操作 bf3f1027c8
fix: code execution node not display clear reasons when sandbox res error (#6830) 2024-08-02 15:36:44 +08:00
sino 8166a8caf5
feat: update llama3.1 parameters for openrouter (#6901) 2024-08-02 13:13:34 +08:00
Jyong 44801df8f8
fix score threshold limit be None (#6900) 2024-08-02 12:10:51 +08:00
灰灰 56af1a0adf
pref: change ollama embedded api request (#6876) 2024-08-02 12:04:47 +08:00
dufei f8617db012
fix tongyi tool calls (#6896) 2024-08-02 10:03:43 +08:00
Jyong 2ab9af3b38
delete weight_type in knowledge retrieval node (#6892) 2024-08-01 21:38:59 +08:00
Weaxs cc4785f094
fix: xinference reranker return_documents (#6888) 2024-08-01 19:57:53 +08:00
ian 093f902335
fix: Change API key authentication failure response code from 404 to 401 (#6885) 2024-08-01 17:41:35 +08:00
hursit 104c797dd0
feat: Add support for i18n Turkish language (tr-TR) (#6886)
Co-authored-by: hursit <hursit.topal@enuygun.com>
2024-08-01 17:30:35 +08:00
chenxu9741 a9cd6df97e
Remove tts (blocking call) (#6869) 2024-08-01 14:50:22 +08:00
呆萌闷油瓶 f31142e758
Azure 4o mini options (#6873) 2024-08-01 14:04:18 +08:00
crazywoola 792f908afb
Revert "feat:Azure gpt4o mini" (#6870) 2024-08-01 13:32:03 +08:00
非法操作 29e3c3061c
fix: remote image not display in answer node (#6867) 2024-08-01 13:21:49 +08:00
呆萌闷油瓶 14367ddc09
feat:Azure gpt4o mini (#6866) 2024-08-01 13:03:08 +08:00
Jyong 8157fccf6d
delete weight_type (#6865) 2024-08-01 13:02:33 +08:00
Charlie.Wei cbf7f21ade
Add azure gpt4omini (#6862)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-08-01 12:57:52 +08:00
Weaxs f6e8e120a1
support xinference tts (#6746) 2024-08-01 11:59:15 +08:00
Joe 08f922d8c9
fix: anthropic max token NoneType error (#6858) 2024-08-01 11:30:00 +08:00
-LAN- feb4576ee7
chore: update SQLAlchemy configuration with custom naming convention (#6854) 2024-08-01 11:16:49 +08:00
小羽 56b43f62d1
feat: nvidia add llama3.1 model (#6844) 2024-07-31 21:24:02 +08:00
Giga Group 4b410494b3
Add model parameter enable_enhance for hunyuan llm model (#6847)
Co-authored-by: sun <sun@centen.cn>
2024-07-31 20:04:43 +08:00
Joe df9bd36cab
fix: claude-3-5-sonnet-20240620 max token error (#6843) 2024-07-31 18:34:44 +08:00
Jyong af76381b98
fix notion internal setting (#6836) 2024-07-31 17:17:46 +08:00
William Espegren 4be12b29b9
fix: improved error handling for spider tool (#6835) 2024-07-31 17:11:52 +08:00
ybalbert001 c23aa50bea
Add AWS builtin Tools (#6721)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-31 14:41:42 +08:00
Nam Vu 8eb0d0fddd
feat: support Celery auto-scale (#6249)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-31 14:34:44 +08:00
Ever 545d3c5a93
chore: Add processId field for metrics of threads/db-pool-stat/health (#6797)
Co-authored-by: 老潮 <zhangyongsheng@3vjia.com>
Co-authored-by: takatost <takatost@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-31 00:21:16 +08:00
crazywoola 3c371a6cb0
fix: workflow api (#6810) 2024-07-30 23:51:48 +08:00
longzhihun 9ce5cea911
feat: bedrock invoke enhancement (#6808) 2024-07-30 21:57:18 +08:00
eric-0x72 98d9837fbc
fix wrong charset when decoding Chinese content (#6774)
Co-authored-by: zhangwb <zhangwb@zts.com.cn>
2024-07-30 21:32:45 +08:00
Yeuoly 72963d1f13
fix: nonetype in webscraper validation (#6788) 2024-07-30 14:45:14 +08:00
-LAN- a98284b1ef
refactor(api): Switch to `dify_config` (#6750)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-30 11:15:26 +08:00
Bowen Liang daa31b2cb3
chore: remove redundant version pinning for indirect dependencies (#6772) 2024-07-30 08:45:57 +08:00
Bowen Liang b414ea41d6
dep: initial support for Milvus 2.4.x (#6084) 2024-07-29 19:56:45 +08:00
Joe f78d0082ae
feat: implement function dispatch table for trace processing (#6628) 2024-07-29 18:47:25 +08:00
SiliconFlow, Inc 3e18d32ce5
add deepseek-coder-v2 in siliconflow (#6149) 2024-07-29 18:45:19 +08:00
Charles 94d68b6a08
upgrade deepseek params (#6744) 2024-07-29 18:31:56 +08:00
Giga Group c9ff0e3961
Add model hunyuan-embedding (#6657)
Co-authored-by: sun <sun@centen.cn>
2024-07-29 18:30:52 +08:00
-LAN- 8dd68e2034
fix(api/core/moderation/output_moderation.py): Fix config call. (#6769) 2024-07-29 18:30:29 +08:00
Bowen Liang cb01bf2986
chore: set logging level to debug when reading YAML files and falling back to default value in case of None (#6758) 2024-07-29 13:40:18 +08:00
Bowen Liang 20268708cc
chore: improve position map conversion and tolerate empty position yaml file (#6541) 2024-07-29 10:32:11 +08:00
Vicky Guo 829472a1d7
switch to diffy_config with Pydantic in files, moderation and app (#6747)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-29 02:57:45 +08:00
Hiroshige Aoki e23461c837
Fix/6615 40 varchar limit on DatasetCollectionBinding and Embedding model name (#6723) 2024-07-28 09:42:58 +08:00
非法操作 21f6caacd4
feat: enhance the firecrawl tool (#6705) 2024-07-27 15:00:06 +08:00
-LAN- 6a3bef8378
feat(api/core/app/segments): Update segment types and variables (#6734)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:51 +08:00
-LAN- b6c3010f02
refactor(api/core/workflow/nodes/base_node.py): Update extract_variable_selector_to_variable_mapping method signature. (#6733)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:25 +08:00
crazywoola 90d2c01218
Feat/6725 can not get image url from cogview tool (#6728) 2024-07-27 00:07:31 +08:00
-LAN- 83af50368f
fix(api/core/model_runtime/model_providers/azure_openai/llm/llm.py): Try to skip if `delta.delta` is None. (#6727)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 00:05:21 +08:00
Jyong cf258b7a67
add xlsx support hyperlink extract (#6722) 2024-07-26 19:26:52 +08:00
-LAN- 5d77dc4f58
feat(api/core/app/segments/parser.py): Remove blank segment in `convert_template` (#6709)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 18:19:33 +08:00
Joe e4542215cc
fix: tongyi empty tool_calls is not supported in message (#6719) 2024-07-26 18:10:13 +08:00
Jason 3d3677e912
Feat/model provider novita (#6717)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-26 17:37:21 +08:00
-LAN- c6996a48a4
refactor(api/core/app/segments): Support more kinds of Segments. (#6706)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 15:03:56 +08:00
chenxu9741 6b50bb0fe6
issues #6655 Open ai tts issues (#6696) 2024-07-26 14:55:49 +08:00
Sangmin Ahn ecb9c311b5
chore: make prompt generator max tokens configurable (#6693) 2024-07-26 10:20:23 +08:00
Yeuoly 79cb23e8ac
security/SSRF vulns (#6682) 2024-07-25 20:50:26 +08:00
longzhihun c5ac004f15
[seanguo] fix: unsupported filename in windows & add Mistral Large 2 (#6679) 2024-07-25 19:26:46 +08:00
RookieAgent 78a339a794
modify llama3-1 yaml filename to support Windows pull operations (#6677) 2024-07-25 18:58:55 +08:00
灰灰 5e4ac11df3
fix: code block segmentation problem of markdown document (#6465) 2024-07-25 17:24:37 +08:00
tmuife 16b4f560cd
fix bugs(when using Oracle23ai as Vector DB) (#6658) 2024-07-25 17:07:14 +08:00
-LAN- 75e6576c67
refactor(api/core/app/segments): implement `to_object` in ObjectVariable and ArrayVariable. (#6671)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 17:06:38 +08:00
Seayon 0b4c26578e
Enhance database URI security and add URL encoding (#6668) 2024-07-25 16:48:00 +08:00
xielong ebcc07e3e9
feat: support max_retries in jina requests (#6585) 2024-07-25 13:10:39 +08:00
-LAN- 55c2b61921
fix(api/fields/workflow_fields.py): Add check in environment variables (#6621) 2024-07-25 11:30:52 +08:00
Giga Group ca696fe94c
Add support of tool-call for model provider "hunyuan" (#6656)
Co-authored-by: sun <sun@centen.cn>
2024-07-25 11:27:58 +08:00
longzhihun 9815aab7a3
[seanguo] feat: add llama 3.1 support in bedrock (#6645) 2024-07-25 11:20:37 +08:00
yanghx 349ec0db77
fix tencent_cos_storage image-preview error is not a byte (#6652) 2024-07-25 11:20:20 +08:00
majian a876baf0a9
Resolve variable type parameter error (#6646) 2024-07-25 11:15:54 +08:00
Jyong 91fd8521c3
fix reranking model field error (#6654) 2024-07-25 10:07:55 +08:00
-LAN- 4ec9a87e46
fix(api/core/workflow/nodes/iteration/iteration_node.py): Extend output in iteration if output is a array. (#6647)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 00:32:39 +08:00
Vico Chu fb5e3662d5
Chores: add missing profile for middleware docker compose cmd and fix ssrf-proxy doc link (#6372)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-24 19:36:06 +08:00
-LAN- 31efe10c75
refactor(api/core/workflow/workflow_engine_manager.py): Remove (#6630)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:40 +08:00
-LAN- 72bc9d5f2b
feat(api/core/app/segments/variables.py): Support description in Variable. (#6636)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:22 +08:00
Jyong 600f13436d
remove rerank model must be required when retrieval_model is multiple (#6640) 2024-07-24 19:34:41 +08:00
Joe b347a2f839
Feat/user session id search (#6638) 2024-07-24 19:34:23 +08:00
zhangzhiqiangcs d4c55748f1
doc: fix about model features (#6619) 2024-07-24 19:12:10 +08:00
takatost 0625db0bf5
chore: optimize asynchronous workflow deletion performance of app related data (#6639) 2024-07-24 19:00:37 +08:00
takatost 05141ede16
chore: optimize asynchronous deletion performance of app related data (#6634) 2024-07-24 18:15:03 +08:00
dufei 5af2df0cd5
fix: qwen fc error (#6620)
Co-authored-by: dufei <du_fei@venusgroup.com.cn>
2024-07-24 16:56:06 +08:00
crazywoola f324374b95
Fix/6615 40 varchar limit on model name (#6623) 2024-07-24 16:23:16 +08:00
Jyong e4bb943fe5
Feat/delete single dataset retrival (#6570) 2024-07-24 12:50:11 +08:00
takatost 0fb741f269
fix: downgraded sentry-sdk to 1.44.1 due to claude LLM token returning 0 (#6597) 2024-07-24 04:49:03 +08:00
takatost 4c85393a1d
feat: add GroqCloud llama3.1 series models support (#6596) 2024-07-24 00:41:58 +08:00
sino d5c2680fde
feat: support llama3.1 series models for openrouter provider (#6595) 2024-07-24 00:37:48 +08:00
takatost 49729647ea
bump to 0.6.15 (#6592) 2024-07-23 22:46:42 +08:00
-LAN- 85a883e281
fix(variables): NoneVariable should inherit from NoneSegment. (#6584) 2024-07-23 21:46:08 +08:00
Joe 8123a00e97
feat: update prompt generate (#6516) 2024-07-23 19:52:14 +08:00
-LAN- 2bc0632d0d
fix(segments): Support NoneType. (#6581) 2024-07-23 17:59:32 +08:00
-LAN- ad7552ea8d
fix(api/core/workflow/nodes/llm/llm_node.py): Fix LLM Node error. (#6576) 2024-07-23 17:09:16 +08:00
非法操作 c0ada940bd
fix: tool params not work as expected when develop a tool (#6550) 2024-07-23 17:00:39 +08:00
takatost 1690788827
fix: name 'current_app' is not defined in recommended_app_service (#6574) 2024-07-23 16:48:21 +08:00
Lance Mao 7c55c39085
feat: add tencent asr (#6091) 2024-07-23 16:38:39 +08:00
非法操作 f17d4fe412
fix: extract only `like` feedback to caculate User Satisfaction (#6553) 2024-07-23 16:32:36 +08:00
-LAN- f019bc4bd7
feat(variables): Support `to_object`. (#6572) 2024-07-23 16:22:06 +08:00
-LAN- cfc408095c
fix(api/nodes): Fallback to `get_any` in some nodes that use object or array. (#6566) 2024-07-23 15:51:07 +08:00
takatost 6b5fac3004
fix: fetch context error in llm node (#6562) 2024-07-23 15:04:51 +08:00
崔亮 0569c547ee
fix the issue of MILVUS_DATABASE has no effect. (#6424) 2024-07-23 15:03:55 +08:00
tmuife 06fc1bce9e
Add search by full text when using Oracle23ai as vector DB (#6559) 2024-07-23 15:03:21 +08:00
Sangmin Ahn 093b8ca475
fix: escape double quotation marks in the vector DB search query (#6506) 2024-07-23 15:02:25 +08:00
Ryan Tian 5fcc2caeed
feat: add Mingdao HAP tool, implemented read and maintain HAP application worksheet data. (#6257)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-23 14:34:19 +08:00
dependabot[bot] 642723d09e
chore(deps): bump sentry-sdk from 1.39.2 to 2.8.0 in /api (#6517)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-23 13:48:23 +08:00
-LAN- cd7fa8027a
fix(api/core/model_manager.py): Avoid mutation during iteration. (#6536) 2024-07-22 22:58:22 +08:00
-LAN- 617847e3c0
fix(api/services/app_generate_service.py): Remove wrong type hints. (#6535) 2024-07-22 22:58:07 +08:00
-LAN- 5e6fc58db3
Feat/environment variables in workflow (#6515)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-22 15:29:39 +08:00
Benjamin a67831773f
refactor: handle missing position file gracefully (#6513) 2024-07-22 13:24:32 +08:00
sino dfb6f4fec6
fix: extract tool calls correctly while arguments is empty (#6503) 2024-07-22 07:43:18 +08:00
Jyong f38034e455
clean vector collection redis cache (#6494) 2024-07-21 15:09:09 +08:00
Shoya SHIRAKI c57b3931d5
refactor(api): switch to dify_config in controllers/console (#6485) 2024-07-21 01:11:40 +08:00
Jyong f73a3a58ae
update delete embeddings by id (#6489) 2024-07-20 09:04:21 +08:00
Jyong 1e0e573165
update clean embedding cache query logic (#6483) 2024-07-20 01:29:25 +08:00
Joe 27e08a8e2e
Fix/extra table tracing app config (#6487) 2024-07-20 00:53:31 +08:00
Matri 49ef9ef225
feat(tool): getimg.ai integration (#6260) 2024-07-19 20:32:42 +08:00
Even c013086e64
fix: next suggest question logic problem (#6451)
Co-authored-by: evenyan <yikun.yan@ubtrobot.com>
2024-07-19 20:26:11 +08:00
sino 4f9f175f25
fix: correct gpt-4o-mini max token (#6472)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-19 18:24:58 +08:00
Jyong 57729823a0
fix wrong method using (#6459) 2024-07-19 13:48:13 +08:00
sino 9e168f9d1c
feat: support gpt-4o-mini for openrouter provider (#6447) 2024-07-19 13:09:41 +08:00
Weaxs ea45496a74
update ernie models (#6454) 2024-07-19 13:08:39 +08:00
Waffle 2ba05b041f
refactor(myscale):Set the default value of the myscale vector db in DifyConfig. (#6441) 2024-07-19 10:57:45 +08:00
Richards Tu 8e49146a35
[EMERGENCY] Fix Anthropic header issue (#6445) 2024-07-19 07:38:15 +08:00
takatost dad3fd2dc1
feat: add gpt-4o-mini (#6442) 2024-07-19 01:53:43 +08:00
Jyong e493ce9981
update clean embedding cache logic (#6434) 2024-07-18 20:25:28 +08:00
Weishan-0 7b45a5d452
fix: Unable to display images generated by Dall-E 3 (#6155) 2024-07-18 19:37:04 +08:00
ybalbert001 4a026fa352
Enhancement: add model provider - Amazon Sagemaker (#6255)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-18 19:32:31 +08:00
leoterry dc847ba145
Fix the vector retrieval sorting issue (#6431)
Co-authored-by: weifj <“weifj@tuyuansu.com.cn”>
2024-07-18 19:25:41 +08:00
-LAN- c0ec40e483
fix(api/core/tools/provider/builtin/spider/tools/scraper_crawler.yaml): Fix wrong placeholder config in scraper crawler tool. (#6432) 2024-07-18 19:23:18 +08:00
themanforfree ba181197c2
feat: api_key support for xinference (#6417)
Signed-off-by: themanforfree <themanforfree@gmail.com>
2024-07-18 18:58:46 +08:00
Songyawn 218930c897
fix tool icon get failed (#6375)
Co-authored-by: songyawen <songyawen@zkme.xyz>
2024-07-18 18:55:48 +08:00
Poorandy c8f5dfcf17
refactor(rag): switch to dify_config. (#6410)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-18 18:40:36 +08:00
非法操作 afe95fa780
feat: support get workflow task execution status (#6411) 2024-07-18 15:06:14 +08:00
William Espegren 588615b20e
feat: Spider web scraper & crawler tool (#5725) 2024-07-18 14:29:33 +08:00
listeng d5dca46854
feat: add a Tianditu tool (#6320)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-18 13:04:03 +08:00
Xiao Ley 23e5eeec00
feat: added custom secure_ascii to the json_process tool (#6401) 2024-07-18 08:43:14 +08:00
Masashi Tomooka 5236cb1888
fix: kill signal is not passed to the main process (#6159) 2024-07-18 07:50:54 +08:00
forrestlinfeng 3b5b548af3
Add Stepfun LLM Support (#6346) 2024-07-18 07:47:18 +08:00
Richards Tu 4782fb50c4
Support new Claude-3.5 Sonnet max token limit (#6335) 2024-07-18 07:47:06 +08:00
Jyong f55876bcc5
fix web import url is too long (#6402) 2024-07-18 01:14:36 +08:00
Poorandy 8a80af39c9
refactor(models&tools): switch to dify_config in models and tools. (#6394)
Co-authored-by: Poorandy <andymonicamua1@gmail.com>
2024-07-17 22:26:18 +08:00
Jyong 443e96777b
update empty document caused delete exist collection (#6392) 2024-07-17 20:38:32 +08:00
xielong f3f052ba36
fix: rename model from ernie-4.0-8k-Latest to ernie-4.0-8k-latest (#6383) 2024-07-17 19:07:47 +08:00
Jyong 1bc90b992b
Feat/optimize clean dataset logic (#6384) 2024-07-17 17:36:11 +08:00
-LAN- fc37887a21
refactor(api/core/workflow/nodes/http_request): Remove `mask_authorization_header` because its alwary true. (#6379) 2024-07-17 16:52:14 +08:00
Lion 4ed1476531
fix: incorrect config key name (#6371)
Co-authored-by: LionYuYu <lyu@theknotww.com>
2024-07-17 15:52:51 +08:00
FamousMai 20f73cb756
fix: default model set wrong(#6327) (#6332)
Co-authored-by: maiyouming <maiyouming@yafex.cn>
2024-07-17 14:14:12 +08:00
Weaxs 4e2fba404d
WebscraperTool bypass cloudflare site by cloudscraper (#6337) 2024-07-17 14:13:57 +08:00
Bowen Liang 7943f7f697
chore: fix legacy API usages of Query.get() by Session.get() in SqlAlchemy 2 (#6340) 2024-07-17 13:54:35 +08:00
Jyong 7c397f5722
update celery beat scheduler time to env (#6352) 2024-07-17 02:31:30 +08:00
Charlie.Wei 06fcc0c650
Fix tts api err (#6349)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-16 21:53:57 +08:00
Jyong 0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2024-07-16 19:09:04 +08:00
longzhihun ed9e692263
feat: bedrock model runtime enhancement (#6299) 2024-07-16 15:54:39 +08:00
svcvit cc0c826f36
Add tool: Google Translate (#6156) 2024-07-16 15:28:33 +08:00
Jyong 988aa4b5da
update clean_unused_datasets_task timedelta (#6324) 2024-07-16 13:43:04 +08:00
Bowen Liang c5d06e7943
dep: bump Pydantic from 2.7 to 2.8 (#6273) 2024-07-16 13:40:58 +08:00
呆萌闷油瓶 d66d7146a3
chore:update azure GA version 2024-06-01 (#6307) 2024-07-16 10:32:18 +08:00
takatost eabfd84ceb
bump to 0.6.14 (#6294) 2024-07-15 21:01:09 +08:00
Jyong d320d1468d
Feat/delete file when clean document (#5882) 2024-07-15 19:57:05 +08:00
Onelevenvy b47fa27a35
fix: zhipuai validate error when user's api key not support for chatglm_turbo in issue #6289 (#6290) 2024-07-15 19:27:18 +08:00
thibautleaux-kreactive 96c171805a
Update bedrock.yaml (#6281) 2024-07-15 16:53:03 +08:00
takatost 46a5294d94
feat(backend): support import DSL from URL (#6287) 2024-07-15 16:23:40 +08:00
Benjamin ec181649ae
Update model provider configuration for Triton Inference Server and X… (#6274) 2024-07-15 15:07:28 +08:00
guogeer 4fdcb30ff8
fix: custom tool input number fail (#6200)
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
2024-07-14 22:11:13 +08:00
Waffle 07add06c59
Feat/add zhipu CogView 3 tool (#6210) 2024-07-13 17:39:17 +08:00
tangyoha 0cbbaf3f68
fix: markdown proc will remove image (#5855) 2024-07-12 20:07:22 +08:00
Little 羊 7c2c949f01
Update ernie_bot.py (#6236) 2024-07-12 19:54:53 +08:00
天魂 1df71ec64d
refactor(api): switch to dify_config with Pydantic in controllers and schedule (#6237) 2024-07-12 16:51:43 +08:00
Matri a9ee52f2d7
Fix/firecrawl parameters issue (#6213) 2024-07-12 12:59:50 +08:00
Waffle 7b225a5ab0
refactor(services/tasks): Swtich to dify_config witch Pydantic (#6203) 2024-07-12 12:25:38 +08:00
耐小心 d7a6f25c63
fix: differentiate prompts fields based on function_calling_type (#5880) 2024-07-12 11:07:38 +08:00
crazywoola ee3936916f
upgrade deepseek params (#6215) 2024-07-12 10:55:44 +08:00
dufei 109de52fe2
Fix: When editing an Agent, selecting custom tools does not allow filtering by labels. (#6197)
Co-authored-by: dufei <du_fei@venusgroup.com.cn>
2024-07-12 09:02:25 +08:00
Little 羊 2f064c68bc
Create ernie-4.0-turbo-8k-preview (#6132) 2024-07-11 20:20:07 +08:00
JasonVV 0e82072323
Fix if_else node compatibility with historical workflows. (#6186) 2024-07-11 17:13:16 +08:00
Jyong 678ad6b7eb
Fix/file stream azure blob (#6196) 2024-07-11 17:01:03 +08:00
Zhuo Qiu 63e34e5227
feat: support MyScale vector database (#6092) 2024-07-11 15:21:59 +08:00
非法操作 5660878f7b
chore: update the tool's doc (#6167) 2024-07-11 11:02:58 +08:00
liuzhenghua 9622fbb62f
feat: app rate limit (#5844)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-10 21:31:35 +08:00
crazywoola cc8dc6d35e
Revert "chore: update the tool's doc" (#6153) 2024-07-10 19:57:12 +08:00
Su Yang 215661ef91
feat: add PerfXCloud, Qwen series #6116 (#6117) 2024-07-10 18:26:10 +08:00
Joe 5a3e09518c
feat: add if elif (#6094) 2024-07-10 18:22:51 +08:00
非法操作 1d2ab2126c
chore: update the tool's doc (#6122) 2024-07-10 12:42:34 +08:00
Bowen Liang f9d00e0498
chore: use poetry for linter tools installation and bump Ruff from 0.4 to 0.5 (#6081) 2024-07-09 23:06:23 +08:00
sino d27e3ab99d
chore: remove unresolved reference (#6110) 2024-07-09 23:04:44 +08:00
Joe ce930f19b9
fix dataset operator (#6064)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-09 17:47:54 +08:00
8bitpd 7c70eb87bc
feat: support AnalyticDB vector store (#5586)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-07-09 13:32:04 +08:00
chenxu9741 6ef401a9f0
feat:add tts-streaming config and future (#5492) 2024-07-09 11:33:58 +08:00
takatost 17f22347ae
bump to 0.6.13 (#6078) 2024-07-08 23:23:07 +08:00
takatost 68b1d063f7
chore: remove tsne unused code (#6077) 2024-07-08 21:25:19 +08:00
Xiao Ley 6610b4cee5
feat: add request_params field to jina_reader tool (#5610) 2024-07-08 18:11:50 +08:00
Jyong cbbe28f40d
fix azure stream download (#6063) 2024-07-08 17:13:16 +08:00
75py 610da4f662
Fix authorization header validation to handle bearer types correctly - "authorization config header is required" error (#6040) 2024-07-08 00:09:59 +08:00
crazywoola 3ec80f9dda
Fix/6034 get random order of categories in explore and workflow is missing in zh hant (#6043) 2024-07-07 17:06:47 +08:00
Mab 91c5818236
Modify slack webhook url validation to allow workflow (#6041) (#6042)
Co-authored-by: Shunsuke Mabuchi <mabuchs@amazon.co.jp>
2024-07-07 14:09:20 +08:00
-LAN- c436454cd4
fix(configs): Update pydantic settings in config files (#6023) 2024-07-07 12:18:15 +08:00
Yeuoly a877d4831d
Fix/incorrect parameter extractor memory (#6038) 2024-07-07 12:17:34 +08:00
takatost d522308a29
chore: optimize memory fetch performance (#6039) 2024-07-07 08:54:24 +08:00
sino 85744b72e5
feat: support moonshot and glm base models for volcengine provider (#6029) 2024-07-07 01:17:33 +08:00
Cherilyn Buren f0b7051e1a
Optimize db config (#6011) 2024-07-07 01:06:51 +08:00
Masashi Tomooka 3b23d6764f
fix: token count includes base64 string of input images (#5868) 2024-07-06 16:53:32 +08:00
Bowen Liang 9b7c74a5d9
chore: skip pip upgrade preparation in api dockerfile (#5999) 2024-07-06 14:17:34 +08:00
-LAN- 4d105d7bd7
feat(*): Swtich to dify_config. (#6025) 2024-07-06 12:05:13 +08:00
非法操作 eee779a923
fix: the input field of tool panel not worked as expected (#6003) 2024-07-06 09:54:30 +08:00
ahasasjeb ab847c81fa
Add 2 firecrawl tools : Scrape and Search (#6016)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-06 09:45:39 +08:00
-LAN- b217ee414f
test(test_rerank): Remove duplicate test cases. (#6024) 2024-07-06 09:44:50 +08:00
takatost 23dc6edb99
chore: optimize memory messages fetch count limit (#6021) 2024-07-06 03:25:38 +08:00
takatost 79df8825c8
Revert "feat: knowledge admin role" (#6018) 2024-07-05 21:31:34 +08:00
K8sCat 71c50b7e20
feat: add Llama 3 and Mixtral model options to ddgo_ai.yaml (#5979)
Signed-off-by: K8sCat <k8scat@gmail.com>
2024-07-05 21:11:15 +08:00
opriuwohg af98fd29bf
fix: add status_code 304 (#6000)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-05 21:10:33 +08:00
crazywoola cddea83e65
6014 i18n add support for spanish (#6017) 2024-07-05 21:05:33 +08:00
Joe 3f0da88ff7
fix: update workflow trace query (#6010) 2024-07-05 18:37:26 +08:00
ahasasjeb cc63af8e72
Removed firecrawl-py, fixed and improved firecrawl tool (#5896)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-05 18:04:51 +08:00
非法操作 bf2268b0af
fix API tool's schema not support array (#6006) 2024-07-05 17:11:59 +08:00
xielong 00b4cc3cd4
feat: implement forgot password feature (#5534) 2024-07-05 13:38:51 +08:00
Aurelius Huang f546db5437
fix: document truncation and loss in notion document sync (#5631)
Co-authored-by: Aurelius Huang <cm.huang@aftership.com>
2024-07-05 11:48:17 +08:00
orangeclk f8aaa57f31
feat: add retry mechanism for zhipuai (#5926) 2024-07-05 10:49:18 +08:00
jianglin1008 cabcf94be3
fix: TENCENT_VECTOR_DB_REPLICAS can be set to 0 (#5968)
Co-authored-by: jianglin <jianglin@wangxiaobao.com>
2024-07-05 08:32:28 +08:00
legao 2d6624cf9e
typo: Update README.md (#5987) 2024-07-04 22:50:27 +08:00
-LAN- 02982df0d4
fix: Fix some type error in http executor. (#5915) 2024-07-04 19:34:37 +08:00
-LAN- d7f75d17cc
Chore/remove-unused-code (#5917) 2024-07-04 18:18:26 +08:00
Joe 5d9ad430af
feat: knowledge admin role (#5965)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2024-07-04 16:21:40 +08:00
Joe 688b8fe114
fix: langfuse logical operator error (#5948) 2024-07-04 13:47:15 +08:00
longzhihun aecdfa2d5c
feat: add claude3 function calling (#5889) 2024-07-03 22:21:02 +08:00
-LAN- cb8feb732f
refactor: Create a `dify_config` with Pydantic. (#5938) 2024-07-03 21:09:23 +08:00
orangeclk c490bdfbf9
fix: zhipuai pytest correction (#5934) 2024-07-03 19:19:33 +08:00
-LAN- e7494d632c
docs(api/core/tools/docs/en_US/tool_scale_out.md): Format by markdownlint. (#5903) 2024-07-03 13:13:38 +08:00
takatost e3006f98c9
chore: remove dify SaaS URL in default configs (#5888) 2024-07-02 22:49:18 +08:00
quicksand 372dc7ac1a
fix bug : TencentVectorDBConfig Add TENCENT_VECTOR_DB_DATABASE (#5879) 2024-07-02 21:31:14 +08:00
-LAN- 66a62e6c13
refactor(api/core/app/apps/base_app_generator.py): improve input validation and sanitization in BaseAppGenerator (#5866) 2024-07-02 18:58:07 +08:00
Jyong 0944ca9d91
Fix/remove tsne position test (#5858)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-07-02 17:57:42 +08:00
Masashi Tomooka 6e256507d3
doc: docker-compose won't start due to wrong README (#5859) 2024-07-02 16:10:22 +08:00
Joe 59ad091e69
feat: add export permission (#5841) 2024-07-02 13:37:37 +08:00
Joe 598e030a7e
feat: update LangfuseConfig host config (#5846) 2024-07-02 13:14:07 +08:00
-LAN- 32d85fb896
chore: Update some type hints in config. (#5833) 2024-07-02 08:50:02 +08:00
Jyong af308b99a3
sync delete app table record when delete app (#5819) 2024-07-02 08:48:29 +08:00
quicksand 2a27568537
Enhance: tools wecom bot support markdown message (#5791) 2024-07-01 18:19:47 +08:00
hymvp 1d3e96ffa6
add support oracle oci object storage (#5616) 2024-07-01 17:21:44 +08:00
Joe b7b1396c51
fix: ops trace slow db (#5812) 2024-07-01 17:09:53 +08:00
Jyong 71bcf75d9a
Feat/add delete knowledge confirm (#5810) 2024-07-01 17:06:51 +08:00
Charles Zhou 850c2273ee
feat: Nominatim OpenStreetMap search tool (#5789) 2024-07-01 16:34:32 +08:00
Charles Zhou cb09dbef66
feat: correctly delete applications using Celery workers (#5787) 2024-07-01 14:21:17 +08:00
longzhihun fdfbbde10d
[seanguo] modify bedrock Claude3 invoke method to converse API (#5768)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-07-01 04:36:13 +08:00
Joe f637ae4794
fix: langsmith message_trace end_user_data session_id error (#5759) 2024-06-30 01:12:16 +08:00
Joe ffb07eb24b
fix: workflow trace none type error (#5758) 2024-06-29 23:32:52 +08:00
Yeuoly f101fcd0e7
fix: missing process data in parameter extractor (#5755) 2024-06-29 23:29:43 +08:00
takatost 1e045a0187
fix: slow sql of ops tracing (#5749) 2024-06-29 20:28:30 +08:00
takatost 8fd75e6965
bump to 0.6.12-fix1 (#5743) 2024-06-29 17:43:20 +08:00
takatost d56cedfc67
fix: app config does not use empty string in the env (#5741) 2024-06-29 17:15:25 +08:00
takatost 906857b28a
fix: couldn't log in or resetup after a failed setup (#5739) 2024-06-29 17:07:21 +08:00
takatost 6d0cea5fe6
bump to 0.6.12 (#5712) 2024-06-28 22:00:19 +08:00
takatost 0bf4817474
fix: _convert_prompt_message_to_dict parameters err (#5716) 2024-06-28 21:00:00 +08:00
takatost 8e5569f773
fix: fix-app-site-missing command (#5714) 2024-06-28 20:33:53 +08:00
takatost d30c13891b
feat: add fix-app-site-missing command (#5711) 2024-06-28 20:20:23 +08:00
takatost 017d2c804b
fix: do not remove (#5706) 2024-06-28 19:33:42 +08:00
呆萌闷油瓶 68ac433218
feat: add support Spark4.0 (#5688) 2024-06-28 17:39:11 +08:00
Joe dd5f3873da
feat: change TRACE_QUEUE_MANAGER_INTERVAL default value (#5698)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-28 17:34:58 +08:00
scotlandowl 73ce945d40
Feat/add json process tool (#5555) 2024-06-28 11:57:32 +08:00
luckylhb90 d37ee498cd
fix: do not remove (#5682)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-06-28 11:19:34 +08:00
Kevin b3d6726f65
Feature/add qwen llm (#5659) 2024-06-28 11:06:29 +08:00
William Espegren f9e4b4e74c
Fix docker command (#5681) 2024-06-28 01:23:01 +08:00
liuzhenghua 2b080b5cfc
feature: Add presence_penalty and frequency_penalty parameters to the … (#5637)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-06-28 00:27:20 +08:00
Joe e8b8f6c6dd
Feat/fix ops trace (#5672)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-28 00:24:37 +08:00
Bowen Liang 2a13ef9ae0
chore: rearrange python dependencies in groups (#5603) 2024-06-27 17:52:54 +08:00
takatost 3ccad33194
feat: add jina new pre-defined rerankers, include: jina-reranker-v2 (#5657) 2024-06-27 13:45:35 +08:00
sunxichen bafc8a0bde
fix: tool call message role according to credentials (#5625)
Co-authored-by: sunxichen <sun.xc@digitalcnzz.com>
2024-06-27 12:35:27 +08:00
非法操作 92c56fdf2b
fix: HTTP request header is overwritten when user set Content-Type (#5628) 2024-06-27 12:31:37 +08:00
Bowen Liang dcb72e0067
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-27 11:21:31 +08:00
luckylhb90 2e718b85e9
fix(api): language list (#5649)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-06-27 08:46:53 +08:00
-LAN- 17d2f0bb0d
fix(api/configs): Ignore empty environment variables when loading config. (#5647) 2024-06-26 21:39:19 +08:00
takatost 0dfdb61ee9
fix: type error in config (#5643) 2024-06-26 21:01:16 +08:00
非法操作 e1a72e0e2b
fix: ro-RO is not a valid language (#5635) 2024-06-26 18:56:31 +08:00
Diego Romero-Lovo 4c0a31d38b
FR: #4048 - Add color customization to the chatbot (#4885)
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-26 17:51:00 +08:00
Joe 4e2de638af
feat: add ops trace (#5483)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-26 17:33:29 +08:00
Bowen Liang 31a061ebaa
chore: cleanup test_delete_by_document_id method in opensearch vdb test (#5619) 2024-06-26 17:21:36 +08:00
-LAN- f7234c93af
chore(pyproject.toml): Add Ruff formatter config. (#5627) 2024-06-26 16:30:28 +08:00
Bowen Liang d0fe56a98e
fix: populate app configs to system environment variables (#5590) 2024-06-26 14:27:49 +08:00
非法操作 b8926ea267
fix: DuckDuckGo image search tool error (#5606) 2024-06-26 13:21:40 +08:00
Jyong 43335b5c87
delete the deprecated method (#5612) 2024-06-26 12:51:50 +08:00
Pan, Wen-Ming 964f0e1400
fix: Modify the incorrect configuration name for Google storage (#5595)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-26 07:54:22 +08:00
Bowen Liang 87ee3e627f
chore: fix typo in config descriptions (#5585) 2024-06-25 21:19:56 +08:00
-LAN- 45a3ea6fed
fix: add support for FILE type in ToolParameterConverter (#5578) 2024-06-25 18:47:59 +08:00
Bowen Liang 2a0f03a511
refactor: extract cors configs into dify config and cleanup the config class (#5507)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-25 15:48:02 +08:00
takatost ec1d3ddee2
feat: support importing and overwriting workflow DSL (#5511)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-06-25 15:46:12 +08:00
keita69 cdc2a6f637
The firecrawl tool now supports self-hosting (#5528)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-25 15:15:21 +08:00
Yeuoly 023dba9475
fix: revert CI path filters (#5561) 2024-06-24 23:46:15 +08:00
sino 877a2c144b
feat: support predefined models for openrouter (#5494) 2024-06-24 16:31:53 +08:00
非法操作 f7900f298f
chore: refactor the http executor node (#5212) 2024-06-24 16:14:59 +08:00
非法操作 1e28a8c033
chore: add create_json_message api for tools (#5440) 2024-06-24 15:46:16 +08:00
-LAN- ba67206bb9
fix(api/model_runtime/azure/llm): Switch to tool_call. (#5541) 2024-06-24 15:35:21 +08:00
Xiaoguang Sun 13fcd7a901
feat: Add program_name attribute to TiDB connection (#5499)
Signed-off-by: Xiaoguang Sun <sunxiaoguang@gmail.com>
2024-06-24 14:41:07 +08:00
Jyong 756d9a4bc2
add opensearch default value (#5536) 2024-06-24 14:33:31 +08:00
takatost 4a031de0d9
feat: make Citations and Attributions display enable default (#5508)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-06-24 13:03:49 +08:00
crazywoola 47a5d4527b
feat: use root dir to start python and celery (#5515) 2024-06-24 09:53:26 +08:00
Xiao Ley dcec9d7bb7
feat: add new features to enhance image and link handling in Jina tool (#5517) 2024-06-24 01:06:26 +08:00
kurokobo ea29007bc0
fix: apply best practices for the latest buildkit (#5527) 2024-06-24 00:45:33 +08:00
Xiao Ley 3a626cd251
fix: added error handling for novita ai tool query (#5506)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-23 17:59:03 +08:00
Nam Vu e9ce0b10de
feat: add Asia/Ho_Chi_Minh timezone (#5521) 2024-06-23 16:47:44 +08:00
kurokobo c5d64baba4
fix: correct typos (#5510) 2024-06-22 23:01:02 +08:00
Bowen Liang 29ca6815ae
chore: use singular style in middleware config class name (#5502) 2024-06-22 18:26:38 +08:00
Bowen Liang 5217f7cf69
refactor: extract hosted service configs into dify config (#5504) 2024-06-22 17:41:17 +08:00
非法操作 57063095c1
fix: summary of duckduckgo_search (#5488) 2024-06-22 13:58:30 +08:00
vccler 48757e581e
fix: zhipu tool calling, this PR fixes the bug described in issue #5496 (#5469)
Co-authored-by: vccler <vccler@163.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-22 12:41:24 +08:00
LXM e8ad0339a3
fix: tongyi json output (#5396) 2024-06-22 12:25:23 +08:00
Bowen Liang f67b164b0d
refactor: extract db configs and celery configs into dify config (#5491) 2024-06-22 10:29:56 +08:00
Bowen Liang b05cc3a1e4
refactor: extract storage provider configs into dify configs (#5443) 2024-06-22 10:07:03 +08:00
Bowen Liang 8890978ad3
chore: use singular style in config class name (#5489) 2024-06-22 09:54:25 +08:00
takatost 9a5c423d59
chore: remove pip support for api service (#5453)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
2024-06-22 02:05:50 +08:00
tmuife 6a09409ec9
Add Oracle23ai as a vector datasource (#5342)
Co-authored-by: walter from vm <walter.jin@oracle.com>
2024-06-22 01:48:07 +08:00
Bowen Liang 27f0ae8416
build: support Poetry for depencencies tool in api's Dockerfile (#5105)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-22 01:34:08 +08:00
crazywoola 91d38a535f
fix: max_tokens of qwen-plus & qwen-plus-chat (#5480) 2024-06-21 16:49:33 +08:00
Pan, Wen-Ming 95c882934e
feat: add support for Vertex AI claude-3-5-sonnet@20240620 (#5475)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-21 16:45:56 +08:00
crazywoola 92ddb410cd
feat: option to hide workflow steps (#5436) 2024-06-21 12:51:10 +08:00
-LAN- 1336b844fd
feat(api/auth): switch-to-stateful-authentication (#5438) 2024-06-21 12:39:07 +08:00
Su Yang 26b6fd2236
feat: add support for bedrock claude-3-5-sonnet-20240620 (#5461) 2024-06-21 10:21:35 +08:00
takatost ff0f02d809
feat: add support for claude-3-5-sonnet-20240620 (#5452) 2024-06-21 00:23:15 +08:00
Bowen Liang 65d34ebb96
refactor: extract vdb configs into pydantic-setting based dify configs (#5426) 2024-06-20 16:24:10 +08:00
-LAN- 142dc0afd7
refactor: Remove unused code in large_language_model.py (#5433) 2024-06-20 16:20:40 +08:00
Bowen Liang 39c14ec7c1
improve: unify Excel files parsing in either xls or xlsx file format by Pandas (#4965) 2024-06-20 16:14:49 +08:00
-LAN- 23fa3dedc4
fix(core): Fix incorrect type hints. (#5427) 2024-06-20 15:16:21 +08:00
takatost a51ec2094f
fix: sentry config float type err (#5416) 2024-06-20 11:28:52 +08:00
Bowen Liang aed56b1a8f
fix: Revert "feat: initial support for Milvus 2.4.x (#3795)" downgrading to 2.3.x for Linux arm64 installation failure (#5414) 2024-06-20 11:18:05 +08:00
takatost a88aa20824
fix: optional parameter missing default value None in http request node (#5413) 2024-06-20 11:07:01 +08:00
quicksand 0105129fa8
fix bug: tencent vdb #5378 (#5408) 2024-06-20 10:37:39 +08:00
Bowen Liang c923684edd
chore: extract retrival method literal values into enum (#5060) 2024-06-19 16:05:27 +08:00
liuzhenghua 9d5a89eab6
feat: add log date timezone (#4623)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-19 15:51:00 +08:00
-LAN- bdf3ea4369
docs(api/README): Remove unnecessary `=` (#5380) 2024-06-19 15:17:13 +08:00
Bowen Liang bb33ffc332
feat: initial support for Milvus 2.4.x (#3795) 2024-06-19 13:55:44 +08:00
Bowen Liang 3cc6093e4b
feat: introduce pydantic-settings for config definition and validation (#5202)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-19 13:41:12 +08:00
baojingyu d160d1ed02
feat: support opensearch approximate k-NN (#5322) 2024-06-19 12:44:33 +08:00
fishisnow e785cbb81d
Fix: multi image preview sign (#5376)
Co-authored-by: huangyusong <huangyusong@yingzi.com>
2024-06-19 12:36:40 +08:00
kurokobo 0e3113b7ce
feat: allow non-english wikipedias to be searched (#5371) 2024-06-19 10:06:47 +08:00
开坦克的贝塔 7d5ebbb611
docs(readme): Optimize the content in the readme file (#5364)
Co-authored-by: 开坦克的贝塔 <k@aircode.io>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 18:33:22 +08:00
horochx 85eee0dfbb
Update README.md (#5359) 2024-06-18 18:21:45 +08:00
Xiao Ley 369a395ee9
fix: resolve issue with cot_agent_runner not analyzing user-uploaded images correctly (#5360)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 18:15:41 +08:00
-LAN- 4e3d76a1d1
chore: add `novita_client` to `pyproject.toml` (#5349) 2024-06-18 14:52:20 +08:00
Bowen Liang 7450b9acf3
dep: bump chromadb from 0.5.0 to 0.5.1 (#5345) 2024-06-18 14:05:14 +08:00
Bowen Liang c7d378555a
chore: set build system to Poetry and remove unnecessary settings with package mode disabled (#5263) 2024-06-18 13:27:03 +08:00
Bowen Liang 5f0ce5811a
feat: add `flask upgrade-db` command for running db upgrade with redis lock (#5333) 2024-06-18 13:26:01 +08:00
rerorero 9b7fdadce4
fix: wrong token usage in iteration node for streaming result (#5336) 2024-06-18 13:08:40 +08:00
Xiao Ley 132f5fb3de
feat: add Novita AI image generation tool, implemented model search, text-to-image and create tile functionalities (#5308)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 11:08:25 +08:00
Ikko Eltociear Ashimine 8266842809
chore: update llm.py (#5335) 2024-06-18 09:29:14 +08:00
sino d7213b12cc
fix: extract params by function calling for models supporting tool call (#5334) 2024-06-17 23:25:29 +08:00
Richards Tu c163521b9e
Update and fix the model param of Deepseek (#5329) 2024-06-17 21:40:04 +08:00
Mitsuki Ogasahara 7305713b97
fix: allow special characters in email (#5327)
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-17 21:32:59 +08:00
sino edffa5666d
fix: got unknown type of prompt message in multi-round ReAct agent chat (#5245) 2024-06-17 21:20:17 +08:00
-LAN- 54756cd3b2
chore(core/workflow/utils/variable_template_parser): Refactor VariableTemplateParser class for better readability and maintainability. (#5328) 2024-06-17 21:18:56 +08:00
-LAN- b73ec87afc
fix(core/workflow): Handle special values in node run result outputs (#5321) 2024-06-17 20:41:57 +08:00
Justin Wu 61f4f08744
Add bedrock command r models (#4521)
Co-authored-by: Justin Wu <justin.wu@ringcentral.com>
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-06-17 20:37:46 +08:00
Jyong 07387e9586
add the filename length limit (#5326) 2024-06-17 20:36:54 +08:00
quicksand 147a39b984
feat: support tencent cos storage (#5297) 2024-06-17 19:18:52 +08:00
Bowen Liang 7a758a35fe
fix: pin tenacity to 8.3.0 (#5319) 2024-06-17 18:03:42 +08:00
sino be3512aa57
fix: unable to reindex documents (#5276) 2024-06-17 17:19:43 +08:00
Charles Zhou cc4a4ec796
feat: permission and security fixes (#5266) 2024-06-17 16:06:32 +08:00
非法操作 24282236f0
fix: not checked require_summary of duckduckgo search raise error (#5303) 2024-06-17 14:18:49 +08:00
-LAN- 5a99aeb864
fix(core): Reorder `field_validator` and `classmethod` to fit Pydantic V2. (#5257) 2024-06-17 10:04:28 +08:00
Charlie.Wei e95f8fa3dc
Dalle3 add seed (#5288)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-17 09:27:27 +08:00
crazywoola 9a64aa76c1
fix: typo and check (#5287) 2024-06-17 09:15:43 +08:00
kurokobo 42029791e4
fix: add event handler to delete the site when the related app deleted (#5282) 2024-06-17 08:47:26 +08:00
Bowen Liang d94279ae75
fix: casting non-string type value for tool parameter options (#5267) 2024-06-16 09:47:20 +08:00
rerorero 3a423e8ce7
fix: visioin model always with low quality (#5253) 2024-06-16 09:46:17 +08:00
Pan, Wen-Ming 4b54843ed7
fix: run agent with Vertex AI Gemini models (#5260)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-16 09:36:31 +08:00
kurokobo 2e842333b1
fix: correct typos in the icons for microsoft (#5243) 2024-06-15 21:02:47 +08:00
Yash Parmar 6ccde0452a
feat: Added hindi translation i18n (#5240) 2024-06-15 21:01:03 +08:00
Serply 795714bc2f
feat(Tools): Add Serply Web/Job/Scholar/News Search tool for more options (#5186)
Co-authored-by: teampen <136991215+teampen@users.noreply.github.com>
2024-06-15 20:09:33 +08:00
Masashi Tomooka d9bee03ff6
fix: embedding job fails using IAM role (#5252) 2024-06-15 18:57:54 +08:00
sino 4f0488abb5
fix: wrong order of history prompts in ReAct agent mode (#5236) 2024-06-15 10:53:30 +08:00
takatost 12c815c597
fix: ExtractSetting optional value missing None as default val (#5238) 2024-06-15 02:58:47 +08:00
takatost d098bdc59b
version to 0.6.11 (#5224) 2024-06-15 02:46:24 +08:00
Jyong ba5f8afaa8
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-15 02:46:02 +08:00
takatost 8da035aac6
Update README.md (#5228) 2024-06-14 22:31:01 +08:00
kurokobo ef6034abfd
fix: allow the name and icon of the web app to be set independently of that of the bot itself (#5225) 2024-06-14 22:16:11 +08:00
kurokobo 0391282b5e
fix: initialize site with customized icon and icon_background (#5227) 2024-06-14 22:15:50 +08:00
走在修行的大街上 8d1386df0f
feat(Tools): Add Feishu multi-dimensional table operation function (#5213)
Co-authored-by: 黎斌 <libin.23@bytedance.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-14 21:19:20 +08:00
DomKing 43c19007e0
fix: workspace member's last_active should be last_active_time, but not last_login_time (#4906) 2024-06-14 20:49:19 +08:00
rerorero c6b791d070
fix: number variable cause type error in openai moderation (#5222) 2024-06-14 20:43:03 +08:00
Charles Zhou 8bcc5a36bb
feat: new editor user permission profile (#4435)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-14 20:34:25 +08:00
th3n00b13 cdb6c801c1
Fix: http_request delete method not working (#4975) 2024-06-14 20:07:22 +08:00
quicksand 4080f7b8ad
feat: support tencent vector db (#3568) 2024-06-14 19:25:17 +08:00
Jaxon Ley 337bad8525
feat: Add Optional API Key, Proxy Server, and Bypass Cache Parameters to Jina Tools (#5197) 2024-06-14 19:09:25 +08:00
Bin 0f35d07052
support ERNIE-4.0-8K-Latest (#5216) 2024-06-14 18:45:24 +08:00
-LAN- 7f44e88eda
fix(model_providers/ollama): Fix OllamaLargeLanguageModel to correctly set the stop option (#5217) 2024-06-14 18:26:14 +08:00
Jason b7ff765d8d
Add novita.ai as model provider (#4961) 2024-06-14 18:23:06 +08:00
Jyong d7fbae286a
add aws s3 iam check (#5174) 2024-06-14 15:19:59 +08:00
Masashi Tomooka 0633aae7dc
feat: allow to use IAM Role for Bedrock (#5188) 2024-06-14 15:18:42 +08:00
doufa f87f11e92c
chore: make the Celery command more noticeable (#5203) 2024-06-14 15:06:07 +08:00
Bowen Liang 2b04388361
chore: remove bump-pydantic dependency (#5177) 2024-06-14 15:05:17 +08:00
takatost 3c0f21d174
fix: workflow as tool create error by type misuse (#5205) 2024-06-14 15:01:09 +08:00
-LAN- ed53ef29f4
fix(core/tools): Fix the issue with iterating over None in `_transform_tool_parameters_type`. (#5190) 2024-06-14 11:25:48 +08:00
dependabot[bot] 54e02b8147
chore(deps): bump authlib from 1.2.0 to 1.3.1 in /api (#5115)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-14 03:55:40 +08:00
Summer-Gu 7f98c2ea3f
refactor: Delete the dataset to verify whether it is in use (#5112) 2024-06-14 03:25:38 +08:00
dependabot[bot] 7189a4c379
chore(deps): bump azure-identity from 1.15.0 to 1.16.1 in /api (#5116)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-14 03:24:32 +08:00
takatost 415022aa14
fix: pydantic2 error (#5172) 2024-06-14 03:05:04 +08:00
saga.rey edf2047f04
fix: milvus_vector default dataset index_struct type from weaviate to milvus (#5098) 2024-06-14 02:36:01 +08:00
rerorero b85ae146a7
fix: JSON mode with an image doesn't work for Gemini (#5169) 2024-06-14 02:32:09 +08:00
takatost 5ec7d85629
fix: issues by pydantic2 upgrade (#5171) 2024-06-14 02:28:28 +08:00
Pan, Wen-Ming f13af5a811
fix(model_providers/vertex_ai): Vertex AI Anthropic models authentication failed (#4971) 2024-06-14 01:34:31 +08:00
Bowen Liang f976740b57
improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 2024-06-14 01:05:37 +08:00
Yeuoly e8afc416dd
improve: CI experience (#5168) 2024-06-13 23:16:28 +08:00
Yeuoly 0cccf9c67d
feat: introduce APP_MAX_EXECUTION_TIME (#5167) 2024-06-13 23:08:05 +08:00
Bowen Liang cdc08a434f
feat: support Chroma vector store (#5015) 2024-06-13 18:02:18 +08:00
Kazuki Takamatsu 3f18369ad2
Fix: google storage init with sa and download (#5054) 2024-06-13 17:36:34 +08:00
Kazuki Hasegawa db976a1f74
Upgrade boto3 library to support EKS Pod Identity. (#5064) 2024-06-13 17:36:14 +08:00
kurokobo e61f5d029a
chore(docs): fix minor small typos (#5124) 2024-06-13 17:36:01 +08:00
sino 8210637bc5
feat: support jina-clip-v1 embedding model (#5146) 2024-06-13 16:31:18 +08:00
呆萌闷油瓶 790543131a
chore:add some new api version for azure openai (#5142) 2024-06-13 16:30:47 +08:00
Ikko Eltociear Ashimine a40f68cf94
chore: update qdrant_vector.py (#5128) 2024-06-13 15:35:14 +08:00
yanghx adc948e87c
fix(api/core/model_runtime/model_providers/baichuan,localai): Parse ToolPromptMessage. #4943 (#5138)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-13 13:08:30 +08:00