Commit Graph

2523 Commits

Author SHA1 Message Date
miendinh f104b930cf
feat: support elasticsearch vector database (#3558)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-08-13 17:36:20 +08:00
Onelevenvy 0f59d76997
fix: add context_size and max_chunks to Tongyi embedding to resolve issue #7189 (#7227) 2024-08-13 16:35:22 +08:00
非法操作 b3743a9ae5
chore: refactor searXNG tool (#7220) 2024-08-13 15:34:29 +08:00
lichao 13d061911b
Error Exception Message Of "Message Not Exists.", Should be "Suggested Questions Is Disabled." (#7219) 2024-08-13 15:17:18 +08:00
KVOJJJin 935e72d449
Feat: conversation variable & variable assigner node (#7222)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-08-13 14:44:10 +08:00
yusuke_ten 8b55bd5828
fix: display notion document title correctly (#7215) 2024-08-13 14:05:57 +08:00
shAlfred a12ddc47e7
feat: add support of speech2text function for OpenAI-API-compatible and Siliconflow (#7197) 2024-08-12 21:38:59 +08:00
Weaxs 67b9fdaad7
siliconflow support bge-3 && bce-v1 embedding (#7198) 2024-08-12 19:14:43 +08:00
mago960806 a68df696ec
Fix issue with incorrect port number in app_base_url due to NAT networks (#6653) 2024-08-12 12:26:12 +08:00
Bowen Liang ccb6ddd840
chore: bump Ruff to 0.5.7 (#7174) 2024-08-12 10:24:48 +08:00
ybalbert001 f2cb1fb09f
Fix : Workflow "start" paste url not support s3 pre-signed URL (#6855)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-08-11 16:45:15 +08:00
灰灰 ac60182c91
fix: solving http-request-tool bugs in workflow (#6685) 2024-08-11 16:32:06 +08:00
crazywoola 8b5761efb2
change secret input to text input in searxng (#7160) 2024-08-10 16:58:22 +08:00
Yanyi Liu 5b32f2e0dd
Feat: Add model provider Text Embedding Inference for embedding and rerank (#7132) 2024-08-09 19:12:13 +08:00
Yanyi Liu 4cbeb6815b
Fix: Wrong cutoff length lead to empty input in openai compatible embedding model. (#7133) 2024-08-09 19:11:57 +08:00
Jeff Li d338f69837
feat: add decode option to json process tools (#7138) 2024-08-09 19:05:27 +08:00
Jyong c6b0dc6a29
update dataset embedding model, update document status to be indexing (#7145) 2024-08-09 16:47:15 +08:00
crazywoola f667ef98cb
Feat/update tools length (#7141) 2024-08-09 16:07:37 +08:00
Joe 425174e82f
feat: update ops trace (#7102) 2024-08-09 15:22:16 +08:00
Joe 7201b56a6d
fix: workflow log run time error (#7130) 2024-08-09 14:46:31 +08:00
Matri 4dfa8eedb8
Feat/tool-D-ID (#6278) 2024-08-09 11:05:33 +08:00
forrestlinfeng 07511dfaf4
update stepfun model (#7118)
Co-authored-by: chenlinfeng <chenlinfeng@step.ai>
Co-authored-by: Tfsh <tianfs_fight@163.com>
2024-08-08 20:40:37 +08:00
小羽 7944ce0594
feat: wenxin add yi-34b-chat (#7117) 2024-08-08 20:01:21 +08:00
Aero Kang ad682c394d
fix annotation reply is null (#7103) 2024-08-08 19:07:50 +08:00
orangeclk 83acb53c08
feat: add zhipu embedding-3 (#7100) 2024-08-08 17:08:46 +08:00
shAlfred a7162240e6
feat: add text-embedding functon and LLM models to Siliconflow (#7090) 2024-08-08 17:08:28 +08:00
Jyong 12095f8cd6
extract docx filter comment element (#7092) 2024-08-08 16:53:29 +08:00
majian 5542ee4d0d
workflow logs support workflow run id filter (#6833) 2024-08-08 14:54:02 +08:00
zhuhao 4ffa706e4f
feat: add a builtin tool to support regex extraction. (#7081) (#7087) 2024-08-08 14:23:57 +08:00
Jyong 169cde6c3c
add nltk punkt resource (#7063) 2024-08-08 14:23:22 +08:00
小羽 34a9dbe826
Feat/add 360-zhinao provider (#7069) 2024-08-08 14:23:08 +08:00
Nam Vu 8e23e24bd5
feat: Poetry requests timeout (#7086) 2024-08-08 14:17:29 +08:00
orangeclk f288d367ac
Add price info for zhipu models (#7084) 2024-08-08 14:17:05 +08:00
Waffle 5e2fa13126
feat: support glm-4-long (#7070)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-08-08 10:54:39 +08:00
-LAN- 67a2f14cef
fix(api/core/workflow/nodes/tool/tool_node.py): Keep None value in tool params. (#7066) 2024-08-07 19:36:21 +08:00
Joe d7bb422a5c
fix: hunyuan assistant_prompt_message pydantic error (#7062) 2024-08-07 18:31:40 +08:00
8bitpd 40c6f3c724
fix: add redis lock to AnalyticdbVector init (#6859)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-08-07 17:32:06 +08:00
-LAN- df8f8c9a2c
feat(api/core/rag/datasource/vdb/analyticdb/analyticdb_vector.py): Checking config before init analyticdb (#7050) 2024-08-07 17:31:36 +08:00
-LAN- 536c43257b
refactor(*): Update hard-code '[__HIDDEN__]' to the constant. (#7048) 2024-08-07 17:30:56 +08:00
-LAN- 4e8f6b3603
chore(api/core/app/segments/segments.py): Remove todo tags. (#7052) 2024-08-07 17:29:35 +08:00
Jyong 80c94f02e9
add vector field for other vectordb (#7051) 2024-08-07 17:14:03 +08:00
-LAN- aad02113c6
fix(api/core/app/segments): Allow to contains boolean value in object segment (#7047) 2024-08-07 16:20:22 +08:00
chenxu9741 72c75b75cf
feat: Add hyperlink parsing to the DOCX document. (#7017) 2024-08-07 16:01:14 +08:00
Sadegh Ghanbari Shohani ffa992acf7
Add support for i18n Farsi language (fa-IR) (#7044) 2024-08-07 15:44:42 +08:00
majian 99b78dd198
feat: add gpt-4o-2024-08-06 (#7046) 2024-08-07 15:35:57 +08:00
Sangmin Ahn 7f81a86e9e
chore: show non-English characters in exported DSL files (#7042) 2024-08-07 14:03:15 +08:00
Achim a93bc83c8d
Provide output data also in json property of workflow tool (#6924) (#7027) 2024-08-07 08:54:51 +08:00
crazywoola 3516989738
fix: typos in wenxin llm (#7021) 2024-08-06 22:33:03 +08:00
Sa Zhang 26991443ed
fix: Fix incorrect context size for jina-reranker-v2 model (#7006) 2024-08-06 21:08:29 +08:00
Bryan eece50acec
fix: tran list issue (#7009)
Co-authored-by: libing <libing@healink.cn>
2024-08-06 21:01:38 +08:00
Jyong 28d4e5b045
Fix/reranking mode is null (#7012) 2024-08-06 19:12:04 +08:00
yanghx c53875ce8c
fix #6902 .docx handles images within tables and handles cross-column tables (#6951) 2024-08-06 17:14:24 +08:00
灰灰 96dcf0fe8a
fix: code tool fails when null property exists in object (#6988) 2024-08-06 16:11:00 +08:00
Yefori bd3ed89516
feat: add function calling for deepseek models (#6990) 2024-08-06 13:37:27 +08:00
小羽 23ed15d19f
feat:nvidia add nemotron4-340b and microsoft/phi-3 (#6973) 2024-08-06 10:16:41 +08:00
非法操作 312d905c9b
chore: update duckduckgo tool (#6983) 2024-08-06 10:16:04 +08:00
takatost d839f1ada7
version to 0.6.16 (#6972) 2024-08-05 23:33:37 +08:00
takatost 6da14c2d48
security: fix api image security issues (#6971) 2024-08-05 20:21:08 +08:00
Pedro Gomes a34285196b
Revise the wrong pricing of certain LLM models. (#6967) 2024-08-05 18:41:44 +08:00
takatost ea30174057
chore: optimize streaming tts of xinference (#6966) 2024-08-05 18:23:23 +08:00
Sangmin Ahn dd676866aa
chore: exclude .txt extenstion in create_by_text API (#6956) 2024-08-05 15:52:07 +08:00
TzuxinChen f0d10553b4
Fixed a bug where permission was clearly displaye… (#6934) 2024-08-05 13:19:01 +08:00
liuzhenghua ef616c604a
fix: The permissions issue of the editor role accessing some backend … (#6945)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-05 12:55:55 +08:00
Bowen Liang f656e1bae2
fix: ensure db migration in docker entry script running with `upgrade-db` command for proper locking (#6946) 2024-08-05 10:55:26 +08:00
liuzhenghua 141e4e0276
fix: restore xinference secret field (#6941)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-04 22:32:24 +08:00
Pedro Gomes 20d3e1d297
Fix increase_usage of total_price in agent_runner (#6688) 2024-08-04 14:42:22 +08:00
chenxu9741 dff3f41ef6
Workflow TTS playback node filtering issue. (#6877) 2024-08-04 14:28:56 +08:00
Weaxs 5e634a59a2
compatible xinference reranker server (#6927) 2024-08-04 13:49:38 +08:00
Joe 26e46d365c
fix: workflow trace user_id error (#6932) 2024-08-04 03:28:50 +08:00
takatost bcd7c8e921
fix: sending app trace data to other app trace provider (#6931) 2024-08-04 00:05:51 +08:00
Bowen Liang 70283f5b9f
dep: support for Python 3.12 (#6771) 2024-08-02 21:14:36 +08:00
JuHyung Son 2e941bb91c
add new provider Solar (#6884) 2024-08-02 20:48:09 +08:00
zhuhao 541bf1db5a
feat: add the tool Serper for Google search. (#6786) (#6790) 2024-08-02 20:37:04 +08:00
Jyong 048bc4c06e
fix update dataset failed when embedding model is not exist (#6920) 2024-08-02 20:30:22 +08:00
Joe f97a51ce24
fix: reranking disable timer error (#6910) 2024-08-02 16:34:50 +08:00
Bowen Liang 6aa02f8c63
dep: bump pgvecto-rs client from 0.1.x to 0.2.x (#6891) 2024-08-02 15:51:23 +08:00
crazywoola 7ab04e17e7
fix: return code in service api (#6911) 2024-08-02 15:48:58 +08:00
非法操作 bf3f1027c8
fix: code execution node not display clear reasons when sandbox res error (#6830) 2024-08-02 15:36:44 +08:00
sino 8166a8caf5
feat: update llama3.1 parameters for openrouter (#6901) 2024-08-02 13:13:34 +08:00
Jyong 44801df8f8
fix score threshold limit be None (#6900) 2024-08-02 12:10:51 +08:00
灰灰 56af1a0adf
pref: change ollama embedded api request (#6876) 2024-08-02 12:04:47 +08:00
dufei f8617db012
fix tongyi tool calls (#6896) 2024-08-02 10:03:43 +08:00
Jyong 2ab9af3b38
delete weight_type in knowledge retrieval node (#6892) 2024-08-01 21:38:59 +08:00
Weaxs cc4785f094
fix: xinference reranker return_documents (#6888) 2024-08-01 19:57:53 +08:00
ian 093f902335
fix: Change API key authentication failure response code from 404 to 401 (#6885) 2024-08-01 17:41:35 +08:00
hursit 104c797dd0
feat: Add support for i18n Turkish language (tr-TR) (#6886)
Co-authored-by: hursit <hursit.topal@enuygun.com>
2024-08-01 17:30:35 +08:00
chenxu9741 a9cd6df97e
Remove tts (blocking call) (#6869) 2024-08-01 14:50:22 +08:00
呆萌闷油瓶 f31142e758
Azure 4o mini options (#6873) 2024-08-01 14:04:18 +08:00
crazywoola 792f908afb
Revert "feat:Azure gpt4o mini" (#6870) 2024-08-01 13:32:03 +08:00
非法操作 29e3c3061c
fix: remote image not display in answer node (#6867) 2024-08-01 13:21:49 +08:00
呆萌闷油瓶 14367ddc09
feat:Azure gpt4o mini (#6866) 2024-08-01 13:03:08 +08:00
Jyong 8157fccf6d
delete weight_type (#6865) 2024-08-01 13:02:33 +08:00
Charlie.Wei cbf7f21ade
Add azure gpt4omini (#6862)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-08-01 12:57:52 +08:00
Weaxs f6e8e120a1
support xinference tts (#6746) 2024-08-01 11:59:15 +08:00
Joe 08f922d8c9
fix: anthropic max token NoneType error (#6858) 2024-08-01 11:30:00 +08:00
-LAN- feb4576ee7
chore: update SQLAlchemy configuration with custom naming convention (#6854) 2024-08-01 11:16:49 +08:00
小羽 56b43f62d1
feat: nvidia add llama3.1 model (#6844) 2024-07-31 21:24:02 +08:00
Giga Group 4b410494b3
Add model parameter enable_enhance for hunyuan llm model (#6847)
Co-authored-by: sun <sun@centen.cn>
2024-07-31 20:04:43 +08:00
Joe df9bd36cab
fix: claude-3-5-sonnet-20240620 max token error (#6843) 2024-07-31 18:34:44 +08:00
Jyong af76381b98
fix notion internal setting (#6836) 2024-07-31 17:17:46 +08:00
William Espegren 4be12b29b9
fix: improved error handling for spider tool (#6835) 2024-07-31 17:11:52 +08:00
ybalbert001 c23aa50bea
Add AWS builtin Tools (#6721)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-31 14:41:42 +08:00
Nam Vu 8eb0d0fddd
feat: support Celery auto-scale (#6249)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-31 14:34:44 +08:00
Ever 545d3c5a93
chore: Add processId field for metrics of threads/db-pool-stat/health (#6797)
Co-authored-by: 老潮 <zhangyongsheng@3vjia.com>
Co-authored-by: takatost <takatost@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-31 00:21:16 +08:00
crazywoola 3c371a6cb0
fix: workflow api (#6810) 2024-07-30 23:51:48 +08:00
longzhihun 9ce5cea911
feat: bedrock invoke enhancement (#6808) 2024-07-30 21:57:18 +08:00
eric-0x72 98d9837fbc
fix wrong charset when decoding Chinese content (#6774)
Co-authored-by: zhangwb <zhangwb@zts.com.cn>
2024-07-30 21:32:45 +08:00
Yeuoly 72963d1f13
fix: nonetype in webscraper validation (#6788) 2024-07-30 14:45:14 +08:00
-LAN- a98284b1ef
refactor(api): Switch to `dify_config` (#6750)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-30 11:15:26 +08:00
Bowen Liang daa31b2cb3
chore: remove redundant version pinning for indirect dependencies (#6772) 2024-07-30 08:45:57 +08:00
Bowen Liang b414ea41d6
dep: initial support for Milvus 2.4.x (#6084) 2024-07-29 19:56:45 +08:00
Joe f78d0082ae
feat: implement function dispatch table for trace processing (#6628) 2024-07-29 18:47:25 +08:00
SiliconFlow, Inc 3e18d32ce5
add deepseek-coder-v2 in siliconflow (#6149) 2024-07-29 18:45:19 +08:00
Charles 94d68b6a08
upgrade deepseek params (#6744) 2024-07-29 18:31:56 +08:00
Giga Group c9ff0e3961
Add model hunyuan-embedding (#6657)
Co-authored-by: sun <sun@centen.cn>
2024-07-29 18:30:52 +08:00
-LAN- 8dd68e2034
fix(api/core/moderation/output_moderation.py): Fix config call. (#6769) 2024-07-29 18:30:29 +08:00
Bowen Liang cb01bf2986
chore: set logging level to debug when reading YAML files and falling back to default value in case of None (#6758) 2024-07-29 13:40:18 +08:00
Bowen Liang 20268708cc
chore: improve position map conversion and tolerate empty position yaml file (#6541) 2024-07-29 10:32:11 +08:00
Vicky Guo 829472a1d7
switch to diffy_config with Pydantic in files, moderation and app (#6747)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-29 02:57:45 +08:00
Hiroshige Aoki e23461c837
Fix/6615 40 varchar limit on DatasetCollectionBinding and Embedding model name (#6723) 2024-07-28 09:42:58 +08:00
非法操作 21f6caacd4
feat: enhance the firecrawl tool (#6705) 2024-07-27 15:00:06 +08:00
-LAN- 6a3bef8378
feat(api/core/app/segments): Update segment types and variables (#6734)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:51 +08:00
-LAN- b6c3010f02
refactor(api/core/workflow/nodes/base_node.py): Update extract_variable_selector_to_variable_mapping method signature. (#6733)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:25 +08:00
crazywoola 90d2c01218
Feat/6725 can not get image url from cogview tool (#6728) 2024-07-27 00:07:31 +08:00
-LAN- 83af50368f
fix(api/core/model_runtime/model_providers/azure_openai/llm/llm.py): Try to skip if `delta.delta` is None. (#6727)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 00:05:21 +08:00
Jyong cf258b7a67
add xlsx support hyperlink extract (#6722) 2024-07-26 19:26:52 +08:00
-LAN- 5d77dc4f58
feat(api/core/app/segments/parser.py): Remove blank segment in `convert_template` (#6709)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 18:19:33 +08:00
Joe e4542215cc
fix: tongyi empty tool_calls is not supported in message (#6719) 2024-07-26 18:10:13 +08:00
Jason 3d3677e912
Feat/model provider novita (#6717)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-26 17:37:21 +08:00
-LAN- c6996a48a4
refactor(api/core/app/segments): Support more kinds of Segments. (#6706)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 15:03:56 +08:00
chenxu9741 6b50bb0fe6
issues #6655 Open ai tts issues (#6696) 2024-07-26 14:55:49 +08:00
Sangmin Ahn ecb9c311b5
chore: make prompt generator max tokens configurable (#6693) 2024-07-26 10:20:23 +08:00
Yeuoly 79cb23e8ac
security/SSRF vulns (#6682) 2024-07-25 20:50:26 +08:00
longzhihun c5ac004f15
[seanguo] fix: unsupported filename in windows & add Mistral Large 2 (#6679) 2024-07-25 19:26:46 +08:00
RookieAgent 78a339a794
modify llama3-1 yaml filename to support Windows pull operations (#6677) 2024-07-25 18:58:55 +08:00
灰灰 5e4ac11df3
fix: code block segmentation problem of markdown document (#6465) 2024-07-25 17:24:37 +08:00
tmuife 16b4f560cd
fix bugs(when using Oracle23ai as Vector DB) (#6658) 2024-07-25 17:07:14 +08:00
-LAN- 75e6576c67
refactor(api/core/app/segments): implement `to_object` in ObjectVariable and ArrayVariable. (#6671)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 17:06:38 +08:00
Seayon 0b4c26578e
Enhance database URI security and add URL encoding (#6668) 2024-07-25 16:48:00 +08:00
xielong ebcc07e3e9
feat: support max_retries in jina requests (#6585) 2024-07-25 13:10:39 +08:00
-LAN- 55c2b61921
fix(api/fields/workflow_fields.py): Add check in environment variables (#6621) 2024-07-25 11:30:52 +08:00
Giga Group ca696fe94c
Add support of tool-call for model provider "hunyuan" (#6656)
Co-authored-by: sun <sun@centen.cn>
2024-07-25 11:27:58 +08:00
longzhihun 9815aab7a3
[seanguo] feat: add llama 3.1 support in bedrock (#6645) 2024-07-25 11:20:37 +08:00
yanghx 349ec0db77
fix tencent_cos_storage image-preview error is not a byte (#6652) 2024-07-25 11:20:20 +08:00
majian a876baf0a9
Resolve variable type parameter error (#6646) 2024-07-25 11:15:54 +08:00
Jyong 91fd8521c3
fix reranking model field error (#6654) 2024-07-25 10:07:55 +08:00
-LAN- 4ec9a87e46
fix(api/core/workflow/nodes/iteration/iteration_node.py): Extend output in iteration if output is a array. (#6647)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 00:32:39 +08:00
Vico Chu fb5e3662d5
Chores: add missing profile for middleware docker compose cmd and fix ssrf-proxy doc link (#6372)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-24 19:36:06 +08:00
-LAN- 31efe10c75
refactor(api/core/workflow/workflow_engine_manager.py): Remove (#6630)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:40 +08:00
-LAN- 72bc9d5f2b
feat(api/core/app/segments/variables.py): Support description in Variable. (#6636)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:22 +08:00
Jyong 600f13436d
remove rerank model must be required when retrieval_model is multiple (#6640) 2024-07-24 19:34:41 +08:00
Joe b347a2f839
Feat/user session id search (#6638) 2024-07-24 19:34:23 +08:00
zhangzhiqiangcs d4c55748f1
doc: fix about model features (#6619) 2024-07-24 19:12:10 +08:00
takatost 0625db0bf5
chore: optimize asynchronous workflow deletion performance of app related data (#6639) 2024-07-24 19:00:37 +08:00
takatost 05141ede16
chore: optimize asynchronous deletion performance of app related data (#6634) 2024-07-24 18:15:03 +08:00
dufei 5af2df0cd5
fix: qwen fc error (#6620)
Co-authored-by: dufei <du_fei@venusgroup.com.cn>
2024-07-24 16:56:06 +08:00
crazywoola f324374b95
Fix/6615 40 varchar limit on model name (#6623) 2024-07-24 16:23:16 +08:00
Jyong e4bb943fe5
Feat/delete single dataset retrival (#6570) 2024-07-24 12:50:11 +08:00
takatost 0fb741f269
fix: downgraded sentry-sdk to 1.44.1 due to claude LLM token returning 0 (#6597) 2024-07-24 04:49:03 +08:00
takatost 4c85393a1d
feat: add GroqCloud llama3.1 series models support (#6596) 2024-07-24 00:41:58 +08:00
sino d5c2680fde
feat: support llama3.1 series models for openrouter provider (#6595) 2024-07-24 00:37:48 +08:00
takatost 49729647ea
bump to 0.6.15 (#6592) 2024-07-23 22:46:42 +08:00
-LAN- 85a883e281
fix(variables): NoneVariable should inherit from NoneSegment. (#6584) 2024-07-23 21:46:08 +08:00
Joe 8123a00e97
feat: update prompt generate (#6516) 2024-07-23 19:52:14 +08:00
-LAN- 2bc0632d0d
fix(segments): Support NoneType. (#6581) 2024-07-23 17:59:32 +08:00
-LAN- ad7552ea8d
fix(api/core/workflow/nodes/llm/llm_node.py): Fix LLM Node error. (#6576) 2024-07-23 17:09:16 +08:00
非法操作 c0ada940bd
fix: tool params not work as expected when develop a tool (#6550) 2024-07-23 17:00:39 +08:00
takatost 1690788827
fix: name 'current_app' is not defined in recommended_app_service (#6574) 2024-07-23 16:48:21 +08:00
Lance Mao 7c55c39085
feat: add tencent asr (#6091) 2024-07-23 16:38:39 +08:00
非法操作 f17d4fe412
fix: extract only `like` feedback to caculate User Satisfaction (#6553) 2024-07-23 16:32:36 +08:00
-LAN- f019bc4bd7
feat(variables): Support `to_object`. (#6572) 2024-07-23 16:22:06 +08:00
-LAN- cfc408095c
fix(api/nodes): Fallback to `get_any` in some nodes that use object or array. (#6566) 2024-07-23 15:51:07 +08:00
takatost 6b5fac3004
fix: fetch context error in llm node (#6562) 2024-07-23 15:04:51 +08:00
崔亮 0569c547ee
fix the issue of MILVUS_DATABASE has no effect. (#6424) 2024-07-23 15:03:55 +08:00
tmuife 06fc1bce9e
Add search by full text when using Oracle23ai as vector DB (#6559) 2024-07-23 15:03:21 +08:00
Sangmin Ahn 093b8ca475
fix: escape double quotation marks in the vector DB search query (#6506) 2024-07-23 15:02:25 +08:00
Ryan Tian 5fcc2caeed
feat: add Mingdao HAP tool, implemented read and maintain HAP application worksheet data. (#6257)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-23 14:34:19 +08:00
dependabot[bot] 642723d09e
chore(deps): bump sentry-sdk from 1.39.2 to 2.8.0 in /api (#6517)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-23 13:48:23 +08:00
-LAN- cd7fa8027a
fix(api/core/model_manager.py): Avoid mutation during iteration. (#6536) 2024-07-22 22:58:22 +08:00
-LAN- 617847e3c0
fix(api/services/app_generate_service.py): Remove wrong type hints. (#6535) 2024-07-22 22:58:07 +08:00
-LAN- 5e6fc58db3
Feat/environment variables in workflow (#6515)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-22 15:29:39 +08:00
Benjamin a67831773f
refactor: handle missing position file gracefully (#6513) 2024-07-22 13:24:32 +08:00
sino dfb6f4fec6
fix: extract tool calls correctly while arguments is empty (#6503) 2024-07-22 07:43:18 +08:00
Jyong f38034e455
clean vector collection redis cache (#6494) 2024-07-21 15:09:09 +08:00
Shoya SHIRAKI c57b3931d5
refactor(api): switch to dify_config in controllers/console (#6485) 2024-07-21 01:11:40 +08:00
Jyong f73a3a58ae
update delete embeddings by id (#6489) 2024-07-20 09:04:21 +08:00
Jyong 1e0e573165
update clean embedding cache query logic (#6483) 2024-07-20 01:29:25 +08:00
Joe 27e08a8e2e
Fix/extra table tracing app config (#6487) 2024-07-20 00:53:31 +08:00
Matri 49ef9ef225
feat(tool): getimg.ai integration (#6260) 2024-07-19 20:32:42 +08:00
Even c013086e64
fix: next suggest question logic problem (#6451)
Co-authored-by: evenyan <yikun.yan@ubtrobot.com>
2024-07-19 20:26:11 +08:00
sino 4f9f175f25
fix: correct gpt-4o-mini max token (#6472)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-19 18:24:58 +08:00
Jyong 57729823a0
fix wrong method using (#6459) 2024-07-19 13:48:13 +08:00
sino 9e168f9d1c
feat: support gpt-4o-mini for openrouter provider (#6447) 2024-07-19 13:09:41 +08:00
Weaxs ea45496a74
update ernie models (#6454) 2024-07-19 13:08:39 +08:00
Waffle 2ba05b041f
refactor(myscale):Set the default value of the myscale vector db in DifyConfig. (#6441) 2024-07-19 10:57:45 +08:00
Richards Tu 8e49146a35
[EMERGENCY] Fix Anthropic header issue (#6445) 2024-07-19 07:38:15 +08:00
takatost dad3fd2dc1
feat: add gpt-4o-mini (#6442) 2024-07-19 01:53:43 +08:00
Jyong e493ce9981
update clean embedding cache logic (#6434) 2024-07-18 20:25:28 +08:00
Weishan-0 7b45a5d452
fix: Unable to display images generated by Dall-E 3 (#6155) 2024-07-18 19:37:04 +08:00
ybalbert001 4a026fa352
Enhancement: add model provider - Amazon Sagemaker (#6255)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-18 19:32:31 +08:00
leoterry dc847ba145
Fix the vector retrieval sorting issue (#6431)
Co-authored-by: weifj <“weifj@tuyuansu.com.cn”>
2024-07-18 19:25:41 +08:00
-LAN- c0ec40e483
fix(api/core/tools/provider/builtin/spider/tools/scraper_crawler.yaml): Fix wrong placeholder config in scraper crawler tool. (#6432) 2024-07-18 19:23:18 +08:00
themanforfree ba181197c2
feat: api_key support for xinference (#6417)
Signed-off-by: themanforfree <themanforfree@gmail.com>
2024-07-18 18:58:46 +08:00
Songyawn 218930c897
fix tool icon get failed (#6375)
Co-authored-by: songyawen <songyawen@zkme.xyz>
2024-07-18 18:55:48 +08:00
Poorandy c8f5dfcf17
refactor(rag): switch to dify_config. (#6410)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-18 18:40:36 +08:00
非法操作 afe95fa780
feat: support get workflow task execution status (#6411) 2024-07-18 15:06:14 +08:00
William Espegren 588615b20e
feat: Spider web scraper & crawler tool (#5725) 2024-07-18 14:29:33 +08:00
listeng d5dca46854
feat: add a Tianditu tool (#6320)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-18 13:04:03 +08:00
Xiao Ley 23e5eeec00
feat: added custom secure_ascii to the json_process tool (#6401) 2024-07-18 08:43:14 +08:00
Masashi Tomooka 5236cb1888
fix: kill signal is not passed to the main process (#6159) 2024-07-18 07:50:54 +08:00
forrestlinfeng 3b5b548af3
Add Stepfun LLM Support (#6346) 2024-07-18 07:47:18 +08:00
Richards Tu 4782fb50c4
Support new Claude-3.5 Sonnet max token limit (#6335) 2024-07-18 07:47:06 +08:00
Jyong f55876bcc5
fix web import url is too long (#6402) 2024-07-18 01:14:36 +08:00
Poorandy 8a80af39c9
refactor(models&tools): switch to dify_config in models and tools. (#6394)
Co-authored-by: Poorandy <andymonicamua1@gmail.com>
2024-07-17 22:26:18 +08:00
Jyong 443e96777b
update empty document caused delete exist collection (#6392) 2024-07-17 20:38:32 +08:00
xielong f3f052ba36
fix: rename model from ernie-4.0-8k-Latest to ernie-4.0-8k-latest (#6383) 2024-07-17 19:07:47 +08:00
Jyong 1bc90b992b
Feat/optimize clean dataset logic (#6384) 2024-07-17 17:36:11 +08:00
-LAN- fc37887a21
refactor(api/core/workflow/nodes/http_request): Remove `mask_authorization_header` because its alwary true. (#6379) 2024-07-17 16:52:14 +08:00
Lion 4ed1476531
fix: incorrect config key name (#6371)
Co-authored-by: LionYuYu <lyu@theknotww.com>
2024-07-17 15:52:51 +08:00
FamousMai 20f73cb756
fix: default model set wrong(#6327) (#6332)
Co-authored-by: maiyouming <maiyouming@yafex.cn>
2024-07-17 14:14:12 +08:00
Weaxs 4e2fba404d
WebscraperTool bypass cloudflare site by cloudscraper (#6337) 2024-07-17 14:13:57 +08:00
Bowen Liang 7943f7f697
chore: fix legacy API usages of Query.get() by Session.get() in SqlAlchemy 2 (#6340) 2024-07-17 13:54:35 +08:00
Jyong 7c397f5722
update celery beat scheduler time to env (#6352) 2024-07-17 02:31:30 +08:00
Charlie.Wei 06fcc0c650
Fix tts api err (#6349)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-16 21:53:57 +08:00
Jyong 0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2024-07-16 19:09:04 +08:00
longzhihun ed9e692263
feat: bedrock model runtime enhancement (#6299) 2024-07-16 15:54:39 +08:00
svcvit cc0c826f36
Add tool: Google Translate (#6156) 2024-07-16 15:28:33 +08:00
Jyong 988aa4b5da
update clean_unused_datasets_task timedelta (#6324) 2024-07-16 13:43:04 +08:00
Bowen Liang c5d06e7943
dep: bump Pydantic from 2.7 to 2.8 (#6273) 2024-07-16 13:40:58 +08:00
呆萌闷油瓶 d66d7146a3
chore:update azure GA version 2024-06-01 (#6307) 2024-07-16 10:32:18 +08:00
takatost eabfd84ceb
bump to 0.6.14 (#6294) 2024-07-15 21:01:09 +08:00
Jyong d320d1468d
Feat/delete file when clean document (#5882) 2024-07-15 19:57:05 +08:00
Onelevenvy b47fa27a35
fix: zhipuai validate error when user's api key not support for chatglm_turbo in issue #6289 (#6290) 2024-07-15 19:27:18 +08:00
thibautleaux-kreactive 96c171805a
Update bedrock.yaml (#6281) 2024-07-15 16:53:03 +08:00
takatost 46a5294d94
feat(backend): support import DSL from URL (#6287) 2024-07-15 16:23:40 +08:00
Benjamin ec181649ae
Update model provider configuration for Triton Inference Server and X… (#6274) 2024-07-15 15:07:28 +08:00
guogeer 4fdcb30ff8
fix: custom tool input number fail (#6200)
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
2024-07-14 22:11:13 +08:00
Waffle 07add06c59
Feat/add zhipu CogView 3 tool (#6210) 2024-07-13 17:39:17 +08:00
tangyoha 0cbbaf3f68
fix: markdown proc will remove image (#5855) 2024-07-12 20:07:22 +08:00
Little 羊 7c2c949f01
Update ernie_bot.py (#6236) 2024-07-12 19:54:53 +08:00
天魂 1df71ec64d
refactor(api): switch to dify_config with Pydantic in controllers and schedule (#6237) 2024-07-12 16:51:43 +08:00
Matri a9ee52f2d7
Fix/firecrawl parameters issue (#6213) 2024-07-12 12:59:50 +08:00
Waffle 7b225a5ab0
refactor(services/tasks): Swtich to dify_config witch Pydantic (#6203) 2024-07-12 12:25:38 +08:00
耐小心 d7a6f25c63
fix: differentiate prompts fields based on function_calling_type (#5880) 2024-07-12 11:07:38 +08:00
crazywoola ee3936916f
upgrade deepseek params (#6215) 2024-07-12 10:55:44 +08:00
dufei 109de52fe2
Fix: When editing an Agent, selecting custom tools does not allow filtering by labels. (#6197)
Co-authored-by: dufei <du_fei@venusgroup.com.cn>
2024-07-12 09:02:25 +08:00
Little 羊 2f064c68bc
Create ernie-4.0-turbo-8k-preview (#6132) 2024-07-11 20:20:07 +08:00
JasonVV 0e82072323
Fix if_else node compatibility with historical workflows. (#6186) 2024-07-11 17:13:16 +08:00
Jyong 678ad6b7eb
Fix/file stream azure blob (#6196) 2024-07-11 17:01:03 +08:00
Zhuo Qiu 63e34e5227
feat: support MyScale vector database (#6092) 2024-07-11 15:21:59 +08:00
非法操作 5660878f7b
chore: update the tool's doc (#6167) 2024-07-11 11:02:58 +08:00
liuzhenghua 9622fbb62f
feat: app rate limit (#5844)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-10 21:31:35 +08:00
crazywoola cc8dc6d35e
Revert "chore: update the tool's doc" (#6153) 2024-07-10 19:57:12 +08:00
Su Yang 215661ef91
feat: add PerfXCloud, Qwen series #6116 (#6117) 2024-07-10 18:26:10 +08:00
Joe 5a3e09518c
feat: add if elif (#6094) 2024-07-10 18:22:51 +08:00
非法操作 1d2ab2126c
chore: update the tool's doc (#6122) 2024-07-10 12:42:34 +08:00
Bowen Liang f9d00e0498
chore: use poetry for linter tools installation and bump Ruff from 0.4 to 0.5 (#6081) 2024-07-09 23:06:23 +08:00
sino d27e3ab99d
chore: remove unresolved reference (#6110) 2024-07-09 23:04:44 +08:00
Joe ce930f19b9
fix dataset operator (#6064)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-09 17:47:54 +08:00
8bitpd 7c70eb87bc
feat: support AnalyticDB vector store (#5586)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-07-09 13:32:04 +08:00
chenxu9741 6ef401a9f0
feat:add tts-streaming config and future (#5492) 2024-07-09 11:33:58 +08:00
takatost 17f22347ae
bump to 0.6.13 (#6078) 2024-07-08 23:23:07 +08:00
takatost 68b1d063f7
chore: remove tsne unused code (#6077) 2024-07-08 21:25:19 +08:00
Xiao Ley 6610b4cee5
feat: add request_params field to jina_reader tool (#5610) 2024-07-08 18:11:50 +08:00
Jyong cbbe28f40d
fix azure stream download (#6063) 2024-07-08 17:13:16 +08:00
75py 610da4f662
Fix authorization header validation to handle bearer types correctly - "authorization config header is required" error (#6040) 2024-07-08 00:09:59 +08:00
crazywoola 3ec80f9dda
Fix/6034 get random order of categories in explore and workflow is missing in zh hant (#6043) 2024-07-07 17:06:47 +08:00
Mab 91c5818236
Modify slack webhook url validation to allow workflow (#6041) (#6042)
Co-authored-by: Shunsuke Mabuchi <mabuchs@amazon.co.jp>
2024-07-07 14:09:20 +08:00
-LAN- c436454cd4
fix(configs): Update pydantic settings in config files (#6023) 2024-07-07 12:18:15 +08:00
Yeuoly a877d4831d
Fix/incorrect parameter extractor memory (#6038) 2024-07-07 12:17:34 +08:00
takatost d522308a29
chore: optimize memory fetch performance (#6039) 2024-07-07 08:54:24 +08:00
sino 85744b72e5
feat: support moonshot and glm base models for volcengine provider (#6029) 2024-07-07 01:17:33 +08:00
Cherilyn Buren f0b7051e1a
Optimize db config (#6011) 2024-07-07 01:06:51 +08:00
Masashi Tomooka 3b23d6764f
fix: token count includes base64 string of input images (#5868) 2024-07-06 16:53:32 +08:00
Bowen Liang 9b7c74a5d9
chore: skip pip upgrade preparation in api dockerfile (#5999) 2024-07-06 14:17:34 +08:00
-LAN- 4d105d7bd7
feat(*): Swtich to dify_config. (#6025) 2024-07-06 12:05:13 +08:00
非法操作 eee779a923
fix: the input field of tool panel not worked as expected (#6003) 2024-07-06 09:54:30 +08:00
ahasasjeb ab847c81fa
Add 2 firecrawl tools : Scrape and Search (#6016)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-06 09:45:39 +08:00
-LAN- b217ee414f
test(test_rerank): Remove duplicate test cases. (#6024) 2024-07-06 09:44:50 +08:00
takatost 23dc6edb99
chore: optimize memory messages fetch count limit (#6021) 2024-07-06 03:25:38 +08:00
takatost 79df8825c8
Revert "feat: knowledge admin role" (#6018) 2024-07-05 21:31:34 +08:00
K8sCat 71c50b7e20
feat: add Llama 3 and Mixtral model options to ddgo_ai.yaml (#5979)
Signed-off-by: K8sCat <k8scat@gmail.com>
2024-07-05 21:11:15 +08:00
opriuwohg af98fd29bf
fix: add status_code 304 (#6000)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-05 21:10:33 +08:00
crazywoola cddea83e65
6014 i18n add support for spanish (#6017) 2024-07-05 21:05:33 +08:00
Joe 3f0da88ff7
fix: update workflow trace query (#6010) 2024-07-05 18:37:26 +08:00
ahasasjeb cc63af8e72
Removed firecrawl-py, fixed and improved firecrawl tool (#5896)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-05 18:04:51 +08:00
非法操作 bf2268b0af
fix API tool's schema not support array (#6006) 2024-07-05 17:11:59 +08:00
xielong 00b4cc3cd4
feat: implement forgot password feature (#5534) 2024-07-05 13:38:51 +08:00
Aurelius Huang f546db5437
fix: document truncation and loss in notion document sync (#5631)
Co-authored-by: Aurelius Huang <cm.huang@aftership.com>
2024-07-05 11:48:17 +08:00
orangeclk f8aaa57f31
feat: add retry mechanism for zhipuai (#5926) 2024-07-05 10:49:18 +08:00
jianglin1008 cabcf94be3
fix: TENCENT_VECTOR_DB_REPLICAS can be set to 0 (#5968)
Co-authored-by: jianglin <jianglin@wangxiaobao.com>
2024-07-05 08:32:28 +08:00
legao 2d6624cf9e
typo: Update README.md (#5987) 2024-07-04 22:50:27 +08:00
-LAN- 02982df0d4
fix: Fix some type error in http executor. (#5915) 2024-07-04 19:34:37 +08:00
-LAN- d7f75d17cc
Chore/remove-unused-code (#5917) 2024-07-04 18:18:26 +08:00
Joe 5d9ad430af
feat: knowledge admin role (#5965)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2024-07-04 16:21:40 +08:00
Joe 688b8fe114
fix: langfuse logical operator error (#5948) 2024-07-04 13:47:15 +08:00
longzhihun aecdfa2d5c
feat: add claude3 function calling (#5889) 2024-07-03 22:21:02 +08:00
-LAN- cb8feb732f
refactor: Create a `dify_config` with Pydantic. (#5938) 2024-07-03 21:09:23 +08:00
orangeclk c490bdfbf9
fix: zhipuai pytest correction (#5934) 2024-07-03 19:19:33 +08:00
-LAN- e7494d632c
docs(api/core/tools/docs/en_US/tool_scale_out.md): Format by markdownlint. (#5903) 2024-07-03 13:13:38 +08:00
takatost e3006f98c9
chore: remove dify SaaS URL in default configs (#5888) 2024-07-02 22:49:18 +08:00
quicksand 372dc7ac1a
fix bug : TencentVectorDBConfig Add TENCENT_VECTOR_DB_DATABASE (#5879) 2024-07-02 21:31:14 +08:00
-LAN- 66a62e6c13
refactor(api/core/app/apps/base_app_generator.py): improve input validation and sanitization in BaseAppGenerator (#5866) 2024-07-02 18:58:07 +08:00
Jyong 0944ca9d91
Fix/remove tsne position test (#5858)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-07-02 17:57:42 +08:00
Masashi Tomooka 6e256507d3
doc: docker-compose won't start due to wrong README (#5859) 2024-07-02 16:10:22 +08:00
Joe 59ad091e69
feat: add export permission (#5841) 2024-07-02 13:37:37 +08:00
Joe 598e030a7e
feat: update LangfuseConfig host config (#5846) 2024-07-02 13:14:07 +08:00
-LAN- 32d85fb896
chore: Update some type hints in config. (#5833) 2024-07-02 08:50:02 +08:00
Jyong af308b99a3
sync delete app table record when delete app (#5819) 2024-07-02 08:48:29 +08:00
quicksand 2a27568537
Enhance: tools wecom bot support markdown message (#5791) 2024-07-01 18:19:47 +08:00
hymvp 1d3e96ffa6
add support oracle oci object storage (#5616) 2024-07-01 17:21:44 +08:00
Joe b7b1396c51
fix: ops trace slow db (#5812) 2024-07-01 17:09:53 +08:00
Jyong 71bcf75d9a
Feat/add delete knowledge confirm (#5810) 2024-07-01 17:06:51 +08:00
Charles Zhou 850c2273ee
feat: Nominatim OpenStreetMap search tool (#5789) 2024-07-01 16:34:32 +08:00
Charles Zhou cb09dbef66
feat: correctly delete applications using Celery workers (#5787) 2024-07-01 14:21:17 +08:00
longzhihun fdfbbde10d
[seanguo] modify bedrock Claude3 invoke method to converse API (#5768)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-07-01 04:36:13 +08:00
Joe f637ae4794
fix: langsmith message_trace end_user_data session_id error (#5759) 2024-06-30 01:12:16 +08:00
Joe ffb07eb24b
fix: workflow trace none type error (#5758) 2024-06-29 23:32:52 +08:00
Yeuoly f101fcd0e7
fix: missing process data in parameter extractor (#5755) 2024-06-29 23:29:43 +08:00
takatost 1e045a0187
fix: slow sql of ops tracing (#5749) 2024-06-29 20:28:30 +08:00
takatost 8fd75e6965
bump to 0.6.12-fix1 (#5743) 2024-06-29 17:43:20 +08:00
takatost d56cedfc67
fix: app config does not use empty string in the env (#5741) 2024-06-29 17:15:25 +08:00
takatost 906857b28a
fix: couldn't log in or resetup after a failed setup (#5739) 2024-06-29 17:07:21 +08:00
takatost 6d0cea5fe6
bump to 0.6.12 (#5712) 2024-06-28 22:00:19 +08:00
takatost 0bf4817474
fix: _convert_prompt_message_to_dict parameters err (#5716) 2024-06-28 21:00:00 +08:00
takatost 8e5569f773
fix: fix-app-site-missing command (#5714) 2024-06-28 20:33:53 +08:00
takatost d30c13891b
feat: add fix-app-site-missing command (#5711) 2024-06-28 20:20:23 +08:00
takatost 017d2c804b
fix: do not remove (#5706) 2024-06-28 19:33:42 +08:00
呆萌闷油瓶 68ac433218
feat: add support Spark4.0 (#5688) 2024-06-28 17:39:11 +08:00
Joe dd5f3873da
feat: change TRACE_QUEUE_MANAGER_INTERVAL default value (#5698)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-28 17:34:58 +08:00
scotlandowl 73ce945d40
Feat/add json process tool (#5555) 2024-06-28 11:57:32 +08:00
luckylhb90 d37ee498cd
fix: do not remove (#5682)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-06-28 11:19:34 +08:00
Kevin b3d6726f65
Feature/add qwen llm (#5659) 2024-06-28 11:06:29 +08:00
William Espegren f9e4b4e74c
Fix docker command (#5681) 2024-06-28 01:23:01 +08:00
liuzhenghua 2b080b5cfc
feature: Add presence_penalty and frequency_penalty parameters to the … (#5637)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-06-28 00:27:20 +08:00
Joe e8b8f6c6dd
Feat/fix ops trace (#5672)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-28 00:24:37 +08:00
Bowen Liang 2a13ef9ae0
chore: rearrange python dependencies in groups (#5603) 2024-06-27 17:52:54 +08:00
takatost 3ccad33194
feat: add jina new pre-defined rerankers, include: jina-reranker-v2 (#5657) 2024-06-27 13:45:35 +08:00
sunxichen bafc8a0bde
fix: tool call message role according to credentials (#5625)
Co-authored-by: sunxichen <sun.xc@digitalcnzz.com>
2024-06-27 12:35:27 +08:00
非法操作 92c56fdf2b
fix: HTTP request header is overwritten when user set Content-Type (#5628) 2024-06-27 12:31:37 +08:00
Bowen Liang dcb72e0067
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-27 11:21:31 +08:00
luckylhb90 2e718b85e9
fix(api): language list (#5649)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-06-27 08:46:53 +08:00
-LAN- 17d2f0bb0d
fix(api/configs): Ignore empty environment variables when loading config. (#5647) 2024-06-26 21:39:19 +08:00
takatost 0dfdb61ee9
fix: type error in config (#5643) 2024-06-26 21:01:16 +08:00
非法操作 e1a72e0e2b
fix: ro-RO is not a valid language (#5635) 2024-06-26 18:56:31 +08:00
Diego Romero-Lovo 4c0a31d38b
FR: #4048 - Add color customization to the chatbot (#4885)
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-26 17:51:00 +08:00
Joe 4e2de638af
feat: add ops trace (#5483)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-26 17:33:29 +08:00
Bowen Liang 31a061ebaa
chore: cleanup test_delete_by_document_id method in opensearch vdb test (#5619) 2024-06-26 17:21:36 +08:00
-LAN- f7234c93af
chore(pyproject.toml): Add Ruff formatter config. (#5627) 2024-06-26 16:30:28 +08:00
Bowen Liang d0fe56a98e
fix: populate app configs to system environment variables (#5590) 2024-06-26 14:27:49 +08:00
非法操作 b8926ea267
fix: DuckDuckGo image search tool error (#5606) 2024-06-26 13:21:40 +08:00
Jyong 43335b5c87
delete the deprecated method (#5612) 2024-06-26 12:51:50 +08:00
Pan, Wen-Ming 964f0e1400
fix: Modify the incorrect configuration name for Google storage (#5595)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-26 07:54:22 +08:00
Bowen Liang 87ee3e627f
chore: fix typo in config descriptions (#5585) 2024-06-25 21:19:56 +08:00
-LAN- 45a3ea6fed
fix: add support for FILE type in ToolParameterConverter (#5578) 2024-06-25 18:47:59 +08:00
Bowen Liang 2a0f03a511
refactor: extract cors configs into dify config and cleanup the config class (#5507)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-25 15:48:02 +08:00
takatost ec1d3ddee2
feat: support importing and overwriting workflow DSL (#5511)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-06-25 15:46:12 +08:00
keita69 cdc2a6f637
The firecrawl tool now supports self-hosting (#5528)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-25 15:15:21 +08:00
Yeuoly 023dba9475
fix: revert CI path filters (#5561) 2024-06-24 23:46:15 +08:00
sino 877a2c144b
feat: support predefined models for openrouter (#5494) 2024-06-24 16:31:53 +08:00
非法操作 f7900f298f
chore: refactor the http executor node (#5212) 2024-06-24 16:14:59 +08:00
非法操作 1e28a8c033
chore: add create_json_message api for tools (#5440) 2024-06-24 15:46:16 +08:00
-LAN- ba67206bb9
fix(api/model_runtime/azure/llm): Switch to tool_call. (#5541) 2024-06-24 15:35:21 +08:00
Xiaoguang Sun 13fcd7a901
feat: Add program_name attribute to TiDB connection (#5499)
Signed-off-by: Xiaoguang Sun <sunxiaoguang@gmail.com>
2024-06-24 14:41:07 +08:00
Jyong 756d9a4bc2
add opensearch default value (#5536) 2024-06-24 14:33:31 +08:00
takatost 4a031de0d9
feat: make Citations and Attributions display enable default (#5508)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-06-24 13:03:49 +08:00
crazywoola 47a5d4527b
feat: use root dir to start python and celery (#5515) 2024-06-24 09:53:26 +08:00
Xiao Ley dcec9d7bb7
feat: add new features to enhance image and link handling in Jina tool (#5517) 2024-06-24 01:06:26 +08:00
kurokobo ea29007bc0
fix: apply best practices for the latest buildkit (#5527) 2024-06-24 00:45:33 +08:00
Xiao Ley 3a626cd251
fix: added error handling for novita ai tool query (#5506)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-23 17:59:03 +08:00
Nam Vu e9ce0b10de
feat: add Asia/Ho_Chi_Minh timezone (#5521) 2024-06-23 16:47:44 +08:00
kurokobo c5d64baba4
fix: correct typos (#5510) 2024-06-22 23:01:02 +08:00
Bowen Liang 29ca6815ae
chore: use singular style in middleware config class name (#5502) 2024-06-22 18:26:38 +08:00
Bowen Liang 5217f7cf69
refactor: extract hosted service configs into dify config (#5504) 2024-06-22 17:41:17 +08:00
非法操作 57063095c1
fix: summary of duckduckgo_search (#5488) 2024-06-22 13:58:30 +08:00
vccler 48757e581e
fix: zhipu tool calling, this PR fixes the bug described in issue #5496 (#5469)
Co-authored-by: vccler <vccler@163.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-22 12:41:24 +08:00
LXM e8ad0339a3
fix: tongyi json output (#5396) 2024-06-22 12:25:23 +08:00
Bowen Liang f67b164b0d
refactor: extract db configs and celery configs into dify config (#5491) 2024-06-22 10:29:56 +08:00
Bowen Liang b05cc3a1e4
refactor: extract storage provider configs into dify configs (#5443) 2024-06-22 10:07:03 +08:00
Bowen Liang 8890978ad3
chore: use singular style in config class name (#5489) 2024-06-22 09:54:25 +08:00
takatost 9a5c423d59
chore: remove pip support for api service (#5453)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
2024-06-22 02:05:50 +08:00
tmuife 6a09409ec9
Add Oracle23ai as a vector datasource (#5342)
Co-authored-by: walter from vm <walter.jin@oracle.com>
2024-06-22 01:48:07 +08:00
Bowen Liang 27f0ae8416
build: support Poetry for depencencies tool in api's Dockerfile (#5105)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-22 01:34:08 +08:00
crazywoola 91d38a535f
fix: max_tokens of qwen-plus & qwen-plus-chat (#5480) 2024-06-21 16:49:33 +08:00
Pan, Wen-Ming 95c882934e
feat: add support for Vertex AI claude-3-5-sonnet@20240620 (#5475)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-21 16:45:56 +08:00
crazywoola 92ddb410cd
feat: option to hide workflow steps (#5436) 2024-06-21 12:51:10 +08:00
-LAN- 1336b844fd
feat(api/auth): switch-to-stateful-authentication (#5438) 2024-06-21 12:39:07 +08:00
Su Yang 26b6fd2236
feat: add support for bedrock claude-3-5-sonnet-20240620 (#5461) 2024-06-21 10:21:35 +08:00
takatost ff0f02d809
feat: add support for claude-3-5-sonnet-20240620 (#5452) 2024-06-21 00:23:15 +08:00
Bowen Liang 65d34ebb96
refactor: extract vdb configs into pydantic-setting based dify configs (#5426) 2024-06-20 16:24:10 +08:00
-LAN- 142dc0afd7
refactor: Remove unused code in large_language_model.py (#5433) 2024-06-20 16:20:40 +08:00
Bowen Liang 39c14ec7c1
improve: unify Excel files parsing in either xls or xlsx file format by Pandas (#4965) 2024-06-20 16:14:49 +08:00
-LAN- 23fa3dedc4
fix(core): Fix incorrect type hints. (#5427) 2024-06-20 15:16:21 +08:00
takatost a51ec2094f
fix: sentry config float type err (#5416) 2024-06-20 11:28:52 +08:00
Bowen Liang aed56b1a8f
fix: Revert "feat: initial support for Milvus 2.4.x (#3795)" downgrading to 2.3.x for Linux arm64 installation failure (#5414) 2024-06-20 11:18:05 +08:00
takatost a88aa20824
fix: optional parameter missing default value None in http request node (#5413) 2024-06-20 11:07:01 +08:00
quicksand 0105129fa8
fix bug: tencent vdb #5378 (#5408) 2024-06-20 10:37:39 +08:00
Bowen Liang c923684edd
chore: extract retrival method literal values into enum (#5060) 2024-06-19 16:05:27 +08:00
liuzhenghua 9d5a89eab6
feat: add log date timezone (#4623)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-19 15:51:00 +08:00
-LAN- bdf3ea4369
docs(api/README): Remove unnecessary `=` (#5380) 2024-06-19 15:17:13 +08:00
Bowen Liang bb33ffc332
feat: initial support for Milvus 2.4.x (#3795) 2024-06-19 13:55:44 +08:00
Bowen Liang 3cc6093e4b
feat: introduce pydantic-settings for config definition and validation (#5202)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-19 13:41:12 +08:00
baojingyu d160d1ed02
feat: support opensearch approximate k-NN (#5322) 2024-06-19 12:44:33 +08:00
fishisnow e785cbb81d
Fix: multi image preview sign (#5376)
Co-authored-by: huangyusong <huangyusong@yingzi.com>
2024-06-19 12:36:40 +08:00
kurokobo 0e3113b7ce
feat: allow non-english wikipedias to be searched (#5371) 2024-06-19 10:06:47 +08:00
开坦克的贝塔 7d5ebbb611
docs(readme): Optimize the content in the readme file (#5364)
Co-authored-by: 开坦克的贝塔 <k@aircode.io>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 18:33:22 +08:00
horochx 85eee0dfbb
Update README.md (#5359) 2024-06-18 18:21:45 +08:00
Xiao Ley 369a395ee9
fix: resolve issue with cot_agent_runner not analyzing user-uploaded images correctly (#5360)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 18:15:41 +08:00
-LAN- 4e3d76a1d1
chore: add `novita_client` to `pyproject.toml` (#5349) 2024-06-18 14:52:20 +08:00
Bowen Liang 7450b9acf3
dep: bump chromadb from 0.5.0 to 0.5.1 (#5345) 2024-06-18 14:05:14 +08:00
Bowen Liang c7d378555a
chore: set build system to Poetry and remove unnecessary settings with package mode disabled (#5263) 2024-06-18 13:27:03 +08:00
Bowen Liang 5f0ce5811a
feat: add `flask upgrade-db` command for running db upgrade with redis lock (#5333) 2024-06-18 13:26:01 +08:00
rerorero 9b7fdadce4
fix: wrong token usage in iteration node for streaming result (#5336) 2024-06-18 13:08:40 +08:00
Xiao Ley 132f5fb3de
feat: add Novita AI image generation tool, implemented model search, text-to-image and create tile functionalities (#5308)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 11:08:25 +08:00
Ikko Eltociear Ashimine 8266842809
chore: update llm.py (#5335) 2024-06-18 09:29:14 +08:00
sino d7213b12cc
fix: extract params by function calling for models supporting tool call (#5334) 2024-06-17 23:25:29 +08:00
Richards Tu c163521b9e
Update and fix the model param of Deepseek (#5329) 2024-06-17 21:40:04 +08:00
Mitsuki Ogasahara 7305713b97
fix: allow special characters in email (#5327)
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-17 21:32:59 +08:00
sino edffa5666d
fix: got unknown type of prompt message in multi-round ReAct agent chat (#5245) 2024-06-17 21:20:17 +08:00
-LAN- 54756cd3b2
chore(core/workflow/utils/variable_template_parser): Refactor VariableTemplateParser class for better readability and maintainability. (#5328) 2024-06-17 21:18:56 +08:00
-LAN- b73ec87afc
fix(core/workflow): Handle special values in node run result outputs (#5321) 2024-06-17 20:41:57 +08:00
Justin Wu 61f4f08744
Add bedrock command r models (#4521)
Co-authored-by: Justin Wu <justin.wu@ringcentral.com>
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-06-17 20:37:46 +08:00
Jyong 07387e9586
add the filename length limit (#5326) 2024-06-17 20:36:54 +08:00
quicksand 147a39b984
feat: support tencent cos storage (#5297) 2024-06-17 19:18:52 +08:00
Bowen Liang 7a758a35fe
fix: pin tenacity to 8.3.0 (#5319) 2024-06-17 18:03:42 +08:00
sino be3512aa57
fix: unable to reindex documents (#5276) 2024-06-17 17:19:43 +08:00
Charles Zhou cc4a4ec796
feat: permission and security fixes (#5266) 2024-06-17 16:06:32 +08:00
非法操作 24282236f0
fix: not checked require_summary of duckduckgo search raise error (#5303) 2024-06-17 14:18:49 +08:00
-LAN- 5a99aeb864
fix(core): Reorder `field_validator` and `classmethod` to fit Pydantic V2. (#5257) 2024-06-17 10:04:28 +08:00
Charlie.Wei e95f8fa3dc
Dalle3 add seed (#5288)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-17 09:27:27 +08:00
crazywoola 9a64aa76c1
fix: typo and check (#5287) 2024-06-17 09:15:43 +08:00
kurokobo 42029791e4
fix: add event handler to delete the site when the related app deleted (#5282) 2024-06-17 08:47:26 +08:00
Bowen Liang d94279ae75
fix: casting non-string type value for tool parameter options (#5267) 2024-06-16 09:47:20 +08:00
rerorero 3a423e8ce7
fix: visioin model always with low quality (#5253) 2024-06-16 09:46:17 +08:00
Pan, Wen-Ming 4b54843ed7
fix: run agent with Vertex AI Gemini models (#5260)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-16 09:36:31 +08:00
kurokobo 2e842333b1
fix: correct typos in the icons for microsoft (#5243) 2024-06-15 21:02:47 +08:00
Yash Parmar 6ccde0452a
feat: Added hindi translation i18n (#5240) 2024-06-15 21:01:03 +08:00
Serply 795714bc2f
feat(Tools): Add Serply Web/Job/Scholar/News Search tool for more options (#5186)
Co-authored-by: teampen <136991215+teampen@users.noreply.github.com>
2024-06-15 20:09:33 +08:00
Masashi Tomooka d9bee03ff6
fix: embedding job fails using IAM role (#5252) 2024-06-15 18:57:54 +08:00
sino 4f0488abb5
fix: wrong order of history prompts in ReAct agent mode (#5236) 2024-06-15 10:53:30 +08:00
takatost 12c815c597
fix: ExtractSetting optional value missing None as default val (#5238) 2024-06-15 02:58:47 +08:00
takatost d098bdc59b
version to 0.6.11 (#5224) 2024-06-15 02:46:24 +08:00
Jyong ba5f8afaa8
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-15 02:46:02 +08:00
takatost 8da035aac6
Update README.md (#5228) 2024-06-14 22:31:01 +08:00
kurokobo ef6034abfd
fix: allow the name and icon of the web app to be set independently of that of the bot itself (#5225) 2024-06-14 22:16:11 +08:00
kurokobo 0391282b5e
fix: initialize site with customized icon and icon_background (#5227) 2024-06-14 22:15:50 +08:00
走在修行的大街上 8d1386df0f
feat(Tools): Add Feishu multi-dimensional table operation function (#5213)
Co-authored-by: 黎斌 <libin.23@bytedance.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-14 21:19:20 +08:00
DomKing 43c19007e0
fix: workspace member's last_active should be last_active_time, but not last_login_time (#4906) 2024-06-14 20:49:19 +08:00
rerorero c6b791d070
fix: number variable cause type error in openai moderation (#5222) 2024-06-14 20:43:03 +08:00
Charles Zhou 8bcc5a36bb
feat: new editor user permission profile (#4435)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-14 20:34:25 +08:00
th3n00b13 cdb6c801c1
Fix: http_request delete method not working (#4975) 2024-06-14 20:07:22 +08:00
quicksand 4080f7b8ad
feat: support tencent vector db (#3568) 2024-06-14 19:25:17 +08:00
Jaxon Ley 337bad8525
feat: Add Optional API Key, Proxy Server, and Bypass Cache Parameters to Jina Tools (#5197) 2024-06-14 19:09:25 +08:00
Bin 0f35d07052
support ERNIE-4.0-8K-Latest (#5216) 2024-06-14 18:45:24 +08:00
-LAN- 7f44e88eda
fix(model_providers/ollama): Fix OllamaLargeLanguageModel to correctly set the stop option (#5217) 2024-06-14 18:26:14 +08:00
Jason b7ff765d8d
Add novita.ai as model provider (#4961) 2024-06-14 18:23:06 +08:00
Jyong d7fbae286a
add aws s3 iam check (#5174) 2024-06-14 15:19:59 +08:00
Masashi Tomooka 0633aae7dc
feat: allow to use IAM Role for Bedrock (#5188) 2024-06-14 15:18:42 +08:00
doufa f87f11e92c
chore: make the Celery command more noticeable (#5203) 2024-06-14 15:06:07 +08:00
Bowen Liang 2b04388361
chore: remove bump-pydantic dependency (#5177) 2024-06-14 15:05:17 +08:00
takatost 3c0f21d174
fix: workflow as tool create error by type misuse (#5205) 2024-06-14 15:01:09 +08:00
-LAN- ed53ef29f4
fix(core/tools): Fix the issue with iterating over None in `_transform_tool_parameters_type`. (#5190) 2024-06-14 11:25:48 +08:00
dependabot[bot] 54e02b8147
chore(deps): bump authlib from 1.2.0 to 1.3.1 in /api (#5115)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-14 03:55:40 +08:00
Summer-Gu 7f98c2ea3f
refactor: Delete the dataset to verify whether it is in use (#5112) 2024-06-14 03:25:38 +08:00
dependabot[bot] 7189a4c379
chore(deps): bump azure-identity from 1.15.0 to 1.16.1 in /api (#5116)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-14 03:24:32 +08:00
takatost 415022aa14
fix: pydantic2 error (#5172) 2024-06-14 03:05:04 +08:00
saga.rey edf2047f04
fix: milvus_vector default dataset index_struct type from weaviate to milvus (#5098) 2024-06-14 02:36:01 +08:00
rerorero b85ae146a7
fix: JSON mode with an image doesn't work for Gemini (#5169) 2024-06-14 02:32:09 +08:00
takatost 5ec7d85629
fix: issues by pydantic2 upgrade (#5171) 2024-06-14 02:28:28 +08:00
Pan, Wen-Ming f13af5a811
fix(model_providers/vertex_ai): Vertex AI Anthropic models authentication failed (#4971) 2024-06-14 01:34:31 +08:00
Bowen Liang f976740b57
improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 2024-06-14 01:05:37 +08:00
Yeuoly e8afc416dd
improve: CI experience (#5168) 2024-06-13 23:16:28 +08:00
Yeuoly 0cccf9c67d
feat: introduce APP_MAX_EXECUTION_TIME (#5167) 2024-06-13 23:08:05 +08:00
Bowen Liang cdc08a434f
feat: support Chroma vector store (#5015) 2024-06-13 18:02:18 +08:00
Kazuki Takamatsu 3f18369ad2
Fix: google storage init with sa and download (#5054) 2024-06-13 17:36:34 +08:00
Kazuki Hasegawa db976a1f74
Upgrade boto3 library to support EKS Pod Identity. (#5064) 2024-06-13 17:36:14 +08:00
kurokobo e61f5d029a
chore(docs): fix minor small typos (#5124) 2024-06-13 17:36:01 +08:00
sino 8210637bc5
feat: support jina-clip-v1 embedding model (#5146) 2024-06-13 16:31:18 +08:00
呆萌闷油瓶 790543131a
chore:add some new api version for azure openai (#5142) 2024-06-13 16:30:47 +08:00
Ikko Eltociear Ashimine a40f68cf94
chore: update qdrant_vector.py (#5128) 2024-06-13 15:35:14 +08:00
yanghx adc948e87c
fix(api/core/model_runtime/model_providers/baichuan,localai): Parse ToolPromptMessage. #4943 (#5138)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-13 13:08:30 +08:00
smoky 742b08e1d5
chore: update question classifier prompt (#5137)
Signed-off-by: 0xff-dev <stevenshuang521@gmail.com>
2024-06-13 13:04:51 +08:00
orangeclk 79e8489942
feat: support siliconflow (#5129) 2024-06-13 12:59:41 +08:00
Charlie.Wei d6fa130cb5
remove dalle3 seed (#5136)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-13 08:05:55 +08:00
takatost 0c92f81efc
chore: sync pyproject.toml from requirements.txt (#5130) 2024-06-13 00:06:05 +08:00
fishisnow 11fd4a5dcc
Fix: fix load_yaml logging, Avoid setting the log level to warning (#5019)
Co-authored-by: huangyusong <huangyusong@yingzi.com>
2024-06-12 19:27:01 +08:00
Harry Wang b399e8a359
fixed a typo and grammar error in sampled app (#5061) 2024-06-12 18:02:22 +08:00
非法操作 e04fc9b304
fix: select field not work when it is not required (#5101) 2024-06-12 17:46:53 +08:00
xielong ea69dc2a7e
feat: support hunyuan llm models (#5013)
Co-authored-by: takatost <takatost@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
2024-06-12 17:24:23 +08:00
Pika ecc7f130b4
fix(typo): misspelling (#5094) 2024-06-12 17:01:21 +08:00
sino 0ce97e6315
feat: support doubao llm function calling (#5100) 2024-06-12 15:43:50 +08:00
Bowen Liang 25b0a97851
build: use Poetry as default build system for dependency installation in CI jobs (#5088) 2024-06-12 14:43:03 +08:00
rerorero 28997772a5
fix: remote_url doesn't work for gemini (#5090) 2024-06-12 13:14:53 +08:00
Charlie.Wei b7c72f7a97
dalle3 add style consistency parameter (#5067)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-12 12:59:03 +08:00
非法操作 3b36ba797f
feat: add duckduckgo img search, translate, ai chat (#5074) 2024-06-12 10:04:10 +08:00
ugyuji 4d2e6c3391
fix: Google HL Parameter for SearchApi (#5071) 2024-06-12 08:30:01 +08:00
orangeclk 2050a8b8f0
feat: add glm4 new models and zhipu embedding-2 (#5089) 2024-06-12 08:22:17 +08:00
takatost e3544c6ef7
fix: dependency package versions are not synchronized to requirements.txt (#5084) 2024-06-11 22:21:18 +08:00
Matri f62f71a81a
build: initial support for poetry build tool (#4513)
Co-authored-by: Bowen Liang <bowenliang@apache.org>
2024-06-11 13:11:28 +08:00
sino 5f870ac950
chore: update maas model provider description (#5056) 2024-06-11 11:22:22 +08:00
Pascal M 415816cf35
feat: add dataset delete endpoint (#5048) 2024-06-11 11:21:38 +08:00
takatost 5986841e27
fix: issue where an error occurs when invoking TTS without selecting a voice (#5046) 2024-06-09 20:28:24 +08:00
Jaxon Ley 2573b138bf
fix: update presence_penalty configuration for wenxin AI ernie-4.0-8k and ernie-3.5-8k models (#5039) 2024-06-09 14:44:11 +08:00
Bowen Liang bdad993901
improve: generalize vector factory classes and vector type (#5033) 2024-06-08 22:29:24 +08:00
Jyong 3b60c28b3a
deal the external image when extract docx image (#5024) 2024-06-07 20:00:39 +08:00
Jyong 481e7bc6b9
Fix/azure blob new version (#5004) 2024-06-06 23:36:13 +08:00
takatost 3929d289e0
feat: set default memory messages limit to infinite (#5002) 2024-06-06 17:39:44 +08:00
Yeuoly 52585aea74
fix: typo in sd3 (#5000) 2024-06-06 17:08:49 +08:00
Yeuoly 73dee84cab
fix: add handling for non-string type in variable template parser (#4996) 2024-06-06 16:38:13 +08:00
Joe 5cdb95be1f
fix: gemini timeout error (#4955) 2024-06-06 10:19:03 +08:00
Bowen Liang 7fa735a43b
chore: rename vdb tests for PGVector and PGvectoRS (#4973) 2024-06-06 07:22:49 +08:00
takatost 3579fd1b09
feat: add create tenant command (#4974) 2024-06-06 00:42:00 +08:00
Jyong 237b8fe3d9
add meta.doc_id index for tidb (#4963) 2024-06-05 20:45:43 +08:00
Jyong 02e4de5166
fix some tidb bugs (#4960) 2024-06-05 19:14:18 +08:00
Weaxs 0797f9bc05
feat: support tidb vector (#4588) 2024-06-05 18:19:53 +08:00
非法操作 602c4e51ec
fix: duckduckgo search does not work (#4949)
Co-authored-by: Jyong <76649700+johnjyong@users.noreply.github.com>
2024-06-05 17:33:58 +08:00
YC 9f8ca75a81
fixing a bug of handling header row when parsing xls file, and tune xls/xlsx parsing result to be more structured (#3600) 2024-06-05 15:28:43 +08:00
Yeuoly 80a87f36ea
fix: missing iterator in task pipeline (#4948) 2024-06-05 15:10:20 +08:00
Bowen Liang f32b440c4a
chore: fix indention violations by applying E111 to E117 ruff rules (#4925) 2024-06-05 14:05:15 +08:00
JasonVV 7749b71fff
Optimize knowledge retrieval performance by batching dataset quries. (#4917) 2024-06-05 13:30:32 +08:00
takatost b20d173324
pref: optimize feature model_load_balancing_enabled value fetch speed… (#4933) 2024-06-05 02:06:19 +08:00
takatost f44d1e62d2
fix: bedrock get_num_tokens prompt_messages parameter name err (#4932) 2024-06-05 01:53:05 +08:00
takatost 21ac2afb3a
fix: question classifier instruction npe (#4931) 2024-06-05 01:27:58 +08:00
takatost f7dd327bc2
version to 0.6.10 (#4929) 2024-06-05 01:12:20 +08:00
takatost 09298a32e7
fix: vanna CVE-2024-5565 by disable visualize of ask func (#4930) 2024-06-05 00:46:22 +08:00
takatost d1dbbc1e33
feat: backend model load balancing support (#4927) 2024-06-05 00:13:04 +08:00
Yeuoly 52ec152dd3
fix: incorrect parameters transforming while validating (#4928) 2024-06-05 00:01:30 +08:00
Jyong c7bddb637b
support instruction in classifier node (#4913) 2024-06-04 20:07:54 +08:00
Jyong 4e3b0c5aea
support rename document (#4915) 2024-06-04 20:07:40 +08:00
Jyong b6631cd878
modify rerank and splitter code directory (#4924) 2024-06-04 20:07:25 +08:00
非法操作 e121788ff5
chore: make the error msg more clear when validate app token (#4919)
Co-authored-by: Jyong <76649700+johnjyong@users.noreply.github.com>
2024-06-04 18:04:10 +08:00
Jyong 9cf9720efa
Fix/azure blob token expire (#4914) 2024-06-04 14:30:23 +08:00
Henry Lu 2d9f55b632
feat: Add Vanna.AI as a builtin tool (#4878)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-06-04 14:05:29 +08:00
非法操作 7133a16511
chore: refactor the serpapi's google search tool (#4834) 2024-06-04 14:05:05 +08:00
Moonlit 86e7c7321f
Fixed a bug where any content in the 'fetch' was converted to True (#4400) 2024-06-04 13:27:23 +08:00
Bowen Liang 58db719a2c
dep: bump pandas from 1.x to 2.x (#4820) 2024-06-04 13:24:28 +08:00
doufa 9abeb99b32
chore: modify tools/JinaReader label to Jina (#4908) 2024-06-04 13:21:05 +08:00
Jyong d828a7fc35
fix azure blob token expire (#4911) 2024-06-04 13:04:56 +08:00
dependabot[bot] b97181a793
chore(deps): bump azure-storage-blob from 12.9.0 to 12.13.0 in /api (#4695)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-04 02:57:33 +08:00
Bowen Liang 5d15aca85f
chore: remove unused code and class in text splitter (#4864) 2024-06-04 02:54:09 +08:00
Pan, Wen-Ming b98a1a3303
feat: added Anthropic Claude3 models to Google Cloud Vertex AI (#4870)
Co-authored-by: pwm <pwm@google.com>
2024-06-04 02:52:46 +08:00
takatost 696c5308a9
chore: optimize nvidia nim credential schema and info (#4898) 2024-06-04 02:26:26 +08:00
Bowen Liang 3542d55e67
improve: generalize tool parameter converter (#4786) 2024-06-03 21:26:58 +08:00
Joshua 3c8a120e51
add-nvidia-mim (#4882) 2024-06-03 21:10:18 +08:00
Charlie.Wei d058a234ba
Fixed workflow tts feature audition (#4867) 2024-06-03 00:22:14 +08:00
Pan, Wen-Ming cdbc260571
Bugfix: Vertex AI vision model not support image (#4853) 2024-06-02 11:11:09 +08:00
Bowen Liang b234710af9
chore: fix invalid escape sequences by applying W605 rule (#4851) 2024-06-02 10:02:37 +08:00
Bowen Liang 23498883d4
chore: skip explicit installing jinja2 as testing dependency (#4845) 2024-06-02 09:49:20 +08:00
Bowen Liang a47e8d0da2
test: CI test for db migration scripts on changes (#4739) 2024-05-31 16:45:34 +08:00
Yeuoly 7aaa1ff270
chore: increase workflow max steps to 500 (#4835) 2024-05-31 15:16:35 +08:00
Yeuoly 85698ca4f7
chore: cleanup tools, remove useless code (#4833) 2024-05-31 14:19:59 +08:00
Oliver Lee 176d91937d
fix 'NoneType' and new ContentType supported. (#4818) 2024-05-31 14:19:33 +08:00
Yash Parmar e0da0744b5
add: ollama keep alive parameter added. issue #4024 (#4655) 2024-05-31 12:22:02 +08:00
DomKing 38a470a873
fix: app_count of dataset is error when apps was deleted (#4810) 2024-05-30 19:23:46 +08:00
Krasus.Chen 93d3350c8c
update sd-webui api parameters to v1.9.3 (#4798)
Co-authored-by: Your Name <chen@krasus.red>
2024-05-30 19:04:47 +08:00
Charles Zhou a325a294bd
feat: opportunistic tls flag for smtp (#4794) 2024-05-30 18:56:46 +08:00
zxhlyh 4b91383efc
feat: workflow variable aggregator support group (#4811)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-05-30 18:54:58 +08:00
SebastjanPrachovskij b10e67be3b
Add SearchApi tools (#4648) 2024-05-30 11:11:17 +08:00
Kota-Yamaguchi 3b60b712ec
feat: Add logging warning when MAIL_TYPE is not set (#4771) 2024-05-29 18:06:16 +08:00
zeroameli afed3610fc
fix organize agent's history messages without recalculating tokens (#4324)
Co-authored-by: chenyongzhao <chenyz@mama.cn>
2024-05-29 15:25:20 +08:00
Yeuoly 74f38eacda
feat: support define tags in tool yaml (#4763) 2024-05-29 15:19:14 +08:00
Weaxs b189faca52
feat: update ernie model (#4756) 2024-05-29 14:57:23 +08:00
Yeuoly d4cd6149ac
fix: incorrect workflow max call depth (#4759) 2024-05-29 14:52:28 +08:00
xielong e1cd9aef8f
feat: support baichuan3 turbo, baichuan3 turbo 128k, and baichuan4 (#4762) 2024-05-29 14:46:04 +08:00
Yeuoly ba37275503
fix: confusing chart description (#4760) 2024-05-29 14:36:33 +08:00
majian 72a90074bc
Add WORKFLOW_CALL_MAX_DEPTH env var. (#4713) 2024-05-29 13:39:11 +08:00
crazywoola 705a6e3a8e
Fix/4742 ollama num gpu option not consistent with allowed values (#4751) 2024-05-29 13:33:35 +08:00
xielong 793f0c1dd6
fix: Corrected schema link in model_runtime's README.md (#4757) 2024-05-29 13:03:21 +08:00
takatost 9e6b6e7b82
fix: workflow run sequence number slow sql (#4737) 2024-05-28 20:41:52 +08:00
xielong 88b4d69278
fix: Correct context size for banchuan2-53b and banchuan2-turbo (#4721) 2024-05-28 16:37:44 +08:00
Jyong 1b2d862973
add error msg for hit test (#4704) 2024-05-28 14:54:53 +08:00
Yeuoly e198bc9b9a
fix: workflow as tool garbled (#4707) 2024-05-28 14:51:42 +08:00
crazywoola 6534566b7e
feat: add América/São Paulo tz (#4701) 2024-05-28 10:12:18 +08:00
takatost e60350d95d
version to 0.6.9 (#4692) 2024-05-27 22:48:34 +08:00
Patryk Garstecki f40743183e
🔧 Add env variable for time signature (#4650) 2024-05-27 22:20:49 +08:00
Yeuoly e852a21634
Feat/workflow phase2 (#4687) 2024-05-27 22:01:11 +08:00
Bowen Liang 140dd873f1
fix: show exception message when sandbox execution fails (#4663) 2024-05-27 18:06:15 +08:00
crazywoola 27dae156db
fix: colon in file mistral.mistral-small-2402-v1:0 (#4673) 2024-05-27 13:15:20 +08:00
Giovanny Gutiérrez 2deb23e00e
fix: Show rerank in system for localai (#4652) 2024-05-27 12:09:51 +08:00
longzhihun fe9bf5fc4a
[seanguo] add support of amazon titan v2 and modify the price of amazon titan v1 (#4643)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-05-26 23:30:22 +08:00
Charlie.Wei cd4924d472
Fix tts audition (#4656)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-05-26 21:00:36 +08:00
kronus-ho f56b984d97
Fix Unnecessary Newline Characters in Extracted Tool Response Text (#4646)
Co-authored-by: kronus <kronus@istarshine.com>
2024-05-25 15:24:59 +08:00
miendinh f804adbff3
feat: Support for Vertex AI - load Default Application Configuration (#4641)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-05-25 13:40:25 +08:00
10YearsDiary 109aabc6f2
fix: incorrect handling when http header value contain multiple colons. (#4574) 2024-05-25 13:20:06 +08:00
liuzhenghua ad620f02c7
fix: the date is incorrect if the db field is timestamp and the TZ is not the UTC (#4624)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-05-25 13:11:18 +08:00
yalei 026175c8f7
feat: update notion extractor (#3898)
Co-authored-by: duyalei <>
2024-05-24 20:30:48 +08:00
Krasus.Chen f156014daa
update lite8k/speed8k/128k max_token to newest (#4636)
Co-authored-by: Your Name <chen@krasus.red>
2024-05-24 19:33:42 +08:00
takatost 2cd55e456a
fix: WORKFLOW_MAX_EXECUTION_STEPS spell error in config.py (#4642) 2024-05-24 16:32:26 +08:00
majian 8c2ca60c8b
feat: Add WORKFLOW_MAX_EXECUTION_TIME env var (#4632) 2024-05-24 15:27:12 +08:00
Bowen Liang 3fda2245a4
improve: extract method for safe loading yaml file and avoid using PyYaml's FullLoader (#4031) 2024-05-24 12:08:12 +08:00
Patryk Garstecki 296887754f
Support for Vertex AI (#4586) 2024-05-24 12:01:40 +08:00
QuietRocket 9ae72cdcf4
feat: Add Gemini Flash (#4616) 2024-05-24 11:43:06 +08:00
crazywoola 16fec084f5
Fix/4630 bug api suggested (#4633) 2024-05-24 11:11:12 +08:00
Jyong 24624491cd
add qdrant metadata.doc_id index when create qdrant collection (#4570) 2024-05-23 18:11:01 +08:00
Jyong 233c4150d1
support images and tables extract from docx (#4619) 2024-05-23 18:05:23 +08:00
Yeuoly 5893ebec55
fix: code node garbled in Javascript (#4615) 2024-05-23 17:18:57 +08:00
takatost 11642192d1
chore: add https://api.openai.com placeholder in OpenAI api base (#4604) 2024-05-23 12:56:05 +08:00
呆萌闷油瓶 e57bdd4e58
chore:update gpt-3.5-turbo and gpt-4-turbo parameter for azure (#4596) 2024-05-23 11:51:38 +08:00
somethingwentwell 461488e9bf
Add Azure OpenAI API version for GPT4o support (#4569)
Co-authored-by: wwwc <wwwc@outlook.com>
2024-05-22 17:43:16 +08:00
非法操作 24576a39e5
fix: some google search result raise exception (#4567) 2024-05-22 14:28:52 +08:00
Justin Wu 3ab19be9ea
Fix bedrock claude wrong pricing (#4572)
Co-authored-by: Justin Wu <justin.wu@ringcentral.com>
2024-05-22 14:28:28 +08:00
naporitan 5b009a5afb
chore(api): Use channel from UI as API query parameter (#4562) 2024-05-22 14:28:03 +08:00
非法操作 3efb5fe7e2
Refactor part of the ProviderManager code to improve readability (#4524) 2024-05-22 11:18:03 +08:00
呆萌闷油瓶 d5a33a0323
feat:add gpt-4o for azure (#4568) 2024-05-22 11:02:43 +08:00
Jyong f25927855e
add qdrant metadata.doc_id index (#4559) 2024-05-22 01:42:08 +08:00
Li Yi f32bba6531
Update requirements.txt with latest OSS package with AuthV4 support (#4425) 2024-05-20 17:26:07 +08:00
Benjamin 40bc936739
chore: update yfinance dependency to version 0.2.40 (#4517) 2024-05-20 16:47:05 +08:00
rennokki 6b5685ef0c
feat: Jina Search & Jina Reader CSS selectors (#4523) 2024-05-20 16:40:46 +08:00
Bowen Liang e8e213ad1e
chore: apply and fix flake8-bugbear lint rules (#4496) 2024-05-20 16:34:13 +08:00
Bowen Liang 5f4df34829
improve: generalize transformations and scripts of runner and preloads into TemplateTransformer (#4487) 2024-05-20 15:56:26 +08:00
Rain Chen c255a20d7c
allow to config max segmentation tokens length for RAG document using environment variable (#4375) 2024-05-20 13:20:27 +08:00
majian b5204111da
Add UNSTRUCTURED_API_KEY env support (#4369) 2024-05-20 13:14:17 +08:00
Bowen Liang 3a51f2a778
fix: workaround db migration error when adding custom_disclaimer column to recommended_apps (#4518)
Co-authored-by: takatost <takatost@gmail.com>
2024-05-20 12:33:21 +08:00
Ever 4086f5051c
feat:Provide parameter config for mask_sensitive_info of MiniMax mode… (#4294)
Co-authored-by: 老潮 <zhangyongsheng@3vjia.com>
Co-authored-by: takatost <takatost@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-05-20 10:15:27 +08:00
Benjamin 46bd53a929
chore: sort categories in recommended app service response (#4498) 2024-05-19 22:44:29 +08:00
Matri a10c2ccd41
fix: files data missed for message (#4512) 2024-05-19 22:42:52 +08:00
fanghongtai 1cca100a48
fix:modify spelling errors: lanuage ->language in schema.md (#4499)
Co-authored-by: wxfanghongtai <wxfanghongtai@gf.com.cn>
2024-05-19 18:31:05 +08:00
Bowen Liang 04ad46dd31
chore: skip unnecessary key checks prior to accessing a dictionary (#4497) 2024-05-19 18:30:45 +08:00
Patryk Garstecki aa13d14019
Feat/chat custom disclaimer (#4306) 2024-05-18 10:52:48 +08:00
zxhlyh 8b931b085c
fix: app logo (#4483) 2024-05-17 18:02:00 +08:00
sino 528faceb35
fix: cot agent token usage is empty (#4474) 2024-05-17 14:45:20 +08:00
Yeuoly c2a8fa91b1
fix: cot gent duplicate messages (#4470) 2024-05-17 13:32:02 +08:00
Yeuoly 091fba74cb
enhance: claude stream tool call (#4469) 2024-05-17 12:43:58 +08:00
Bowen Liang 083ef2e6fc
improve: exract Code Node provider for each supported scripting language (#4164) 2024-05-17 11:58:12 +08:00
jiaqianjing 0ac5d621b6
add llm: ernie-character-8k of wenxin (#4448) 2024-05-16 18:31:07 +08:00
Jyong bdd409970f
fix the wrong env variable AZURE_BLOB_CONTAINER_NAME (#4455) 2024-05-16 18:30:52 +08:00
takatost d8f38f79f2
feat: add pre ping for sqlalchemy configuration (#4454) 2024-05-16 17:07:21 +08:00
Han Fangyuan 3df47b7b59
fix: wrong category name in examples of question classifier completion prompt (#4421) 2024-05-16 13:04:57 +08:00
sino 6e9066ebf4
feat: support doubao llm and embeding models (#4431) 2024-05-16 11:41:24 +08:00
Garfield Dai dd94931116
Remove useless code (#4416) 2024-05-15 16:14:49 +08:00
huchengyi da81233d61
Custom sqlalchemy database uri scheme is supported (#4367) 2024-05-15 15:27:15 +08:00
VoidIsVoid a76ae2d756
chore: remove useless code in knowledge_retrieval_node (#4412) 2024-05-15 15:24:40 +08:00
Charlie.Wei 97b65f9b4b
Optimize webscraper (#4392)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-05-15 15:23:16 +08:00
Yeuoly 182dadd433
chore: remove model as tool (#4409) 2024-05-15 12:25:04 +08:00
非法操作 1d0f88264f
Fix HTTP REQUEST NODE is always waiting but endpoint have responsed (#4395) 2024-05-15 11:05:46 +08:00
Yash Parmar 332baca538
FIX: fix the temperature value of ollama model (#4027) 2024-05-15 08:05:54 +08:00
Kota Matsumoto e2a78888b9
Fix: setup google-storage client (#4296)
Co-authored-by: kotamat <kota1681@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-05-15 08:05:41 +08:00
Charles Zhou 2eb468f885
fix: add timeout to SMTPClient to prevent worker blocking (#4352) 2024-05-14 23:44:53 +08:00
kerlion 98140ae5d9
fix the issue of MILVUS_DATABASE has no effect. (#4353) 2024-05-14 19:54:31 +08:00
rennokki d1ccb22d8a
feat: Use Romanian & other langs in QA (#4205)
Co-authored-by: crazywoola <427733928@qq.com>
2024-05-14 17:48:24 +08:00
非法操作 3271e3e803
improve the code readability of http_executor node (#4360) 2024-05-14 16:11:12 +08:00
Yeuoly 16d47923c3
fix: requests timeout (#4370) 2024-05-14 16:01:23 +08:00
takatost eee95190cc
version to 0.6.8 (#4347) 2024-05-14 03:18:26 +08:00
Yeuoly e8311357ff
feat: gpt-4o (#4346) 2024-05-14 02:52:41 +08:00
orangeclk ece0f08a2b
add yi models (#4335)
Co-authored-by: 陈力坤 <likunchen@caixin.com>
2024-05-13 17:40:53 +08:00
Yeuoly bbef964eb5
improve: code upgrade (#4231) 2024-05-13 14:39:14 +08:00
Ikko Eltociear Ashimine e6db7ad1d5
chore: update gmpy2_pkcs10aep_cipher.py (#4314) 2024-05-13 10:45:29 +08:00
Weaxs 8cc492721b
fix: minimax streaming function_call message (#4271) 2024-05-11 21:07:22 +08:00
Joshua a80fe20456
add-some-new-models-hosted-on-nvidia (#4303) 2024-05-11 21:05:31 +08:00
takatost d8926a2571
feat: hide node detail outputs in webapp & installed app in explore (#3954) 2024-05-11 13:40:11 +08:00
呆萌闷油瓶 4796f9d914
feat:add gpt-4-turbo for azure (#4287) 2024-05-11 13:02:56 +08:00
Sebastian.W a588df4371
Add rerank model type for LocalAI provider (#3952) 2024-05-11 11:29:28 +08:00
Patryk Garstecki 2c1c660c6e
fix(Backend:http_executor): 🔧 prevent splitting JSON data as v… (#4276) 2024-05-11 11:23:35 +08:00
Bowen Liang 228de1f12a
fix: miss usage of os.path.join for URL assembly and add tests on yarl (#4224) 2024-05-10 18:14:48 +08:00
GalvinYang 6b99075dc8
fix: system default model name length (#4245) (#4246)
Co-authored-by: takatost <takatost@gmail.com>
2024-05-10 18:12:18 +08:00
Yeuoly 8578ee0864
feat: support LLM jinja2 template prompt (#3968)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-05-10 18:08:32 +08:00
Jyong 897e07f639
question classifier prompt optimize (#4262) 2024-05-10 17:22:46 +08:00
LiuVaayne 875249eb00
Feat/vector db pgvector (#3879) 2024-05-10 17:20:30 +08:00
takatost 86a6e6bd04
feat: increase max steps to 50 in workflow (#4252) 2024-05-10 14:50:00 +08:00
takatost 8f3042e5b3
feat: Add draft hash check in workflow (#4251) 2024-05-10 14:48:29 +08:00
takatost 64c3bc070a
version to 0.6.7 (#4208) 2024-05-09 13:58:25 +08:00
sino 4aa21242b6
feat: add volcengine maas model provider (#4142) 2024-05-08 12:45:53 +08:00
Yong723 8ce93faf08
Typo on deepseek.yaml and yi.yaml (#4170) 2024-05-08 10:52:04 +08:00
Su Yang 9f440c11e0
feat: DeepSeek (#4162) 2024-05-08 00:28:16 +08:00
Joshua 58bd5627bf
Add-Deepseek (#4157) 2024-05-07 22:45:38 +08:00
Moonlit 2fdd64c1b5
feat: add proxy configuration for Cohere model (#4152) 2024-05-07 18:12:13 +08:00
Jyong 591b993685
fix dataset segment update api not effect issue (#4151) 2024-05-07 17:47:20 +08:00
VoidIsVoid 543a00e597
feat: update model_provider jina to support custom url and model (#4110)
Co-authored-by: Gimling <huangjl@ruyi.ai>
Co-authored-by: takatost <takatost@gmail.com>
2024-05-07 17:43:24 +08:00
Minamiyama f361c7004d
feat: support vision models from xinference (#4094)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-05-07 17:37:36 +08:00
Tomy bb7c62777d
Add support for local ai speech to text (#3921)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-05-07 17:14:24 +08:00
Yeuoly d51f52a649
fix: http authorization leakage (#4146) 2024-05-07 16:56:25 +08:00
Jyong e353809680
question classifier optimize (#4147) 2024-05-07 16:44:27 +08:00
takatost c2f0f958ef
fix: passing in 0 as a numeric variable will be converted to null (#4148) 2024-05-07 16:38:23 +08:00
Charlie.Wei 087b7a6607
azure_openai add gpt-4-turbo-2024-04-09 model (#4144)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-05-07 15:55:23 +08:00
Patryk Garstecki 6271463240
feat(Languages): 👽 add pl-PL language (#4128) 2024-05-07 15:41:57 +08:00
Weaxs 6f1911533c
bug fix: update minimax model_apis (#4116) 2024-05-07 14:40:24 +08:00
Yeuoly d5d8b98d82
feat: support openai stream usage (#4140) 2024-05-07 13:49:45 +08:00
Yeuoly e7fe7ec0f6
feat: support time format (#4138) 2024-05-07 13:02:00 +08:00
Bowen Liang 049abd698f
improve: test CodeExecutor with code templates and extract CodeLanguage enum (#4098) 2024-05-07 12:37:18 +08:00
Yeuoly 76bec6ce7f
feat: add http node max size env (#4137) 2024-05-07 12:07:56 +08:00
S96EA 13cd409575
feat: support aliyun oss auth v4 (#3886)
Co-authored-by: owen <owen@owen.hawk-toad.ts.net>
2024-05-06 11:56:04 +08:00
羊羽 13292ff73e
🦄 refactor(dataset svc): delete check none (#4101)
Co-authored-by: baxiang <baxiang@lixiang.com>
2024-05-06 11:45:26 +08:00
Joshua 51a9e678f0
Leptonai integrate (#4079) 2024-05-05 14:37:47 +08:00
chenx5 ad76ee76a8
Update bedrock.yaml add Region Asia Pacific (Sydney) (#4016) 2024-05-05 10:49:17 +08:00
Yeuoly b5f101bdac
fix: transform None into correct dest type (#4077) 2024-05-04 16:34:42 +08:00
Pan YANG 5940564d84
feat: add a new built-in tool of Slack Incoming Webhook (#4067) 2024-05-04 16:17:34 +08:00
Yeuoly 67902b5da7
fix: agent log timezone (#4076) 2024-05-04 16:17:15 +08:00
Bowen Liang 44857702ae
test: add integration tests on CodeExecutor with the sandbox service (#4015) 2024-05-03 08:54:40 +08:00
sino b1399cd5f9
fix: unable to fetch CoT agent runner log (#4052) 2024-05-03 08:54:15 +08:00
Garfield Dai 6f1e4a19a2
fix: workflow avg user interaction. (#4056) 2024-05-02 20:24:40 +08:00
takatost 93393e005e
version to 0.6.6 (#4050) 2024-05-02 16:06:40 +08:00
Bowen Liang 093b5c0e63
fix: typo of jinja2 (#4019) 2024-04-30 18:39:02 +08:00
orangeclk cbdb861ee4
add glm-3-turbo max_tokens parameter setting (#4017)
Co-authored-by: 陈力坤 <likunchen@caixin.com>
2024-04-30 17:08:04 +08:00
sino da5a8b9a59
feat: support question classifier node output (#4000) 2024-04-30 17:07:29 +08:00
Weaxs 1e6e8b446d
feat: support minimax abab6.5, abab6.5s (#4012) 2024-04-30 17:02:01 +08:00
Bowen Liang 142814d451
chore: skip deprecated field_schema param in creating payload index on Qdrant (#3903) 2024-04-30 16:16:10 +08:00
crazywoola 704755d005
fix: submitCodeExecutionTask (#4006) 2024-04-30 16:01:03 +08:00
Richards Tu d1263700c0
Update the description and labels in Judge0ce tool (#3990)
Co-authored-by: crazywoola <427733928@qq.com>
2024-04-30 14:58:29 +08:00
Jyong 338e4669e5
add storage factory (#3922) 2024-04-29 18:22:03 +08:00
Jyong 1d432728ac
add default value for QDRANT_GRPC_PORT (#3976) 2024-04-29 15:28:34 +08:00
Richards Tu f26ad16af7
Add new tool: Firecrawl (#3819)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-04-29 14:20:36 +08:00
majian 8f2ae51fe5
feat: add support for request timeout settings in the HTTP request node. (#3854)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-04-29 13:59:07 +08:00
Joshua 2f84d00300
fix-nvidia-llama3 (#3973) 2024-04-29 13:41:15 +08:00
takatost b82a2d97ef
fix: db connections not being released during workflow execution (#3971) 2024-04-29 12:42:09 +08:00
Jyong 3e9dbe3e0a
add pgvecto_rs support and upgrade SQLAlchemy (#3833) 2024-04-29 11:58:17 +08:00
羊羽 975b2fb79e
delete duplicate check get_dataset (#3966)
Co-authored-by: baxiang <baxiang@lixiang.com>
2024-04-29 11:57:26 +08:00
Yeuoly e7b4d024ee
optimize: code node has a bad error message (#3949) 2024-04-28 17:40:29 +08:00
takatost ff67a6d338
feat: llm text stream support for workflow app (#3798)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-04-28 17:37:00 +08:00
呆萌闷油瓶 0940f01634
enhancement:support Qdrant gRPC mode (#3929) 2024-04-28 15:33:32 +08:00
miendinh 9ad489d133
feat: Add google storage support (#3887)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
2024-04-27 18:26:52 +08:00
Bowen Liang 661b30784e
chore: skip warning messages when pytest auto-collecting the vdb test class by removing `Test` prefix (#3906) 2024-04-27 16:36:09 +08:00
longzhihun 43a5ba9415
feat: add support for Bedrock LLAMA3 (#3890) 2024-04-27 13:13:09 +08:00
Garfield Dai cefe156811
feat: replicate supports default version. (#3884) 2024-04-26 21:16:22 +08:00
yongjer 3b5b4d628b
Add support for Traditional Chinese language (#3899)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-04-26 21:10:23 +08:00
Jyong 0ec8b57825
add together ai model setting (#3895) 2024-04-26 20:43:17 +08:00
Bowen Liang 045827043d
test: improve vector store tests (#3855) 2024-04-26 19:18:42 +08:00
yalei 4d66a86579
fix: fetch page name of notion wiki (#3847) 2024-04-26 18:04:37 +08:00
miendinh 2a8881d0e8
fix: tool webscraper - too many redirects in case target url does not… (#3831)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
2024-04-26 17:58:46 +08:00
Charlie.Wei f62b2b5b45
optimize the knowledge failed documents query (#3870)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-04-26 11:47:23 +08:00
Bowen Liang 7919596a21
fix: UP031 style rule violation (#3866) 2024-04-26 11:24:08 +08:00
Bowen Liang 45dd1683fd
test: add tests covering all methods of vector store (#3849) 2024-04-25 22:27:30 +08:00
takatost 8bca908f15
refactor: config file (#3852) 2024-04-25 22:26:45 +08:00
Garfield Dai 9cbb8ddd7f
fix: billing tenant account role. (#3850) 2024-04-25 21:55:08 +08:00
Jingpan Xiong 1be222af2e
fix: using api can not execute relyt vector database (#3766)
Co-authored-by: jingsi <jingsi@leadincloud.com>
2024-04-25 19:46:20 +08:00
Richards Tu bf9fc8fef4
Reduce tool redundancy for [Judge0 CE] (#3837)
Co-authored-by: crazywoola <427733928@qq.com>
2024-04-25 19:20:54 +08:00
Bowen Liang 86e7330fa2
test: refactor vdb tests by visitor design pattern (#3838) 2024-04-25 18:55:49 +08:00
takatost 34bfb715e1
fix: citations always appear in the chatflow app (#3844) 2024-04-25 18:31:38 +08:00
Bowen Liang c54fcfb45d
extract enum type for tenant account role (#3788) 2024-04-25 18:20:08 +08:00
takatost 12435774ca
feat: query prompt template support in chatflow (#3791)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-04-25 18:01:53 +08:00
Henrybit 80b9507e7a
feat: add aliyun oss storage (#3690)
Co-authored-by: henrybit <qipenghui3056@sina.com>
2024-04-25 16:57:19 +08:00
takatost 0ac0f0ffd0
version to 0.6.5 (#3834) 2024-04-25 16:50:37 +08:00
呆萌闷油瓶 78988ed60e
fix:still enable SSL verification when using qdrant based on HTTP protocol (#3805) 2024-04-25 13:04:31 +08:00
Yeuoly 2832adda88
fix: missing url field when searching special keywords (#3820) 2024-04-25 12:33:58 +08:00
takatost a4e4fb4094
fix: credentials validate failed for groqcloud model provider (#3817) 2024-04-25 12:09:44 +08:00
YidaHu 777ec64635
feat: add log_file environment variable (#3793) 2024-04-24 21:55:14 +08:00
Bowen Liang 9cec8c1750
test: add unit tests for vector stores of Milvus, Qdrant and Weaviate (#3688) 2024-04-24 21:52:42 +08:00
Bowen Liang 8ca5aa1190
use pymilvus 2.3.7 (#3790) 2024-04-24 18:37:08 +08:00
takatost 3da179f77b
feat: add conversation_id and user_id in chatflow/workflow system vars (#3771)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-04-24 17:20:01 +08:00
Bowen Liang a34e8cb0bd
test: add test for PKCS1OAEP_Cipher with gmpy2 (#3760) 2024-04-24 17:15:31 +08:00
takatost 2ea8c73cd8
fix: type num of variable converted to str (#3758) 2024-04-24 15:07:56 +08:00
Jyong f257f2c396
Knowledge optimization (#3755)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-04-24 15:02:29 +08:00
Bowen Liang ccaf335466
fix: rollback gmpy2 to 2.1.5 (#3745) 2024-04-24 12:53:23 +08:00
1102 59cba930e5
bedrock llm Model file name change (#3714)
Co-authored-by: heshunchang <shuncanghe@clouditera.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-04-23 18:57:34 +08:00
Bowen Liang 2867d29021
fix: milvus usage with create_collection (#3683) 2024-04-23 17:37:40 +08:00
呆萌闷油瓶 f76ac8bdee
enhance:speedup xinference audio transcription (#3636) 2024-04-23 17:09:30 +08:00
Yeuoly 3480f1c59e
refactor: tool parameter cache (#3703) 2024-04-23 15:22:42 +08:00
Yeuoly 2c50fab3dd
fix: skip dataset icon (#3696) 2024-04-23 12:41:41 +08:00
Richards Tu ff76c4bd5d
Add new tool: Judge0 CE (#3684)
Co-authored-by: crazywoola <427733928@qq.com>
2024-04-23 09:07:21 +08:00
Yeuoly 2a213c6af7
fix: incorrect type parser (#3682) 2024-04-22 19:32:41 +08:00
Bowen Liang b2535e7db6
chore: update description of code interpreter tool (#3679)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-04-22 19:19:16 +08:00
longzhihun 28236147ee
feat: add support for bedrock Mistral AI model (#3676)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-04-22 17:24:02 +08:00
Chenhe Gu 4969783383
add groq llama3 (#3673) 2024-04-22 15:21:09 +08:00
takatost b64080be1b
version to 0.6.4 (#3670) 2024-04-22 12:13:31 +08:00
Bowen Liang aadebd6d23
python 3.12 support (#3652) 2024-04-22 11:41:13 +08:00
xin.gao 71cc0074ef
fix: delete tool parameters cache when sync draft workflow for run workflow use new parameter change in draft workflow (#3637) 2024-04-22 11:12:00 +08:00
saga.rey 1fb7df12d7
fix: in alembic's offline mode (db migrate with --sql option), skip data operations (#3533) 2024-04-21 09:44:35 +08:00
liuzhenghua 73e9f35ab1
feat: add file log (#3612)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-04-20 08:59:49 +08:00
Richards Tu d7f0056e2d
Fix error in [Update yaml and py file in Tavily Tool] (#3465)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-04-19 16:51:51 +08:00
fuckqqcom 9b7b133cbc
content fix to continue (#3633)
Co-authored-by: xiaohan <fuck@qq.com>
2024-04-19 16:51:38 +08:00
Joshua 7545e5de6c
add-llama3-for-nvidia-api-catalog (#3631) 2024-04-19 14:51:22 +08:00
Yeuoly a0c30702c1
feat: moonshot fc (#3629) 2024-04-19 14:04:30 +08:00
sqj8899 0a56c522eb
get dict key indexing_technique in DocumentAddByFileApi (#3615)
Co-authored-by: songqijun <songqijun@qipeng.com>
2024-04-19 09:37:11 +08:00
jeessy2 646858ea08
feat: Vision switch functionality is provided on OpenRouter (#3564) 2024-04-19 09:13:25 +08:00
Bowen Liang d9b821cecc
chore: apply ruff rules on tests and app.py (#3605) 2024-04-18 20:24:05 +08:00
Yeuoly d5448e07ab
seucirty: http smuggling (#3609) 2024-04-18 18:18:42 +08:00
Joshua de3b490f8e
Add mixtral 8x22b (#3606) 2024-04-18 17:44:22 +08:00
Garfield Dai 4481906be2
Feat/enterprise sso (#3602) 2024-04-18 17:33:32 +08:00
Yeuoly d9f1a8ce9f
feat: stable diffusion 3 (#3599) 2024-04-18 16:54:37 +08:00
aniaan aa6d2e3035
fix(openai_api_compatible): fixing the error when converting chunk to json (#3570) 2024-04-18 16:54:16 +08:00
呆萌闷油瓶 4365843c20
enhance:speedup xinference embedding & rerank (#3587) 2024-04-18 16:54:00 +08:00
Joshua b9b28900b1
add-open-mixtral-8x22b (#3591) 2024-04-18 13:48:32 +08:00
Bowen Liang d463b82aba
test: add scripts for running tests on api module both locally and CI jobs (#3497) 2024-04-18 13:43:15 +08:00
Yeuoly c2acb2be60
feat: code (#3557) 2024-04-18 08:00:02 +08:00
Siddharth Jain 8ba95c08a1
added claude 3 opus (#3545) 2024-04-17 20:53:59 +08:00
Yeuoly c7de51ca9a
enhance: preload general packages (#3567) 2024-04-17 19:49:53 +08:00
liuzhenghua e02ee3bb2e
fix event/stream ping (#3553) 2024-04-17 18:28:24 +08:00
Jyong 394ceee141
optimize question classifier prompt and support keyword hit test (#3565) 2024-04-17 17:40:40 +08:00
Yeuoly e212a87b86
fix: json-reader-json-output (#3552) 2024-04-17 14:09:42 +08:00
takatost b890c11c14
feat: filter empty content messages in llm node (#3547) 2024-04-17 13:30:33 +08:00
takatost 9b8861e3e1
feat: increase read timeout of OpenAI Compatible API, Ollama, Nvidia LLM (#3538) 2024-04-17 09:25:50 +08:00
LeePui 38ca3b29b5
add support for swagger object type (#3426)
Co-authored-by: lipeikui <lipeikui@3vjia.com>
2024-04-16 19:54:17 +08:00
Jyong 9e6d4eeb92
fix the return with wrong datatype of segment (#3525) 2024-04-16 17:09:15 +08:00
takatost 38dd58e796
version to 0.6.3 (#3519) 2024-04-16 14:43:57 +08:00
takatost 1219e41d29
fix: array[string] context in llm node invalid (#3518) 2024-04-16 14:39:14 +08:00
miendinh b9fbc39754
get config default for sandbox (#3508)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
2024-04-16 13:36:28 +08:00
Yeuoly fbd3ef8752
fix: add completion mode object check (#3515) 2024-04-16 13:36:02 +08:00
kerlion 200010be19
Add suuport for AWS Bedrock Cohere embedding (#3444) 2024-04-16 13:22:38 +08:00
liuzhenghua 5e02a83b53
fix: the object field is empty string in some openAI api compatible model (#3506) 2024-04-16 12:13:10 +08:00
Bowen Liang 81cdb0fe78
fix: bump twilio to 9.0.4 skipping yanked versions (#3500) 2024-04-16 09:30:52 +08:00
takatost 5b447d61a6
feat: refactor tongyi models (#3496) 2024-04-15 22:28:32 +08:00
Jyong fd90d99cd0
question classifier prompt optimization (#3479) 2024-04-15 17:55:52 +08:00
Joshua fd38e1cf15
nvidia-label-update (#3482) 2024-04-15 13:50:16 +08:00
Jingpan Xiong 33397836a5
feat: support relyt vector database (#3367)
Co-authored-by: jingsi <jingsi@leadincloud.com>
2024-04-15 11:52:34 +08:00
YidaHu 92f8c40e4c
fix: prompt template issue (#3449) 2024-04-15 11:31:38 +08:00
Bowen Liang 168bf61b23
chore: separate Python dependencies for development (#3198) 2024-04-15 11:03:10 +08:00
takatost 8811677154
feat: remove langchain from output parsers (#3473) 2024-04-15 00:23:42 +08:00
takatost 12f1ce4794
feat: optimize the efficiency of generating chatbot conversation name (#3472) 2024-04-14 23:50:24 +08:00
Yeuoly 8f8e9de601
feat: support configurate openai compatible stream tool call (#3467) 2024-04-14 22:04:45 +08:00
Yeuoly 5b3133f9fc
feat: jina reader (#3468) 2024-04-14 22:03:19 +08:00
crazywoola 782ecfa5c3
Revert "Update yaml and py file in Tavily Tool" (#3464) 2024-04-14 10:13:56 +08:00