Commit Graph

1894 Commits

Author SHA1 Message Date
-LAN- 9414143b5f
chore(api/libs): Apply ruff format. (#7301) 2024-08-15 17:53:12 +08:00
-LAN- 2d89b7d0a9
fix(api/services/app_dsl_service.py): Add conversation variables. (#7304) 2024-08-15 16:46:48 +08:00
-LAN- 3f9720bca0
fix(api/core/app/segments/segments.py): Fix file to markdown. (#7293) 2024-08-15 13:09:49 +08:00
Xiyuan Chen 7619850855
feat: support pinning, including, and excluding for Model Providers and Tools (#7283) 2024-08-15 12:58:38 +08:00
-LAN- 3571292fbf
chore(api): Introduce Ruff Formatter. (#7291) 2024-08-15 12:54:05 +08:00
-LAN- 8f16165f92
chore(api/core): Improve FileVar's type hint and imports. (#7290) 2024-08-15 12:43:18 +08:00
非法操作 6ff7fd80a1
feat: support OPENAI json_schema (#7258) 2024-08-15 11:29:19 +08:00
非法操作 5aa373dc04
feat: add chatgpt-4o-latest (#7289) 2024-08-15 11:19:10 +08:00
-LAN- 32dc963556
feat(api/workflow): Add `Conversation.dialogue_count` (#7275) 2024-08-15 10:53:05 +08:00
Nam Vu d2ccd8ba53
fix: #7222 docstrings (#7276) 2024-08-15 09:47:26 +08:00
Xiyuan Chen d29b32fce2
fix: typo in upstage/llm/_position.yaml (#7286) 2024-08-15 08:39:35 +08:00
pp 101db126c8
fix: missed rerank_mode when convert to DatasetEntity (#7269) 2024-08-15 00:41:12 +08:00
mochi ba79088ffc
Fix SQL parser Error in MyScale vdb. (#7255) 2024-08-14 16:41:18 +08:00
非法操作 3a27166c2e
chore: allow download audio/video through HTTP node (#7224) 2024-08-14 16:25:59 +08:00
-LAN- b5d472fad7
test(*): Avoid import from `api` in tests. (#7251) 2024-08-14 14:09:26 +08:00
噢哎哟喂 52383d0161
add support for tongyi-farui (#7248)
Co-authored-by: 雪风 <xuefeng@shifaedu.cn>
2024-08-14 14:09:13 +08:00
-LAN- 48d2febebf
fix(api/core/tools/entities/tool_entities.py): Fix type define. (#7250) 2024-08-14 14:08:54 +08:00
-LAN- f6c12b10ac
chore: update package versions to 0.7.0 (#7236) 2024-08-13 22:28:06 +08:00
-LAN- 5b77ef01d4
chore(api/services/app_dsl_service.py): Bump DSL version to 0.1.1 (#7235) 2024-08-13 18:20:41 +08:00
feng0 2fe2e350ce
add secondary sort_key when using `order_by` and `paginate` at the same time (#7225) 2024-08-13 17:39:51 +08:00
Leo.Wang 986fd5bfc6
Add gitlab support (#7179)
Co-authored-by: crazywoola <427733928@qq.com>
2024-08-13 17:36:45 +08:00
miendinh f104b930cf
feat: support elasticsearch vector database (#3558)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-08-13 17:36:20 +08:00
Onelevenvy 0f59d76997
fix: add context_size and max_chunks to Tongyi embedding to resolve issue #7189 (#7227) 2024-08-13 16:35:22 +08:00
非法操作 b3743a9ae5
chore: refactor searXNG tool (#7220) 2024-08-13 15:34:29 +08:00
lichao 13d061911b
Error Exception Message Of "Message Not Exists.", Should be "Suggested Questions Is Disabled." (#7219) 2024-08-13 15:17:18 +08:00
KVOJJJin 935e72d449
Feat: conversation variable & variable assigner node (#7222)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-08-13 14:44:10 +08:00
yusuke_ten 8b55bd5828
fix: display notion document title correctly (#7215) 2024-08-13 14:05:57 +08:00
shAlfred a12ddc47e7
feat: add support of speech2text function for OpenAI-API-compatible and Siliconflow (#7197) 2024-08-12 21:38:59 +08:00
Weaxs 67b9fdaad7
siliconflow support bge-3 && bce-v1 embedding (#7198) 2024-08-12 19:14:43 +08:00
mago960806 a68df696ec
Fix issue with incorrect port number in app_base_url due to NAT networks (#6653) 2024-08-12 12:26:12 +08:00
Bowen Liang ccb6ddd840
chore: bump Ruff to 0.5.7 (#7174) 2024-08-12 10:24:48 +08:00
ybalbert001 f2cb1fb09f
Fix : Workflow "start" paste url not support s3 pre-signed URL (#6855)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-08-11 16:45:15 +08:00
灰灰 ac60182c91
fix: solving http-request-tool bugs in workflow (#6685) 2024-08-11 16:32:06 +08:00
crazywoola 8b5761efb2
change secret input to text input in searxng (#7160) 2024-08-10 16:58:22 +08:00
Yanyi Liu 5b32f2e0dd
Feat: Add model provider Text Embedding Inference for embedding and rerank (#7132) 2024-08-09 19:12:13 +08:00
Yanyi Liu 4cbeb6815b
Fix: Wrong cutoff length lead to empty input in openai compatible embedding model. (#7133) 2024-08-09 19:11:57 +08:00
Jeff Li d338f69837
feat: add decode option to json process tools (#7138) 2024-08-09 19:05:27 +08:00
Jyong c6b0dc6a29
update dataset embedding model, update document status to be indexing (#7145) 2024-08-09 16:47:15 +08:00
crazywoola f667ef98cb
Feat/update tools length (#7141) 2024-08-09 16:07:37 +08:00
Joe 425174e82f
feat: update ops trace (#7102) 2024-08-09 15:22:16 +08:00
Joe 7201b56a6d
fix: workflow log run time error (#7130) 2024-08-09 14:46:31 +08:00
Matri 4dfa8eedb8
Feat/tool-D-ID (#6278) 2024-08-09 11:05:33 +08:00
forrestlinfeng 07511dfaf4
update stepfun model (#7118)
Co-authored-by: chenlinfeng <chenlinfeng@step.ai>
Co-authored-by: Tfsh <tianfs_fight@163.com>
2024-08-08 20:40:37 +08:00
小羽 7944ce0594
feat: wenxin add yi-34b-chat (#7117) 2024-08-08 20:01:21 +08:00
Aero Kang ad682c394d
fix annotation reply is null (#7103) 2024-08-08 19:07:50 +08:00
orangeclk 83acb53c08
feat: add zhipu embedding-3 (#7100) 2024-08-08 17:08:46 +08:00
shAlfred a7162240e6
feat: add text-embedding functon and LLM models to Siliconflow (#7090) 2024-08-08 17:08:28 +08:00
Jyong 12095f8cd6
extract docx filter comment element (#7092) 2024-08-08 16:53:29 +08:00
majian 5542ee4d0d
workflow logs support workflow run id filter (#6833) 2024-08-08 14:54:02 +08:00
zhuhao 4ffa706e4f
feat: add a builtin tool to support regex extraction. (#7081) (#7087) 2024-08-08 14:23:57 +08:00
Jyong 169cde6c3c
add nltk punkt resource (#7063) 2024-08-08 14:23:22 +08:00
小羽 34a9dbe826
Feat/add 360-zhinao provider (#7069) 2024-08-08 14:23:08 +08:00
Nam Vu 8e23e24bd5
feat: Poetry requests timeout (#7086) 2024-08-08 14:17:29 +08:00
orangeclk f288d367ac
Add price info for zhipu models (#7084) 2024-08-08 14:17:05 +08:00
Waffle 5e2fa13126
feat: support glm-4-long (#7070)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-08-08 10:54:39 +08:00
-LAN- 67a2f14cef
fix(api/core/workflow/nodes/tool/tool_node.py): Keep None value in tool params. (#7066) 2024-08-07 19:36:21 +08:00
Joe d7bb422a5c
fix: hunyuan assistant_prompt_message pydantic error (#7062) 2024-08-07 18:31:40 +08:00
8bitpd 40c6f3c724
fix: add redis lock to AnalyticdbVector init (#6859)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-08-07 17:32:06 +08:00
-LAN- df8f8c9a2c
feat(api/core/rag/datasource/vdb/analyticdb/analyticdb_vector.py): Checking config before init analyticdb (#7050) 2024-08-07 17:31:36 +08:00
-LAN- 536c43257b
refactor(*): Update hard-code '[__HIDDEN__]' to the constant. (#7048) 2024-08-07 17:30:56 +08:00
-LAN- 4e8f6b3603
chore(api/core/app/segments/segments.py): Remove todo tags. (#7052) 2024-08-07 17:29:35 +08:00
Jyong 80c94f02e9
add vector field for other vectordb (#7051) 2024-08-07 17:14:03 +08:00
-LAN- aad02113c6
fix(api/core/app/segments): Allow to contains boolean value in object segment (#7047) 2024-08-07 16:20:22 +08:00
chenxu9741 72c75b75cf
feat: Add hyperlink parsing to the DOCX document. (#7017) 2024-08-07 16:01:14 +08:00
Sadegh Ghanbari Shohani ffa992acf7
Add support for i18n Farsi language (fa-IR) (#7044) 2024-08-07 15:44:42 +08:00
majian 99b78dd198
feat: add gpt-4o-2024-08-06 (#7046) 2024-08-07 15:35:57 +08:00
Sangmin Ahn 7f81a86e9e
chore: show non-English characters in exported DSL files (#7042) 2024-08-07 14:03:15 +08:00
Achim a93bc83c8d
Provide output data also in json property of workflow tool (#6924) (#7027) 2024-08-07 08:54:51 +08:00
crazywoola 3516989738
fix: typos in wenxin llm (#7021) 2024-08-06 22:33:03 +08:00
Sa Zhang 26991443ed
fix: Fix incorrect context size for jina-reranker-v2 model (#7006) 2024-08-06 21:08:29 +08:00
Bryan eece50acec
fix: tran list issue (#7009)
Co-authored-by: libing <libing@healink.cn>
2024-08-06 21:01:38 +08:00
Jyong 28d4e5b045
Fix/reranking mode is null (#7012) 2024-08-06 19:12:04 +08:00
yanghx c53875ce8c
fix #6902 .docx handles images within tables and handles cross-column tables (#6951) 2024-08-06 17:14:24 +08:00
灰灰 96dcf0fe8a
fix: code tool fails when null property exists in object (#6988) 2024-08-06 16:11:00 +08:00
Yefori bd3ed89516
feat: add function calling for deepseek models (#6990) 2024-08-06 13:37:27 +08:00
小羽 23ed15d19f
feat:nvidia add nemotron4-340b and microsoft/phi-3 (#6973) 2024-08-06 10:16:41 +08:00
非法操作 312d905c9b
chore: update duckduckgo tool (#6983) 2024-08-06 10:16:04 +08:00
takatost d839f1ada7
version to 0.6.16 (#6972) 2024-08-05 23:33:37 +08:00
takatost 6da14c2d48
security: fix api image security issues (#6971) 2024-08-05 20:21:08 +08:00
Pedro Gomes a34285196b
Revise the wrong pricing of certain LLM models. (#6967) 2024-08-05 18:41:44 +08:00
takatost ea30174057
chore: optimize streaming tts of xinference (#6966) 2024-08-05 18:23:23 +08:00
Sangmin Ahn dd676866aa
chore: exclude .txt extenstion in create_by_text API (#6956) 2024-08-05 15:52:07 +08:00
TzuxinChen f0d10553b4
Fixed a bug where permission was clearly displaye… (#6934) 2024-08-05 13:19:01 +08:00
liuzhenghua ef616c604a
fix: The permissions issue of the editor role accessing some backend … (#6945)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-05 12:55:55 +08:00
Bowen Liang f656e1bae2
fix: ensure db migration in docker entry script running with `upgrade-db` command for proper locking (#6946) 2024-08-05 10:55:26 +08:00
liuzhenghua 141e4e0276
fix: restore xinference secret field (#6941)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-04 22:32:24 +08:00
Pedro Gomes 20d3e1d297
Fix increase_usage of total_price in agent_runner (#6688) 2024-08-04 14:42:22 +08:00
chenxu9741 dff3f41ef6
Workflow TTS playback node filtering issue. (#6877) 2024-08-04 14:28:56 +08:00
Weaxs 5e634a59a2
compatible xinference reranker server (#6927) 2024-08-04 13:49:38 +08:00
Joe 26e46d365c
fix: workflow trace user_id error (#6932) 2024-08-04 03:28:50 +08:00
takatost bcd7c8e921
fix: sending app trace data to other app trace provider (#6931) 2024-08-04 00:05:51 +08:00
Bowen Liang 70283f5b9f
dep: support for Python 3.12 (#6771) 2024-08-02 21:14:36 +08:00
JuHyung Son 2e941bb91c
add new provider Solar (#6884) 2024-08-02 20:48:09 +08:00
zhuhao 541bf1db5a
feat: add the tool Serper for Google search. (#6786) (#6790) 2024-08-02 20:37:04 +08:00
Jyong 048bc4c06e
fix update dataset failed when embedding model is not exist (#6920) 2024-08-02 20:30:22 +08:00
Joe f97a51ce24
fix: reranking disable timer error (#6910) 2024-08-02 16:34:50 +08:00
Bowen Liang 6aa02f8c63
dep: bump pgvecto-rs client from 0.1.x to 0.2.x (#6891) 2024-08-02 15:51:23 +08:00
crazywoola 7ab04e17e7
fix: return code in service api (#6911) 2024-08-02 15:48:58 +08:00
非法操作 bf3f1027c8
fix: code execution node not display clear reasons when sandbox res error (#6830) 2024-08-02 15:36:44 +08:00
sino 8166a8caf5
feat: update llama3.1 parameters for openrouter (#6901) 2024-08-02 13:13:34 +08:00
Jyong 44801df8f8
fix score threshold limit be None (#6900) 2024-08-02 12:10:51 +08:00
灰灰 56af1a0adf
pref: change ollama embedded api request (#6876) 2024-08-02 12:04:47 +08:00
dufei f8617db012
fix tongyi tool calls (#6896) 2024-08-02 10:03:43 +08:00
Jyong 2ab9af3b38
delete weight_type in knowledge retrieval node (#6892) 2024-08-01 21:38:59 +08:00
Weaxs cc4785f094
fix: xinference reranker return_documents (#6888) 2024-08-01 19:57:53 +08:00
ian 093f902335
fix: Change API key authentication failure response code from 404 to 401 (#6885) 2024-08-01 17:41:35 +08:00
hursit 104c797dd0
feat: Add support for i18n Turkish language (tr-TR) (#6886)
Co-authored-by: hursit <hursit.topal@enuygun.com>
2024-08-01 17:30:35 +08:00
chenxu9741 a9cd6df97e
Remove tts (blocking call) (#6869) 2024-08-01 14:50:22 +08:00
呆萌闷油瓶 f31142e758
Azure 4o mini options (#6873) 2024-08-01 14:04:18 +08:00
crazywoola 792f908afb
Revert "feat:Azure gpt4o mini" (#6870) 2024-08-01 13:32:03 +08:00
非法操作 29e3c3061c
fix: remote image not display in answer node (#6867) 2024-08-01 13:21:49 +08:00
呆萌闷油瓶 14367ddc09
feat:Azure gpt4o mini (#6866) 2024-08-01 13:03:08 +08:00
Jyong 8157fccf6d
delete weight_type (#6865) 2024-08-01 13:02:33 +08:00
Charlie.Wei cbf7f21ade
Add azure gpt4omini (#6862)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-08-01 12:57:52 +08:00
Weaxs f6e8e120a1
support xinference tts (#6746) 2024-08-01 11:59:15 +08:00
Joe 08f922d8c9
fix: anthropic max token NoneType error (#6858) 2024-08-01 11:30:00 +08:00
-LAN- feb4576ee7
chore: update SQLAlchemy configuration with custom naming convention (#6854) 2024-08-01 11:16:49 +08:00
小羽 56b43f62d1
feat: nvidia add llama3.1 model (#6844) 2024-07-31 21:24:02 +08:00
Giga Group 4b410494b3
Add model parameter enable_enhance for hunyuan llm model (#6847)
Co-authored-by: sun <sun@centen.cn>
2024-07-31 20:04:43 +08:00
Joe df9bd36cab
fix: claude-3-5-sonnet-20240620 max token error (#6843) 2024-07-31 18:34:44 +08:00
Jyong af76381b98
fix notion internal setting (#6836) 2024-07-31 17:17:46 +08:00
William Espegren 4be12b29b9
fix: improved error handling for spider tool (#6835) 2024-07-31 17:11:52 +08:00
ybalbert001 c23aa50bea
Add AWS builtin Tools (#6721)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-31 14:41:42 +08:00
Nam Vu 8eb0d0fddd
feat: support Celery auto-scale (#6249)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-31 14:34:44 +08:00
Ever 545d3c5a93
chore: Add processId field for metrics of threads/db-pool-stat/health (#6797)
Co-authored-by: 老潮 <zhangyongsheng@3vjia.com>
Co-authored-by: takatost <takatost@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-31 00:21:16 +08:00
crazywoola 3c371a6cb0
fix: workflow api (#6810) 2024-07-30 23:51:48 +08:00
longzhihun 9ce5cea911
feat: bedrock invoke enhancement (#6808) 2024-07-30 21:57:18 +08:00
eric-0x72 98d9837fbc
fix wrong charset when decoding Chinese content (#6774)
Co-authored-by: zhangwb <zhangwb@zts.com.cn>
2024-07-30 21:32:45 +08:00
Yeuoly 72963d1f13
fix: nonetype in webscraper validation (#6788) 2024-07-30 14:45:14 +08:00
-LAN- a98284b1ef
refactor(api): Switch to `dify_config` (#6750)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-30 11:15:26 +08:00
Bowen Liang daa31b2cb3
chore: remove redundant version pinning for indirect dependencies (#6772) 2024-07-30 08:45:57 +08:00
Bowen Liang b414ea41d6
dep: initial support for Milvus 2.4.x (#6084) 2024-07-29 19:56:45 +08:00
Joe f78d0082ae
feat: implement function dispatch table for trace processing (#6628) 2024-07-29 18:47:25 +08:00
SiliconFlow, Inc 3e18d32ce5
add deepseek-coder-v2 in siliconflow (#6149) 2024-07-29 18:45:19 +08:00
Charles 94d68b6a08
upgrade deepseek params (#6744) 2024-07-29 18:31:56 +08:00
Giga Group c9ff0e3961
Add model hunyuan-embedding (#6657)
Co-authored-by: sun <sun@centen.cn>
2024-07-29 18:30:52 +08:00
-LAN- 8dd68e2034
fix(api/core/moderation/output_moderation.py): Fix config call. (#6769) 2024-07-29 18:30:29 +08:00
Bowen Liang cb01bf2986
chore: set logging level to debug when reading YAML files and falling back to default value in case of None (#6758) 2024-07-29 13:40:18 +08:00
Bowen Liang 20268708cc
chore: improve position map conversion and tolerate empty position yaml file (#6541) 2024-07-29 10:32:11 +08:00
Vicky Guo 829472a1d7
switch to diffy_config with Pydantic in files, moderation and app (#6747)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-29 02:57:45 +08:00
Hiroshige Aoki e23461c837
Fix/6615 40 varchar limit on DatasetCollectionBinding and Embedding model name (#6723) 2024-07-28 09:42:58 +08:00
非法操作 21f6caacd4
feat: enhance the firecrawl tool (#6705) 2024-07-27 15:00:06 +08:00
-LAN- 6a3bef8378
feat(api/core/app/segments): Update segment types and variables (#6734)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:51 +08:00
-LAN- b6c3010f02
refactor(api/core/workflow/nodes/base_node.py): Update extract_variable_selector_to_variable_mapping method signature. (#6733)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:25 +08:00
crazywoola 90d2c01218
Feat/6725 can not get image url from cogview tool (#6728) 2024-07-27 00:07:31 +08:00
-LAN- 83af50368f
fix(api/core/model_runtime/model_providers/azure_openai/llm/llm.py): Try to skip if `delta.delta` is None. (#6727)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 00:05:21 +08:00
Jyong cf258b7a67
add xlsx support hyperlink extract (#6722) 2024-07-26 19:26:52 +08:00
-LAN- 5d77dc4f58
feat(api/core/app/segments/parser.py): Remove blank segment in `convert_template` (#6709)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 18:19:33 +08:00
Joe e4542215cc
fix: tongyi empty tool_calls is not supported in message (#6719) 2024-07-26 18:10:13 +08:00
Jason 3d3677e912
Feat/model provider novita (#6717)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-26 17:37:21 +08:00