Commit Graph

2142 Commits

Author SHA1 Message Date
jyong 19c526120c external knowledge api 2024-09-19 17:07:33 +08:00
takatost ffd2f61dd9
fix: thread_pool submit count in parallel workflow not releasing (#8549) 2024-09-19 15:34:56 +08:00
takatost 54b9e1f6d1
fix: ci issues(missing duckduckgo-search==6.2.11, ruff lint issue) (#8543) 2024-09-19 11:43:00 +08:00
jyong 37f7d5732a external knowledge api 2024-09-18 15:29:30 +08:00
Wang Bo 6f222b49f2
refactor: rename task_type to task for jina embeddings v3 (#8488) 2024-09-18 14:53:15 +08:00
jyong dcb033d221 Merge branch 'main' into feat/external-knowledge
# Conflicts:
#	api/core/rag/datasource/retrieval_service.py
#	api/models/dataset.py
#	api/services/dataset_service.py
2024-09-18 14:40:43 +08:00
-LAN- 8dfe8c773a
chore: Deprecate gpt-3.5-turbo-0613 and gpt-3.5-turbo-16k-0613 models (#8500) 2024-09-18 14:38:09 +08:00
jyong 9f894bb3b3 external knowledge api 2024-09-18 14:36:51 +08:00
Qun cf645c3ba1
feat: Add ComfyUI tool for Stable Diffusion (#8160) 2024-09-18 10:56:29 +08:00
Xiao Ley 6dba68f62d
feat: Add base URL settings and secure_ascii options to the Brave search tool (#8463)
Co-authored-by: crazywoola <427733928@qq.com>
2024-09-15 17:38:43 +08:00
非法操作 3d083b758f
feat: add flux dev of siliconflow image-gen tool (#8450) 2024-09-15 17:14:12 +08:00
takatost bf16de50fe
fix: internal error when tool authorization (#8449) 2024-09-14 21:50:02 +08:00
Jyong 7e611ffbf3
multi-retrival use dataset's top-k (#8416) 2024-09-14 21:48:44 +08:00
走在修行的大街上 72b7f8a949
Bugfix/fix feishu plugins (#8443)
Co-authored-by: 黎斌 <libin.23@bytedance.com>
2024-09-14 18:59:06 +08:00
takatost 88c9834ef2
chore(workflow): Optimize the iteration when selecting a variable from a branch in the output variable causes iteration index err (#8440) 2024-09-14 18:02:43 +08:00
ybalbert001 b6ad7a1e06
Fix: https://github.com/langgenius/dify/issues/8190 (Update Model nam… (#8426)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-09-14 17:14:18 +08:00
Aaron Ji 6f7625fa47
chore: update Jina embedding model (#8376) 2024-09-14 16:21:17 +08:00
takatost f01602b570
fix(workflow): the answer node after the iteration node containing the answer was output prematurely (#8419) 2024-09-14 14:02:09 +08:00
HowardChan 0123498452
fix:logs and rm unused codes in CacheEmbedding (#8409) 2024-09-14 12:56:45 +08:00
swingchen01 f55e06d8bf
fix: resolve runtime error when self.folder is None (#8401)
Co-authored-by: 陈长君 <chenchangjun@shuwen.com>
2024-09-14 11:07:16 +08:00
ybalbert001 b613b11422
Fix: Support Bedrock cross region inference #8190 (Update Model name to distinguish between different region groups) (#8402)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-09-14 11:06:20 +08:00
Nam Vu bf55b1910f
fix: pyproject.toml typo (#8396) 2024-09-14 09:45:49 +08:00
crazywoola 71b4480c4a
fix: o1-mini 65563 -> 65536 (#8388) 2024-09-14 02:39:58 +08:00
Yeuoly b6b1057a18
fix: sandbox issue related httpx and requests (#8397) 2024-09-14 02:02:55 +08:00
Bowen Liang 5b98acde2f
chore: improve usage of striping prefix or suffix of string with Ruff 0.6.5 (#8392) 2024-09-13 23:34:39 +08:00
Bowen Liang aad6f340b3
fix (#8322 followup): resolve the violation of pylint rules (#8391) 2024-09-13 23:19:36 +08:00
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2024-09-13 22:42:08 +08:00
xiandan-erizo 1ab81b4972
support hunyuan-turbo (#8372)
Co-authored-by: sunkesi <sunkesi@hosecloud.com>
2024-09-13 20:21:48 +08:00
非法操作 06b66216d7
chore: update firecrawl scrape to V1 api (#8367) 2024-09-13 20:02:00 +08:00
takatost cd3eaed335
fix(workflow): both parallel and single branch errors occur in if-else (#8378) 2024-09-13 19:55:54 +08:00
Joe 84ac5ccc8f
fix: add before send to remove langfuse defaultErrorResponse (#8361) 2024-09-13 16:08:08 +08:00
takatost 24af4b9313
fix: o1-series model encounters an error when the generate mode is blocking (#8363) 2024-09-13 15:37:54 +08:00
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2024-09-13 14:24:49 +08:00
-LAN- 08c486452f
fix: score_threshold handling in vector search methods (#8356) 2024-09-13 14:24:35 +08:00
sino a45ac6ab98
fix: ark token usage is none (#8351) 2024-09-13 14:19:24 +08:00
-LAN- 80a322aaa2
chore: update version to 0.8.2 in packaging and docker-compose files (#8352) 2024-09-13 13:45:13 +08:00
Joe 82f7875a52
feat: add langfuse sentry ignore error (#8353) 2024-09-13 13:44:19 +08:00
takatost 4637ddaa7f
feat: add o1-series models support in Agent App (ReACT only) (#8350) 2024-09-13 13:08:27 +08:00
fanlia 5f03e66489
Feature/service api workflow logs (#8323) 2024-09-13 11:03:57 +08:00
Jyong 49cee773c5
fixed score threshold is none (#8342) 2024-09-13 10:21:58 +08:00
jyong 89e81873c4 merge error 2024-09-13 09:49:24 +08:00
-LAN- c78828ab7c
chore: update Dify version to 0.8.1 (#8329) 2024-09-13 02:48:24 +08:00
takatost e90d3c29ab
feat: add OpenAI o1 series models support (#8328) 2024-09-13 02:15:19 +08:00
Nam Vu 153807f243
fix: response_format label (#8326) 2024-09-12 23:17:29 +08:00
Ikko Eltociear Ashimine 5db0b56c5b
docs: update lambda_translate_utils.yaml (#8293) 2024-09-12 20:33:07 +08:00
Tamer 404db1ae5b
Fix VariableEntityType Bug external-data-tool -> external_data_tool (#8299) 2024-09-12 20:27:55 +08:00
呆萌闷油瓶 02c4b1af71
chore:add Azure openai api version 2024-08-01-preview (#8291) 2024-09-12 20:22:57 +08:00
ybalbert001 d4985fb3aa
Fix: Support Bedrock cross region inference [#8190](https://github.com/langgenius/dify/issues/8190) (#8317) 2024-09-12 19:15:20 +08:00
Bowen Liang 8815511ccb
chore: apply flake8-pytest-style linter rules (#8307) 2024-09-12 18:09:16 +08:00
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2024-09-12 15:50:49 +08:00
Bowen Liang c69f5b07ba
chore: apply ruff E501 line-too-long linter rule (#8275)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 14:00:36 +08:00
takatost 56c90e212a
fix(workflow): missing content in the answer node stream output during iterations (#8292)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 13:59:48 +08:00
Bowen Liang 0f14873255
chore: cleanup ruff flake8-simplify linter rules (#8286)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 12:55:45 +08:00
Bowen Liang 781d294f49
chore: cleanup pycodestyle E rules (#8269) 2024-09-11 18:55:00 +08:00
yalei f515af2232
let claude models in bedrock support the response_format parameter (#8220)
Co-authored-by: duyalei <>
2024-09-11 18:24:50 +08:00
crazywoola 4d2cd6703b
chore: remove useless code (#8198) 2024-09-11 18:19:34 +08:00
jyong 9ca0e56a8a external dataset binding 2024-09-11 16:59:19 +08:00
Bowen Liang 292220c596
chore: apply pep8-naming rules for naming convention (#8261) 2024-09-11 16:40:52 +08:00
HowardChan 53f37a6704
fix:ollama text embedding 500 error (#8252) 2024-09-11 16:23:19 +08:00
Leo.Wang 75c1a82556
Update Gitlab query field, add query by path (#8244) 2024-09-11 16:09:53 +08:00
Jason Tan c5b3777d93
editor can also create api key (#8214) 2024-09-11 16:07:15 +08:00
Nam Vu 342607f4a4
fix: truthy value (#8208) 2024-09-11 15:44:53 +08:00
takatost 5f4cdd66fa
fix(workflow): IF-ELSE nodes connected to the same subsequent node cause execution to stop (#8247) 2024-09-11 12:28:32 +08:00
HowardChan 82c42b9ec5
fix:error when adding the ollama embedding model (#8236)
Co-authored-by: crazywoola <427733928@qq.com>
2024-09-11 10:25:45 +08:00
takatost cee0c51dbb
feat: add from_variable_selector for stream chunk / message event (#8228) 2024-09-10 22:15:50 +08:00
takatost fdbbdb706f
fix(workflow): answers are output simultaneously across different braches in the question classifier node. (#8225) 2024-09-10 21:11:35 +08:00
takatost f6dfe23cf8
fix(workflow): in multi-parallel execution with multiple conditional branches (#8221) 2024-09-10 21:09:18 +08:00
Jyong bb3002b173
revert page column (#8217) 2024-09-10 18:21:22 +08:00
Bowen Liang d109881410
chore(api/models): apply ruff reformatting (#7600)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-10 17:08:06 +08:00
Bowen Liang 2cf1187b32
chore(api/core): apply ruff reformatting (#7624) 2024-09-10 17:00:20 +08:00
takatost dabfd74622
feat: Parallel Execution of Nodes in Workflows (#8192)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Yi <yxiaoisme@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-10 15:23:16 +08:00
-LAN- ed37439ef7
refactor(api/core): Improve type hints and apply ruff formatter in agent runner and model manager. (#8166) 2024-09-10 15:00:25 +08:00
Jyong af92f19291
filter excel empty sheet (#8194) 2024-09-10 14:55:08 +08:00
zhuhao 86f7f245e4
fix: The length of the tag should between 1 and 50 (#8187) (#8188) 2024-09-10 14:07:06 +08:00
Jyong 2d690801d1
nvidia rerank top n missed (#8185) 2024-09-10 13:17:48 +08:00
Nam Vu fede54be77
fix: Version '2.6.2-2' for 'expat' was not found (#8182) 2024-09-10 13:00:37 +08:00
Jyong 85ff82a694
code merge error (#8183)
Co-authored-by: crazywoola <427733928@qq.com>
2024-09-10 12:52:50 +08:00
ice yao c8df92d0eb
add volcengine tos storage (#8164) 2024-09-10 09:19:47 +08:00
-LAN- 4313d92e6b
feat(api/core/model_runtime/entities/defaults.py): Add TOP_K in default parameters. (#8167) 2024-09-10 09:11:31 +08:00
Nam Vu 0695543f63
Fix variable typo (cont) (#8161) 2024-09-09 23:46:13 +08:00
crazywoola 0bec6a037c
update qwen-long (#8157) 2024-09-09 19:09:42 +08:00
jyong e7c77d961b Merge branch 'main' into feat/external-knowledge
# Conflicts:
#	api/controllers/console/auth/data_source_oauth.py
2024-09-09 15:54:43 +08:00
AAEE86 fa34b9aed6
Modify model parameters in Spark LLMs and zhipuai LLMs (#8078)
Co-authored-by: Charlie.Wei <luowei@cvte.com>
2024-09-09 15:36:47 +08:00
crazywoola a27d4d58ec
fix: ollama text embedding 500 error (#8131) 2024-09-09 15:27:49 +08:00
邹成卓 a15791e788
Fix: tongyi code wrapper works not stable (#7871)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-09-09 11:15:17 +08:00
ybalbert001 954580a4af
feat: support more model types and builtin tools on aws/sagemaker (#8061)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
2024-09-09 10:34:11 +08:00
crazywoola ab7d79275e
fix: Claude can not validate credientials (#8109) 2024-09-09 10:22:42 +08:00
呆萌闷油瓶 d28446301f
feat:add fishaudio in xinference (#8100) 2024-09-08 23:58:02 +08:00
Charlie.Wei feefeb44d7
fix LangSmith project config error (#7996) 2024-09-08 13:25:27 +08:00
Zhi d542b15cc0
feat: support redis sentinel mode (#7756) 2024-09-08 13:23:51 +08:00
Nam Vu 2d7954c7da
Fix variable typo (#8084) 2024-09-08 13:14:11 +08:00
AAEE86 0cef25ef8c
Revert "fix: parameter rule" (#8070) 2024-09-07 10:44:56 +08:00
crazywoola 900fd82a92
fix: parameter rule (#8064) 2024-09-06 19:15:24 +08:00
crazywoola 44f963f281
If else add regexmatch (#8059)
Co-authored-by: 罗威 <luowei@cvte.com>
2024-09-06 18:35:51 +08:00
Charlie.Wei 01858e1caf
ifEsle node add regex match (#8007) 2024-09-06 17:44:09 +08:00
ChengZi 2060db8e11
fix: change milvus init args from (host, port) to (url, token) (#8019)
Signed-off-by: ChengZi <chen.zhang@zilliz.com>
2024-09-06 17:32:48 +08:00
Nam Vu 9ded063417
chore: #7348, support query conversations by updated_at (#8047) 2024-09-06 17:31:51 +08:00
tmuife 89aede80cc
Add OCI(Oracle Cloud Infrastructure) Generative AI Service as a Model Provider (#7775)
Co-authored-by: Walter Jin <jinshuhaicc@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: walter from vm <walter.jin@oracle.com>
2024-09-06 14:15:40 +08:00
zhuhao e0d3cd91c6
support huawei cloud obs storage (#7980) (#7981) 2024-09-06 14:00:47 +08:00
Byeongjin Kang d489b8b3e0
feat: return page number of pdf documents upon retrieval (#7749) 2024-09-05 16:43:26 +08:00
Leng Yue bd0992275c
feat: support fish audio TTS (#7982) 2024-09-05 14:18:39 +08:00
非法操作 3e7597f2bd
feat: add gpt-4o-2024-08-06 and json_schema for azure openAI service (#7648) 2024-09-04 21:56:08 +08:00
Jyong 0e71f6db84
fix spliter length missed (#7987) 2024-09-04 21:47:12 +08:00
wochuideng f6b9982c23
Concurrent calls to the Wenxin model, and the exception problem when obtaining the token is fixed (#7976)
Co-authored-by: puqs1 <puqs1@lenovo.com>
2024-09-04 21:44:57 +08:00
Jyong 15791510c8
fix wrong error message (#7972) 2024-09-04 16:46:41 +08:00
非法操作 0f72a8e89d
chore: refactor the beichuan model (#7953) 2024-09-04 16:22:31 +08:00
KVOJJJin 14af87527f
Feat:remove estimation of embedding cost (#7950)
Co-authored-by: jyong <718720800@qq.com>
2024-09-04 14:41:47 +08:00
呆萌闷油瓶 83494cb4f5
fix:empty voice occurs when xinference CosyVoice tts model (#7958) 2024-09-04 13:04:31 +08:00
Sumkor 571415d1a4
fix: split text keep separator (#7930) 2024-09-04 12:59:10 +08:00
Joe fee4d3f6ca
feat: ops trace add llm model (#7306) 2024-09-04 10:39:00 +08:00
takatost 161cc0cda9
Revert "fix: an issue of keyword search feature in application log list" (#7949) 2024-09-04 10:00:55 +08:00
陳鈞 80d14c9b22
fix(api): Code-Based Extension cause error on position map sorting (#7934)
Signed-off-by: 陳鈞 <jim60105@gmail.com>
2024-09-04 08:41:12 +08:00
crazywoola 596f160a1e
Chore/add default step 1x url (#7933) 2024-09-04 08:32:22 +08:00
Jyong d8b6c053a2
fix rerank model value is empty string (#7937) 2024-09-03 21:25:21 +08:00
Jyong 1a5116cba0
Fix/segment create with api (#7928) 2024-09-03 18:14:47 +08:00
Jyong 01581dd35f
improve the notion table extract (#7925) 2024-09-03 17:52:07 +08:00
-LAN- 8986be0aab
chore: Update versions to 0.7.3 (#7895) 2024-09-03 09:49:32 +08:00
-LAN- f76bbbf5e6
chore(Dockerfile): Bump expat to 2.6.2-2 (#7904) 2024-09-03 09:48:30 +08:00
kurokobo 80aa7c4019
feat: allow users to use the app icon as the answer icon (#7888)
Co-authored-by: crazywoola <427733928@qq.com>
2024-09-02 20:00:41 +08:00
Jyong 6f33351eb3
ignore linked images when image id is none (#7890) 2024-09-02 19:37:05 +08:00
Fei He a8b9e01b3e
fix: fixed typo on loading reranking_mode (#7887) 2024-09-02 16:18:47 +08:00
Joshua 7193e189f3
Add perplexity search as a new tool (#7861) 2024-09-02 14:48:13 +08:00
orangeclk 3f2a806abe
fix: glm models prices and max_tokens correction (#7882) 2024-09-02 14:29:09 +08:00
omr bf63c5d1e3
fix typo: langauge -> language (#7875) 2024-09-02 08:41:45 +08:00
Seayon 78989e9049
Add ALIYUN_OSS_PATH configuration for Aliyun OSS (#7864)
Co-authored-by: seayon <zhaoxuyang@shouqianba.com>
2024-09-01 21:30:17 +08:00
sino 1f56a20b62
feat: support auth by api key for ark provider (#7845) 2024-08-31 10:56:32 +08:00
Bowen Liang 0c2a62f847
fix: correct http timeout configs‘ default values and ignorance by HttpRequestNode (#7762) 2024-08-30 19:09:10 +08:00
Ethan ea748b50f2
fix: an issue of keyword search feature in application log list (#7816) 2024-08-30 18:48:05 +08:00
Zhi ceb2b150ff
enhance: include workspace name in create-tenant command (#7834) 2024-08-30 15:53:50 +08:00
非法操作 dc015c380a
feat: add zhipu glm_4_plus and glm_4v_plus model (#7824) 2024-08-30 15:08:31 +08:00
YidaHu bd6d4d0553
fix: filter out installed apps without an app (#7799) 2024-08-29 19:03:08 +08:00
hisir f0273f00e1
Fixed when testing the openai compatible interface model, an error is reported when no object is returned (#7808) 2024-08-29 18:58:19 +08:00
Yeuoly 962cdbbebd
chore: add app generator overload (#7792) 2024-08-29 16:04:01 +08:00
Jyong 8e311cc45c
fixed permission is None (#7788) 2024-08-29 12:46:42 +08:00
crazywoola c441bea4d1
fix: datasets permission is missing (#7787) 2024-08-29 12:46:33 +08:00
takatost 0e0a703496
chore: ignore openai error record in sentry (#7770) 2024-08-28 23:26:11 +08:00
Garfield Dai 54b693d5b1
feat: update saas billing hint. (#7760) 2024-08-28 18:55:47 +08:00
Bowen Liang 1262277714
chore: improve http executor configs (#7730) 2024-08-28 17:46:37 +08:00
zhuhao 26abbe8e5b
feat(Tools): add a tool to query the stock price from Alpha Vantage (#7019) (#7752) 2024-08-28 17:27:20 +08:00
Leheng Lu 5d0914daea
fix: not able to pass array of string/number/object into variable aggregator groups (#7757) 2024-08-28 17:25:20 +08:00
crazywoola 3a071b8db9
fix: datasets permission is missing (#7751) 2024-08-28 15:36:11 +08:00
snickerjp 9342b4b951
Update package "libldap-2.5-0" for docker build. (#7726) 2024-08-28 14:44:05 +08:00
Vimpas 4682e0ac7c
fix(storage): 🐛 HeadBucket Operation Permission (#7733)
Co-authored-by: 莫岳恒 <moyueheng@datagrand.com>
2024-08-28 13:57:45 +08:00
sino 7cfebffbb8
chore: update default endpoint for ark provider (#7741) 2024-08-28 13:56:50 +08:00
kurokobo bc3a8e0ca2
feat: store created_by and updated_by for apps, modelconfigs, and sites (#7613) 2024-08-28 08:47:30 +08:00
Jiakun Xu e38334cfd2
fix: doc_language return null when document segment settings (#7719) 2024-08-28 08:45:51 +08:00
走在修行的大街上 92cab33b73
feat(Tools): add feishu document and message plugins (#6435)
Co-authored-by: 黎斌 <libin.23@bytedance.com>
2024-08-27 20:21:42 +08:00
Bowen Liang 3f467613fc
feat: support configs for code execution request (#7704) 2024-08-27 19:38:33 +08:00
crazywoola da326baa5e
fix: tongyi Error: 'NoneType' object is not subscriptable (#7705) 2024-08-27 16:56:06 +08:00
Jyong 60001a62c4
fixed chunk_overlap is None (#7703) 2024-08-27 16:38:06 +08:00