opensource
/
dify
mirror of https://github.com/langgenius/dify.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,344 Commits 288 Branches 160 Tags 496 MiB
Commit Graph

2798 Commits

Author SHA1 Message Date
Hiroshi Fujita d2586278d6
Feat elasticsearch japanese (#12194) 2025-01-08 12:35:41 +08:00
crazywoola 6222179a57
Revert "fix:deepseek tool call not working correctly" (#12463) 2025-01-08 10:50:34 +08:00
Jyong 05bda6f38d
add tidb on qdrant redis lock (#12462) 2025-01-08 08:55:44 +08:00
非法操作 67228c9b26
fix: url with variable not work (#12452) 2025-01-07 21:55:51 +08:00
Infinitnet 4e6c86341d
Add 'document' feature to Sonnet 3.5 through OpenRouter (#12444) 2025-01-07 19:51:38 +08:00
ybalbert001 2a14c67edc
Fix #12448 - update bedrock retrieve tool, support hybrid search type and re… (#12446) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2025-01-07 19:51:23 +08:00
hisir 41f39bf3fc
Fix newline characters in tables during document parsing (#12112) 
Co-authored-by: hisir <admin@qq.com>
 2025-01-07 17:26:24 +08:00
呆萌闷油瓶 9677144015
fix:deepseek tool call not working correctly (#12437) 2025-01-07 17:25:38 +08:00
SiliconFlow, Inc 15797c556f
add fish-speech-1.5 from siliconflow (#12425) 2025-01-07 15:27:34 +08:00
-LAN- d3f5b1cbb6
refactor: use tiktoken for token calculation (#12416) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-01-07 13:32:30 +08:00
SiliconFlow, Inc dc650c5368
Fixes #12414: Add cheaper model and long context model for Qwen2.5-72B-Instruct from siliconflow (#12415) 2025-01-07 11:28:24 +08:00
Alex Chen 2bb521b135
Support TTS and Speech2Text for Model Provider GPUStack (#12381) 2025-01-07 09:42:11 +08:00
SiliconFlow, Inc 409cc7d9b0
mark deprecated models in siliconflow #12399 (#12405) 
Co-authored-by: crazywoola <427733928@qq.com>
 2025-01-07 09:08:58 +08:00
yihong fe26be2312
fix: http method can be upper case and lower case close #11877 (#12401) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-01-06 20:35:53 +08:00
Warren Chen 147d578922
[Fix] revert sagemaker llm to support model hub (#12378) 2025-01-06 18:01:45 +08:00
huangzhuo1949 70698024f5
fix: empty delete bug (#12339) 
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
 2025-01-03 20:46:39 +08:00
方程 6df17a334c
fix: Update the API call address for the text_embedding model (#12342) 
Co-authored-by: 方程 <fangcheng@oschina.cn>
 2025-01-03 19:19:17 +08:00
-LAN- 7ed6485f86
refactor: streamline initialization of application_generate_entity and task_state in task pipeline classes (#12326) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-01-03 18:41:44 +08:00
jifei 3c2e30f348
fix: #12143 support streaming mode content start with "data:" (#12171) 2025-01-03 16:33:37 +08:00
Jyong b873e6349c
add child chunk preview number limit (#12309) 2025-01-03 16:14:27 +08:00
丹枫染秋色 7c1961e618
feat: Add response format support to GLM-4 (#12252) 2025-01-03 09:38:50 +08:00
xander-art baeddd4d15
feat:Add support for stop parameter in hunyuan model #12313 (#12315) 
Co-authored-by: xander-art <xander-art@gmail.com>
 2025-01-03 09:15:04 +08:00
-LAN- 6f5a8a33d9
refactor: replace gevent threadpool with ProcessPoolExecutor in GPT2Tokenizer (#12316) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2025-01-03 09:13:18 +08:00
Yingchun Lai c135967e59
refactor: simplify some exception catch code (#12246) 2025-01-02 14:25:12 +08:00
Giovanny Gutiérrez d7c0bc8c23
feat: Add response format support for openai compat models (#12240) 
Co-authored-by: Gio Gutierrez <giovannygutierrez@gmail.com>
 2025-01-02 09:59:34 +08:00
yihong f30bf08580
fix: close #12215 for yi special case (#12222) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-01-02 09:58:34 +08:00
Warren Chen 9954ddb780
[Fix] modify sagemaker llm (#12274) 2025-01-02 09:49:11 +08:00
非法操作 b218df6920
fix: draft run single node can't get env variable (#12266) 2025-01-01 13:31:44 +08:00
-LAN- c7911c7130
fix: improve JSON parsing error handling in Executor class (#12265) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-31 17:03:07 +08:00
-LAN- 62f792ea14
fix: ensure workflow_run_id is always set and improve handling in Wor… (#12264) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-31 17:02:44 +08:00
-LAN- 6a85960605
feat: implement asynchronous token counting in GPT2Tokenizer (#12239) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-31 17:02:08 +08:00
-LAN- 634b382a3d
fix: enhance ToolEngineInvokeError to include meta information (#12238) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-31 14:01:24 +08:00
-LAN- d4b848272e
fix: apply gevent threading patch early and ensure unique workflow node execution IDs (#12196) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-31 11:42:51 +08:00
Warren Chen fc29f2003e
translate comments (#12234) 2024-12-31 00:36:03 +08:00
Warren Chen 562450751f
[Fix] Fix sagemaker_chinese_toxicity_detector and bedrock_retrieve (#12227) 2024-12-30 22:26:04 +08:00
-LAN- 8d15c8cfbf
fix: improve error handling in NotionExtractor data fetching (#12182) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-29 11:53:09 +08:00
呆萌闷油瓶 bd2fec4813
fix: #12125 (#12184) 2024-12-29 11:52:12 +08:00
非法操作 b66c03dfe9
fix: workflow_as_tool output files raise error (#12061) 2024-12-27 20:33:28 +08:00
Kepler 2a909e634b
feat: support Ernie-lite-pro-128k (#12161) 
Co-authored-by: bigfish49 <bigfish49@126.com>
 2024-12-27 20:23:46 +08:00
非法操作 309fd76ddf
fix: comfyui output image's format (#12121) 2024-12-27 20:20:03 +08:00
ybalbert001 0fdb39f1c3
Fix: The topk parameter doesn't work in sagemaker rerank tool (#12150) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-12-27 14:42:25 +08:00
-LAN- dae1b5a619
fix: import jieba.analyse (#12133) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-27 11:37:55 +08:00
-LAN- 26b5680913
fix: improve merge branch node ID checks in graph engine (#12128) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-26 23:33:45 +08:00
yihong 8339d2c7c9
fix: issue #11868 bring old logic back (#12100) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-26 12:17:55 +08:00
Jyong 811e4bd0cf
fix unstructured setting (#12116) 2024-12-26 12:08:36 +08:00
yihong efdd54a670
fix: issue #12068 by test is answer in the ids (#12105) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-26 10:31:05 +08:00
Jyong 84ac004772
py lint (#12102) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-12-26 00:16:35 +08:00
-LAN- 822af70dce
fix(workflow_service): assign UUID to workflow_node_execution id and update optional fields in WorkflowRun and WorkflowNodeExecution models (#12096) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-25 21:34:53 +08:00
Jyong 9231fdbf4c
Feat/support parent child chunk (#12092) 2024-12-25 19:49:07 +08:00
-LAN- 50b7ec3c73
fix(http_request): add error handling for invalid URLs (#12082) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-25 18:36:33 +08:00
-LAN- 7ae417b4b6
fix(tool): validate return type from _invoke method to ensure ToolInv… (#12079) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-25 18:36:24 +08:00
-LAN- 39ace9bdee
fix(app_generator): improve error handling for closed file I/O operat… (#12073) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-25 16:34:38 +08:00
-LAN- 83ea931e3c
refactor: optimize database usage (#12071) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-25 16:24:52 +08:00
jiangbo721 c98d91e44d
fix: o1 model error, use max_completion_tokens instead of max_tokens. (#12037) 
Co-authored-by: 刘江波 <jiangbo721@163.com>
 2024-12-25 13:29:43 +08:00
yihong 7da4fb68da
fix: can not find model bug (#12051) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-25 08:42:52 +08:00
yihong 7a24c957bd
fix: i18n error (#12052) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-24 23:14:51 +08:00
yihong 56e15d09a9
feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
-LAN- 094343739b
fix/array file cannot use in iteration node (#12035) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-24 15:56:59 +08:00
-LAN- 82134a1d50
fix: Replace generic exceptions with specific error classes in task p… (#12036) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-24 15:24:19 +08:00
yihong 6a0ff3686c
fix: fix typo (#12034) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-24 15:23:27 +08:00
Yang Jingtao e0c24c0e99
fix: Fix session typo in workflow_trace method (#12031) 2024-12-24 10:30:31 +08:00
yihong e0f1410b48
fix: issue Multiple Paths Between IF/ELSE Branches (#11646) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-23 18:56:59 +08:00
-LAN- c3c85276d1
Fix/refactor invoke result handling in question classifier node (#12015) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 17:54:08 +08:00
-LAN- af2888d394
fix: remove json_schema if response format is disabled. (#12014) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 17:53:57 +08:00
-LAN- d0dd8b7955
fix: add UUID validation for tool file ID extraction (#12011) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 17:53:42 +08:00
-LAN- 75bce2822e
fix: add logging for missing edge mapping in StreamProcessor (#12008) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 17:53:36 +08:00
Novice dc19cd5d9d
fix: add retry feature to code node (#12005) 
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
 2024-12-23 16:42:28 +08:00
-LAN- e068bbec73
feat: add RequestBodyError for invalid request body handling (#11994) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 15:53:03 +08:00
-LAN- 9cfd1c67b6
fix: Introduce ArrayVariable and update iteration node to handle it (#12001) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 15:52:50 +08:00
-LAN- 8978a6a3ff
fix: remove unused credential validation logic in VectorizerProvider (#12000) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 15:30:58 +08:00
yihong 70dd69d533
fix: Multiple Paths Between IF/ELSE Branches Invalidate Conditions (#11544) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-23 15:09:02 +08:00
Novice 453f324f54
fix: retry node in iteration logs wrong (#11995) 
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
 2024-12-23 15:06:01 +08:00
Novice c1aa55f3ea
fix: remove the unused retry index field (#11903) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-12-23 14:32:11 +08:00
JasonVV 4b1e13e982
Fix 11979 (#11984) 2024-12-23 14:30:04 +08:00
yihong 26c10b9931
fix: 'dict_keys' object is not subscriptable error (#11957) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-22 14:58:33 +08:00
-LAN- 03ddee3663
fix(variable_assigner): change VariableOperatorNodeError to inherit from ValueError (#11951) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-22 10:43:40 +08:00
-LAN- 10caab1729
fix: change CredentialsValidateFailedError to inherit from ValueError (#11950) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-22 10:43:31 +08:00
-LAN- 21a31d7f8b
fix(base_node): change BaseNodeError exception type from Exception to ValueError (#11952) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-22 10:42:30 +08:00
-LAN- 2c4df108e5
fix: raise http request node error on httpx.request error (#11954) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-22 10:41:53 +08:00
-LAN- 5db8addcc6
fix(core/errors): change base class of custom exceptions to ValueError (#11955) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-22 10:41:34 +08:00
-LAN- dd0e81d094
fix: enhance type hints and improve audio message handling in TTS pub… (#11947) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-22 10:41:06 +08:00
-LAN- a056a9d601
feat(code_node): add more check (#11949) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-22 10:40:43 +08:00
非法操作 366857cd26
fix: gemini system prompt with variable raise error (#11946) 2024-12-21 23:14:05 +08:00
yihong 9ee9e9c6de
fix: self.method should method in api_tool.py (#11926) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-21 21:24:59 +08:00
-LAN- a227af3664
fix(code_node): update type hints for string and number checks in Cod… (#11936) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:24:22 +08:00
-LAN- 599d410d99
fix: validate reranking model attributes before processing (#11930) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:23:12 +08:00
-LAN- 5e37ab60d8
fix: validate response type in transform_response method (#11931) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:23:03 +08:00
-LAN- b8d42cdea7
fix: change MaxRetriesExceededError to inherit from ValueError (#11934) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:22:47 +08:00
-LAN- 455791b710
fix(model_runtime): make invoke as ValueError (#11929) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:22:14 +08:00
-LAN- 90323cd355
fix(tool_file_manager): raise ValueError when get timeout (#11928) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:22:06 +08:00
-LAN- c07d9e96ce
fix(nodes): handle errors in question_classifier and parameter_extractor (#11927) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:21:57 +08:00
-LAN- 810adb8a94
fix: change OutputParserError to inherit from ValueError (#11935) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:21:30 +08:00
-LAN- 8c559d6231
fix(retrieval_service): avoid to use exception (#11925) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-21 21:19:46 +08:00
Kalo Chin 786cb6859b
fix: ensure WorkflowRun attributes are refreshed in WorkflowCycleMana… (#11913) 2024-12-21 15:05:04 +08:00
ybalbert001 de8800f41a
add three aws tools (#11905) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-12-21 13:36:13 +08:00
Kalo Chin 2681bafb76
fix: handle document fetching from URL in Anthropic LLM model, solving base64 decoding error (#11858) 2024-12-20 18:23:42 +08:00
yihong ac635c70cd
fix: doc can not extract tables (#11879) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Co-authored-by: akinobu-i <akinobu-i@users.noreply.github.com>
 2024-12-20 17:19:46 +08:00
-LAN- dacd457478
feat: add workflow parallel depth limit configuration (#11460) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
 2024-12-20 14:52:20 +08:00
yihong 7b03a0316d
fix: better memory usage from 800+ to 500+ (#11796) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-20 14:51:43 +08:00
Novice 7abc7fa573
Feat: Retry on node execution errors (#11871) 
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
 2024-12-20 14:14:06 +08:00
-LAN- 996a9135f6
feat(llm_node): support order in text and files (#11837) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-20 14:12:50 +08:00
-LAN- 3599751f93
chore(db): use a better way to export models and remove unused table (#11838) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-20 14:12:29 +08:00
Dr.MerdanBay bb2f46d7cc
fix: add safe dictionary access for bedrock credentials (#11860) 2024-12-20 12:13:39 +09:00
yihong 463fbe2680
fix: better gard nan value from numpy for issue #11827 (#11864) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-20 09:28:32 +08:00
傻笑zz 95a7e50137
Fix comfyui tool https (#11859) 2024-12-20 09:27:21 +08:00
非法操作 9d93ad1f16
feat: add gemini-2.0-flash-thinking-exp-1219 (#11863) 2024-12-20 09:26:31 +08:00
stardust 44104797d6
fix: Enhance file type detection in HTTP Request node (#11797) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: 谭成 <tancheng.sh@chinatelecom.cn>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-12-20 02:21:41 +08:00
傻笑zz 1548501050
fix: comfyui tool supports https (#11823) 2024-12-19 23:05:27 +08:00
yihong 5a8a901560
fix: float values are not json for nan value close #11827 (#11840) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-19 20:50:20 +08:00
yihong 12d45e9114
fix: silicon change its model fix #11844 (#11847) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-19 20:50:09 +08:00
barabicu d057067543
fix: remove ruff ignore SIM300 (#11810) 2024-12-19 18:30:51 +08:00
sino 560d375e0f
feat(ark): add doubao-pro-256k and doubao-embedding-large (#11831) 2024-12-19 17:49:31 +08:00
Agung Besti 3388d6636c
add-model-azure-gpt-4o-2024-11-20 (#11803) 
Co-authored-by: agungbesti <agung.besti@insignia.co.id>
 2024-12-19 12:36:11 +08:00
xander-art 56434db4f5
feat:add hunyuan model(hunyuan-role, hunyuan-large, hunyuan-large-rol… (#11766) 
Co-authored-by: xanderdong <xanderdong@tencent.com>
 2024-12-18 15:25:53 +08:00
Jiang ad17ff9a92
Lindorm vdb bug-fix (#11790) 
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
 2024-12-18 15:19:20 +08:00
-LAN- a5db7c9acb
feat: add openai o1 & update pricing and max_token of other models (#11780) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-18 12:15:11 +08:00
DDDDD12138 79d11ea709
feat: add parameters for JinaReaderTool (#11613) 2024-12-18 09:08:06 +08:00
非法操作 9048832a9a
chore: improve gemini models (#11745) 2024-12-17 17:42:21 +08:00
Shota Totsuka 7d5a385811
feat: use Gemini response metadata for token counting (#11743) 2024-12-17 17:42:05 +08:00
sino 99430a5931
feat(ark): support doubao vision series models (#11740) 2024-12-17 15:43:11 +08:00
非法操作 c9b4029ce7
chore: the consistency of MultiModalPromptMessageContent (#11721) 2024-12-17 15:01:38 +08:00
呆萌闷油瓶 cd4310df25
chore:update azure api version (#11711) 2024-12-17 13:39:56 +08:00
-LAN- 62b9e5a6f9
feat(knowledge_retrieval_node): Suppress exceptions thrown by DatasetRetrieval (#11728) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-17 13:12:29 +08:00
-LAN- 92a840f1b2
feat(tool_node): Suppress exceptions thrown by the Tool (#11724) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-17 12:11:50 +08:00
非法操作 74fdc16bd1
feat: enhance gemini models (#11497) 2024-12-17 12:05:13 +08:00
方程 fc8fdbacb4
feat: add gitee ai vl models (#11697) 
Co-authored-by: 方程 <fangcheng@oschina.cn>
 2024-12-16 18:45:26 +08:00
zhongliliu-butterfly daccb10d8c
fix: volcengine_maas and baichuan message error (#11625) 
Co-authored-by: zhongliliu <liuzlx@digitalchina.com>
 2024-12-16 13:05:27 +08:00
Kazuhisa Wada 63f1dd7877
Make max_submit_count configurable via Config (#11673) 2024-12-16 12:59:37 +08:00
zhaobingshuang 79801f5c30
fix: deepseek reports an error when using Response Format #11677 (#11678) 
Co-authored-by: zhaobs <zhaobs@cailian.net>
 2024-12-16 12:58:03 +08:00
非法操作 9c7a1bc067
fix: change http node params from dict to list tuple (#11665) 2024-12-15 21:27:39 +08:00
非法操作 cf0ff88120
feat: add grok-2-1212 and grok-2-vision-1212 (#11672) 2024-12-15 21:18:24 +08:00
Novice e0b67536e0
fix: remove the unused QueueWorkflowPartialSuccessEvent handle in workflow (#11669) 
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
 2024-12-15 21:18:14 +08:00
yihong efd5575683
fix: _handle_workflow_run_partial_success args is wrong (#11562) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-15 17:22:13 +08:00
Bowen Liang 924b4fe742
test: run vdb tests on TiDB Vector with docker in CI tests (#11645) 2024-12-15 17:16:40 +08:00
yihong 7e154a467b
fix: better error message for stream (#11635) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-15 17:16:04 +08:00
yihong 821992e21f
fix: langfuse do not have created_at args and fix the typing in the file (#11648) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-15 17:13:46 +08:00
IWAI, Masaharu f0c0ce9db1
fix: rename README filename: Japanese language code is 'JA' (#11651) 2024-12-15 17:13:34 +08:00
yihong 22258fb0bf
fix: filter bug for keywork cause code can not reach (#11666) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-15 17:12:06 +08:00
JasonVV bb3bc60f83
feat(model): add vertex_ai Gemini 2.0 Flash Exp (#11604) 2024-12-12 20:20:49 +08:00
crazywoola e7a4cfac4d
fix: name of llama-3.3-70b-specdec (#11596) 2024-12-12 16:33:49 +08:00
Alok Shrivastwa 6478aa1c9d
Added new models and Removed the deleted ones for Groq #11455 (#11456) 
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Alok Shrivastwa <Alok.Shrivastwa@microland.com>
 2024-12-12 14:11:30 +08:00
Warren Chen 7b5839335a
[ref] use one method to get boto client for aws bedrock (#11506) 2024-12-12 13:56:52 +08:00
yihong 36cb25b341
fix: support mdx files close #11557 (#11565) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-12 13:37:56 +08:00
Joe e565ecdaef
fix: change workflow trace id (#11585) 2024-12-12 13:37:29 +08:00
Jiang 0d04cdc323
Lindorm vdb (#11574) 
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
 2024-12-12 09:43:27 +08:00
非法操作 926f604f09
feat: add gemini-2.0-flash-exp (#11570) 2024-12-12 09:33:39 +08:00
liuzhenghua d05f189049
Fix: RateLimit requests were not released when a streaming generation exception occurred (#11540) 2024-12-11 19:16:35 +08:00
Novice 1765fe2a29
fix: iteration node in parallel mode token count error (#11539) 
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
 2024-12-11 14:23:01 +08:00
Novice 79a710ce98
Feat: continue on error (#11458) 
Co-authored-by: Novice Lee <novicelee@NovicedeMacBook-Pro.local>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
 2024-12-11 14:22:42 +08:00
Tommy 42d986b96d
[Pixtral] Add new model ; add vision (#11231) 2024-12-11 10:14:16 +08:00
zkyTech fbc4ca980c
fix: Remove duplicate 'response_format' parameter from model YAML files (#11531) 
Co-authored-by: zhangkunyuan <zhangkunyuan@cmhi.chinamobile.com>
 2024-12-11 10:10:53 +08:00
Paul van Oorschot 80c52e0ea4
feat: Add llama-3.3 models for Groq (#11533) 2024-12-11 09:59:46 +08:00
yihong 225fcd5e41
Revert "fix: total tokens is wrong which is zero in inter way, close … (#11536) 2024-12-11 09:54:46 +08:00
yihong 716576043d
fix: issue 11247 that Completion mode content maybe list or str (#11504) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-10 23:22:14 +08:00
Wei Mingzhi 28231d39a4
Remove the processing of single quote when testing API tools. (#11390) 2024-12-10 19:53:38 +08:00
非法操作 9e23c3d625
chore: LOCAL_FILE also try to use remote_url as Prompt message (#11443) 2024-12-10 10:56:49 +08:00
-LAN- fd354d999d
fix(app_generator_service): overload type hints (#11507) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-10 09:06:34 +08:00
orangeclk ec00b25793
feat: add siliconflow qwq and llama3.3 model (#11492) 2024-12-10 08:49:45 +08:00
Yingchun Lai 32f8439143
fix: add the missing abab6.5t-chat model of Minimax (#11484) 2024-12-09 17:59:20 +08:00
-LAN- 537068cfde
refactor(iteration_node): use Sequence and Mapping in parameters (#11483) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-09 15:41:20 +08:00
suzuki.sh c3c6a48059
Fix the token count at the iteration node (#11235) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-12-09 15:02:04 +08:00
Kazuki Takamatsu 4d7cfd0de5
Fix model provider of vertex ai (#11437) 2024-12-08 08:44:49 +08:00
非法操作 7e1184c071
feat: support json_schema for ollama models (#11449) 2024-12-08 08:36:12 +08:00
非法操作 1ce51e57ab
feat: add gemini exp 1206 (#11444) 2024-12-07 22:28:10 +08:00
非法操作 142b4fd699
feat: add zhipu glm_4v_flash (#11440) 2024-12-07 22:27:57 +08:00
yihong d9d5d35a77
fix: issue #10596 by making the iteration node outputs right (#11394) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-12-07 16:28:15 +08:00
Huỳnh Gia Bôi 9277156b6c
fix(document_extractor): pptx file type and missing metadata_filename UnstructuredIO (#11364) 
Co-authored-by: Julian Huynh <julian.huynh@immersio.io>
 2024-12-06 18:55:59 +08:00
Jyong 9b7adcd4d9
update tidb batch get endpoint to basic mode (#11426) 2024-12-06 17:06:46 +08:00
Jyong a8d32f9964
fix external retrieval without segment id (#11423) 2024-12-06 14:45:15 +08:00
shirochan 5093337de1
FEAT: cohere rerank 3.5 model added (#11289) 2024-12-06 09:58:55 +08:00
Matsuda f54225568c
fix(model_runtime): add vision to Amazon Nova Lite and Pro (#11398) 2024-12-06 09:15:32 +08:00
Warren Chen 631cbcd781
[fix] rename yaml files to fit windows (#11379) 2024-12-05 14:38:12 +08:00
yihong 5669cac16d
fix: some typos using typos (#11374) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-05 13:24:06 +08:00
Warren Chen 376726cf90
[feat] Add AWS Bedrock rerank (#11349) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-12-05 11:31:43 +08:00
Akira Noda eca466bdaa
chore: fix typo (#11359) 2024-12-05 09:04:30 +08:00
crazywoola d56abec195
Revert "Fix: iteration not in main thread pool" (#11358) 2024-12-04 21:22:22 +08:00
yihong 961e25f608
fix: better bedrock message handler close #10976 (#11317) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-04 19:46:40 +08:00
ybalbert001 1bae9b8ff7
update pricing for bedrock nova LLM models (#11336) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-12-04 16:16:41 +08:00
Jyong d7c1f43b49
fix tidb full-text-search vector missed (#11337) 2024-12-04 16:13:23 +08:00
非法操作 91e1ff5e30
chore: improve zhipu LLM (#11321) 2024-12-04 15:14:30 +08:00
ybalbert001 5908e10549
integrate amazon nove llms to dify (#11324) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-12-04 15:13:08 +08:00
-LAN- 464e6354c5
feat: correct the prompt grammar. (#11328) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-04 15:12:47 +08:00
非法操作 d470e55f8c
fix: http node download file always image type (#11319) 2024-12-04 12:15:26 +08:00
Jyong c58d2fce89
roll back rerank topn setting (#11297) 2024-12-03 17:34:56 +08:00
yihong e39e776d03
fix: better wenxin rerank handler, close #11252 (#11283) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-03 13:57:16 +08:00
Yi Xiao e135ffc2c1
Feat: upgrade variable assigner (#11285) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-12-03 13:56:40 +08:00
Bowen Liang e79eac688a
chore(lint): sort __all__ definitions (#11243) 2024-12-03 13:26:33 +08:00
-LAN- 643a90c48d
fix: use `removeprefix()` instead of `lstrip()` to remove the `data:` prefix (#11272) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-03 09:16:25 +08:00
Novice 2a448a899d
Fix: iteration not in main thread pool (#11271) 
Co-authored-by: Novice Lee <novicelee@NovicedeMacBook-Pro.local>
 2024-12-03 09:16:03 +08:00
yihong e686f12317
fix: better handle error (#11265) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-03 09:15:38 +08:00
Hash Brown c4fad66f2a
fix: `dialogue_count` incorrect in chatflow when there's... (#11175) 2024-12-02 16:09:26 +08:00
yihong 02572e8cca
fix: claude can not handle empty string (#11238) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-02 16:00:40 +08:00
-LAN- f8c966c39c
fix(workflow_tool): Rename `stream` to `streaming` (#11258) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-02 15:00:26 +08:00
-LAN- 3c8efe7c0a
fix(workflow_cycle_manage): Handle special values in the process_data. (#11253) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-02 13:53:43 +08:00
yihong 239bf97b47
fix: nvidia special embedding model payload close #11193 (#11239) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-12-02 10:25:15 +08:00
-LAN- c34bdb74e6
Fix/type-error (#11240) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-02 10:24:21 +08:00
-LAN- 9601102885
fix(word_extractor): Fix type error and remove stream in ssrf_proxy (#11241) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-12-02 10:24:03 +08:00
yihong fd4be36991
fix: total tokens is wrong which is zero in inter way, close #11221 (#11224) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-30 23:18:24 +08:00
Shota Totsuka 594666eb61
fix: use Gemini response metadata for token counting (#11226) 2024-11-30 17:30:55 +08:00
朱晓兵 e80f41a701
fix: support setting variables in url (#10676) 2024-11-30 11:15:17 +08:00
Cling_o3 f9c2aa7689
feat: add retireval_top_n to config in env (#11132) 2024-11-30 11:14:45 +08:00
yihong 5a9b785773
fix: excel in node only read one sheet, close #9661 (#11215) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-30 11:11:08 +08:00
catusax d96a28487a
fix: 'validation error for ToolInvokeMessage' when blob_message meta is None (#11212) 2024-11-29 17:35:13 +08:00
liujiamingtiny 6f9ce6a199
fix: fix azure open-4o-08-06 when enable json schema cant process content = "" (#11204) 
Co-authored-by: jiaming.liu <jiaming.liu@zkh.com>
 2024-11-29 17:26:07 +08:00
ybalbert001 cc0b92bc75
Update aws tools (#11174) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-11-29 09:28:28 +08:00
kazuya-awano 2d6865d421
Ensure consistent float type for cached embedding return values (#10185) 2024-11-29 09:18:41 +08:00
yihong d7160ee563
fix: typo in upstashVector if id is always true, also fix some type hint (#11183) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-28 14:05:25 +08:00
yihong 40fc6f529e
fix: gitee ai wrong default model, and better para (#11168) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-27 17:27:11 +08:00
Hiroshi Fujita a918cea2fe
feat: add VTT file support to Document Extractor (#11148) 2024-11-27 11:42:42 +08:00
-LAN- 9789905a1f
chore(*): Removes debugging print statements (#11145) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-11-26 22:03:19 +08:00
Charlie.Wei f458580dee
fix parameter extractor function call Expected str (#11142) 2024-11-26 21:46:56 +08:00
-LAN- 223a30401c
fix: LLM invoke error should not be raised (#11141) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-11-26 20:56:48 +08:00
Tao Wang aa135a3780
Add TTS to OpenAI_API_Compatible (#11071) 2024-11-26 15:14:02 +08:00
-LAN- 044e7b63c2
fix(llm_node): Ignore file if not supported. (#11114) 2024-11-26 14:14:14 +08:00
-LAN- 5b7b328193
feat: Allow to contains files in the system prompt even model not support. (#11111) 2024-11-26 13:45:49 +08:00
-LAN- 8d5a1be227
fix: Cannot use files in the user inputs. (#11112) 2024-11-26 13:43:38 +08:00
-LAN- 1db14793fa
fix(anthropic_llm): Ignore non-text parts in the system prompt. (#11107) 2024-11-26 13:31:40 +08:00
-LAN- cbb4e95928
fix(llm_node): Ignore user query when memory is disabled. (#11106) 2024-11-26 13:07:32 +08:00
-LAN- 20c091a5e7
fix: user query be ignored if query_prompt_template is an empty string (#11103) 2024-11-26 12:47:59 +08:00
horochx 9f75970347
fix: ops_trace_manager `from_end_user_id` (#11077) 2024-11-26 10:29:00 +08:00
SebastjanPrachovskij 17ee731546
SearchApi - Return error message instead of raising a ValueError (#11083) 2024-11-26 09:34:51 +08:00
Tao Wang af2461cccc
Add query_prefix + Return TED Transcript URL for Downstream Scraping Tasks (#11090) 2024-11-26 09:32:37 +08:00
fengjiajie ab6dcf7032
fix: update the max tokens configuration for Azure GPT-4o (2024-08-06) to 16384 (#11074) 2024-11-25 21:13:02 +08:00
yihong 8aae235a71
fix: int None will cause error for context size (#11055) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-25 21:04:16 +08:00
Tao Wang 1065917872
Add grok-vision-beta to xAI + Update grok-beta Features (#11004) 2024-11-25 20:53:03 +08:00
非法操作 56e361ac44
fix: chart tool chinese font display and raise error (#11058) 2024-11-25 19:50:33 +08:00
yihong 2e00829b1e
fix: drop useless and wrong code for zhipu embedding (#11069) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-25 19:50:23 +08:00
-LAN- 98d85e6b74
fix: WorkflowNodeExecution.created_at may be earlier than WorkflowRun.created_at (#11070) 2024-11-25 18:16:55 +08:00
Pedro Gomes 319d49084b
fix: ignore empty outputs in Tool node (#10988) 2024-11-25 18:00:42 +08:00
-LAN- 3eb51d85da
fix(workflow_entry): Support receive File and FileList in single step run. (#10947) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
 2024-11-25 12:46:50 +08:00
Kalo Chin 684f6b2299
fix: slidespeak text output is not the download link (#10997) 2024-11-25 11:28:52 +08:00
SiliconFlow, Inc a4fc057a1c
ISSUE=11042: add tts model in siliconflow (#11043) 2024-11-25 11:04:13 +08:00
Tao Wang aae29e72ae
Fix Deepseek Function/Tool Calling (#11023) 2024-11-25 11:03:53 +08:00
cyflhn 87c831e5dd
make tool parameters parsing compatible with the response of glm4 model in xinference provider when function tool call integerated (#11049) 2024-11-25 11:02:58 +08:00
-LAN- 60b5dac3ab
fix: query will be None if the query_prompt_template not exists (#11031) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2024-11-24 21:06:51 +08:00
cyflhn 03ba4bc760
fix error with xinference tool calling with qwen2-instruct and add timeout retry setttings for xinference (#11012) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-11-24 15:29:30 +08:00
litterGuy ae3a2cb272
fix: json parse err when http node send request (#11001) 2024-11-24 14:19:48 +08:00
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 2024-11-24 13:28:46 +08:00
yihong 0181f1c08c
fix: wrong convert in PromptTemplateConfigManager (#11016) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-24 12:18:19 +08:00
yihong 7f00c5a02e
fix: uuid not import bug (#11014) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-24 11:17:55 +08:00
kenwoodjw 096c0ad564
feat: Add support for TEI API key authentication (#11006) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2024-11-23 23:55:35 +08:00
Kazuhisa Wada 16c41585e1
Fixing #11005: Incorrect max_tokens in yaml file for AWS Bedrock US Cross Region Inference version of 3.5 Sonnet v2 and 3.5 Haiku (#11013) 2024-11-23 23:46:25 +08:00
AkisAya 566ab9261d
fix: gitlab file url not correctly encoded (#10996) 2024-11-23 23:44:17 +08:00
yihong 448a19bf54
fix: fish audio wrong validate credentials interface (#11019) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-23 23:39:41 +08:00
yihong ed55de888a
fix: rules should not be None for in (#10977) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-22 23:04:20 +08:00
非法操作 08ac36812b
feat: support LLM process document file (#10966) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-11-22 19:32:44 +08:00
-LAN- c5f7d650b5
feat: Allow using file variables directly in the LLM node and support more file types. (#10679) 
Co-authored-by: Joel <iamjoel007@gmail.com>
 2024-11-22 16:30:22 +08:00
CXwudi d9579f418d
chore: Added the new gemini exp-1121 and learnlm-1.5 models (#10963) 2024-11-22 13:14:20 +08:00
Kalo Chin 817b85001f
feat: slidespeak slides generation (#10955) 2024-11-22 10:30:21 +08:00
Agung Besti e8868a7fb9
feat: add gpt-4o-2024-11-20 (#10951) 
Co-authored-by: akubesti <agung.besti@insignia.co.id>
 2024-11-22 10:29:20 +08:00
yihong 464f384cea
fix: tiny lora bug found by mypy (#10959) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-22 10:01:44 +08:00
Xu Song 8c2f62fb92
Feat: support json output for bing-search (#10904) 2024-11-21 18:32:54 +08:00
LastHopeOfGPNU 1a6b961b5f
Resolve 8475 support rerank model from infinity (#10939) 
Co-authored-by: linyanxu <linyanxu2@qq.com>
 2024-11-21 18:03:49 +08:00
AkisAya cb0c55daa7
fix weight rerank of knowledge retrieval (#10931) 2024-11-21 17:53:20 +08:00
-LAN- 82575a7aea
fix(gpt-4o-audio-preview): Remove the vision feature (#10932) 2024-11-21 16:42:48 +08:00
yihong 80da0c5830
fix: default max_chunks set to 1 as other providers (#10937) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-21 16:36:05 +08:00
Pedro Gomes 83b6abf4ad
Update parse.py to handle empty list result (#10915) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-11-21 14:14:07 +08:00
wy96f 94c9cadbd8
fix image files not deleted on indexing_estimate #9541 (#10798) 
Co-authored-by: root <root@localhost.localdomain>
 2024-11-21 13:03:16 +08:00
Steven sun 2ae6460f46
Add googlenews tools from rapidapi (#10877) 
Co-authored-by: steven <sunzwj@digitalchina.com>
 2024-11-21 10:39:49 +08:00
yihong 0067b16d1e
fix: refactor all 'or []' and 'or {}' logic to make code more clear (#10883) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-21 10:34:43 +08:00
方程 99b0369f1b
Gitee AI embedding tool (#10903) 2024-11-20 17:40:34 +08:00
-LAN- 4d6b45427c
Support streaming output for OpenAI o1-preview and o1-mini (#10890) 2024-11-20 15:10:41 +08:00
-LAN- 1be8365684
Fix/input-value-type-in-moderation (#10893) 2024-11-20 15:10:12 +08:00
ybalbert001 c3d11c8ff6
fix: aws presign url is not workable remote url (#10884) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-11-20 14:24:41 +08:00
非法操作 bf4b6e5f80
feat: support custom tool upload file (#10796) 2024-11-20 13:26:42 +08:00
-LAN- 25fda7adc5
fix(http_request): allow content type `application/x-javascript` (#10862) 2024-11-20 12:55:06 +08:00
Muntaser Abuzaid 33cfc56ad0
fix: update email validation regex to allow periods in local part (#10868) 2024-11-20 12:33:02 +08:00
GeorgeCaoJ fbfc811a44
feat: support function call for ollama block chat api (#10784) 2024-11-20 11:15:19 +08:00
Ding Jiatong 3087913b74
Fix the situation where output_tokens/input_tokens may be None in response.usage (#10728) 2024-11-19 21:19:13 +08:00
Joe 2dc29cfee3
Feat/add langsmith dotted order (#10856) 2024-11-19 21:08:23 +08:00
Jyong bd05df5cc5
fix tongyi embedding endpoint return None output (#10857) 2024-11-19 21:04:17 +08:00
Jyong ee1f14621a
fix httpx doesn't support stream parameter (#10859) 2024-11-19 21:03:01 +08:00
yihong 58a9d9eb9a
fix: better WeightRerankRunner run logic use O(1) and delete unused code (#10849) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-19 20:12:13 +08:00
非法操作 bc1013dacf
feat: support json schema for gemini models (#10835) 2024-11-19 17:49:58 +08:00
Tao Wang 9f195df103
Support Video Proxy and TED Embedding (#10819) 2024-11-19 17:49:14 +08:00
KVOJJJin 328965ed7c
Fix: crash of workflow file upload (#10831) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
 2024-11-19 14:15:18 +08:00
Zane 14f3d44c37
refactor: improve handling of leading punctuation removal (#10761) 2024-11-18 21:32:33 +08:00
8bitpd 873e9720e9
feat: AnalyticDB vector store supports invocation via SQL. (#10802) 
Co-authored-by: 璟义 <yangshangpo.ysp@alibaba-inc.com>
 2024-11-18 19:29:54 +08:00
Tao Wang 90d6ebc879
Add youtube-transcript-api as tool (#10772) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-11-18 10:58:16 +08:00
Kalo Chin 6de1f8c770
Feat(tools) add tavily extract tool and enhance tavily search implementation (#10786) 2024-11-18 09:51:34 +08:00
非法操作 ba537d657f
feat: add gemini-exp-1114 (#10779) 2024-11-18 09:49:22 +08:00
Kalo Chin 305fbc7c92
fix: fal ai wizper also return text msg (#10789) 2024-11-18 09:45:59 +08:00
Tao Wang 29341d60aa
Add DuckDuckGo Video Search and News Search (#10771) 2024-11-17 13:59:48 +08:00
crazywoola 2fed55ae6b
Fix: number maybe empty string (#10743) 2024-11-15 16:31:10 +08:00
Bowen Liang 51db59622c
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 2024-11-15 15:41:40 +08:00
非法操作 2a5c5a4e15
fix: remove default model selection for audio tool (#10729) 2024-11-15 12:40:41 +08:00
非法操作 4b2abf8ac2
fix: create_blob_message of tool will always create image type file (#10701) 2024-11-15 10:38:12 +08:00
Bowen Liang 365cb4b368
chore(lint): bump ruff from 0.6.9 to 0.7.3 (#10714) 2024-11-15 09:19:41 +08:00
Kalo Chin ad16180b1a
feat(tool): fal ai wizper ASR built-in tool (#10716) 2024-11-15 09:01:07 +08:00
SiliconFlow, Inc e61242a337
feat: add vlm models from siliconflow (#10704) 2024-11-14 20:53:35 +08:00
yihong 722964667f
fix: non utf8 code decode close #10691 (#10698) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2024-11-14 17:29:49 +08:00
Xiao Ley fbb9c1c249
fixed the Base URL usage issue in Podcast Generator tool verification (#10697) 2024-11-14 17:24:42 +08:00
非法操作 15f341b655
feat: add the audio tool (#10695) 2024-11-14 16:37:15 +08:00
orangeclk 317ae9233e
feat: add json response format for siliconflow models (#10657) 2024-11-14 08:58:22 +08:00
xiandan-erizo 5b8f03cd9d
add abab7-chat-preview model (#10654) 
Co-authored-by: xiandan-erizo <xiandan-erizo@outlook.com>
 2024-11-13 19:30:42 +08:00
Kalo Chin 2a4783307a
Feat(tool): fal ai flux image generation (#10606) 2024-11-13 17:41:58 +08:00
-LAN- 70c2ec8ed5
feat(variable-handling): enhance variable and segment conversion (#10483) 2024-11-12 21:51:09 +08:00
wakaka6 9c7edb9242
feat: add builtin tools for send email (#10493) 2024-11-12 21:48:36 +08:00
Jyong 0b2d51d859
add the index field for elasticsearch (#10592) 2024-11-12 21:43:16 +08:00
方程 ef8022f715
Gitee AI Qwen2.5-72B model (#10595) 2024-11-12 21:40:32 +08:00
Kevin9703 e03ec0032b
fix: Azure OpenAI o1 max_completion_token error (#10593) 2024-11-12 21:40:13 +08:00
-LAN- 16b9665033
refactor(api): improve handling of `tools` field and cleanup variable usage (#10553) 2024-11-12 00:08:04 +08:00
Benjamin b7238caea5
chore(vanna): update form parameter from 'form' to 'llm' in vanna.yaml (#10548) 2024-11-12 00:00:27 +08:00
-LAN- bd4a61addd
fix: set default factory for extract_by in ListOperatorNodeData (#10561) 2024-11-11 23:32:40 +08:00
smyhw f19c18dc14
Fixes `you have not added provider None` (#10501) 2024-11-11 21:50:32 +08:00
liuhaoran 570f10d91c
fix issues:Image file not deleted when a doc is removed #9541 (#10465) 
Signed-off-by: root <root@localhost.localdomain>
Co-authored-by: root <root@localhost.localdomain>
 2024-11-11 21:43:37 +08:00
Novice 4b45ef62ed
fix: iteration invalid output selector doesn't throw an error (#10544) 2024-11-11 17:34:48 +08:00
-LAN- a1543b7da0
fix(extractor): temporary file (#10543) 2024-11-11 17:31:27 +08:00
Benjamin 90087160c6
chore (vanna): update form parameter from 'form' to 'llm' in vanna.yaml (#10488) 2024-11-11 16:41:47 +08:00
-LAN- be33875199
fix(gitee_ai): update English description for clarity and accuracy (#10540) 2024-11-11 16:23:11 +08:00
-LAN- 867bf70f1a
fix(model_runtime): ensure compatibility with O1 models by adjusting token parameters (#10537) 2024-11-11 16:06:53 +08:00
Novice f414d241c1
Feat/iteration single run time (#10512) 2024-11-11 14:47:52 +08:00
Jyong 0c1307b083
add jina rerank http timout parameter (#10476) 2024-11-11 13:28:11 +08:00
-LAN- b8b6cd409a
refactor(code_executor): update input type annotations to use Mapping for better type safety (#10478) 2024-11-11 13:10:39 +08:00
Charlie.Wei fbee41f8c7
The list action node adds methods to extract specific list objects (#10421) 
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2024-11-11 12:10:21 +08:00
Xiao Ley 451ccb778d
feat(tools/podcast_generator): add support for setting openai base url with the podcast_generationor tool (#10517) 2024-11-11 11:31:47 +08:00
crazywoola 5656f81bde
Revert "fix the error of unable to retrieve url from file" (#10511) 2024-11-11 08:56:19 +08:00
Xiao Ley 5eb27afd63
fix the error of unable to retrieve url from file (#10498) 2024-11-11 08:47:47 +08:00
fdb02983rhy 05d43a4074
Fix: Correct the max tokens of Claude-3.5-Sonnet-20241022 for Bedrock and VertexAI (#10508) 2024-11-11 08:41:43 +08:00
larcane97 aa895cfa9b
fix: [VESSL-AI] edit some words in vessl_ai.yaml (#10417) 
Co-authored-by: moon <moon@vessl.ai>
 2024-11-11 08:38:26 +08:00
-LAN- 172c7eb270
fix(file_upload): correct validation method and add unit tests (#10477) 2024-11-08 21:55:01 +08:00
-LAN- bf31a3efbc
feat(workflow-nodes): handle missing variables without failure (#10471) 2024-11-08 19:48:05 +08:00
-LAN- 25ca0278dd
refactor(core): Remove extra_config from File. (#10203) 2024-11-08 18:13:24 +08:00
非法操作 7903ba0297
chore: make comfy workflow can generate image with a random seed (#10462) 2024-11-08 17:21:16 +08:00
非法操作 4fe5297e35
feat: add cogVideo tool (#10456) 2024-11-08 17:04:05 +08:00
Novice a7dbe58c85
fix: correct output order in parallel mode for iteration nodes (#10323) 2024-11-08 15:32:40 +08:00
Joe aa3da0e24c
fix(ops_tracing): enhance error handle in celery tasks. (#10401) 2024-11-08 14:43:47 +08:00
非法操作 033ab5490b
feat: support LLM understand video (#9828) 2024-11-08 13:22:52 +08:00
Leo.Wang c9f785e00f
Feat/tools/gitlab (#10407) 2024-11-08 09:53:03 +08:00
Bowen Liang 0ebe198ff1
chore: use DEBUG in dify_config instead of parsing raw system environment variable in place (#10437) 2024-11-08 09:34:11 +08:00
-LAN- 438ad8148b
fix(http_request): send form data (#10431) 2024-11-08 09:33:40 +08:00
Bowen Liang a60133bfb3
fix: config violations when running db migtration ci tests (#10428) 2024-11-08 09:33:12 +08:00
Bowen Liang 574c4a264f
chore(lint): Use logging.exception instead of logging.error (#10415) 2024-11-07 21:13:02 +08:00
走在修行的大街上 f562a88249
feat(Tools): add lark tools (#10117) 
Co-authored-by: 黎斌 <libin.23@bytedance.com>
 2024-11-07 18:11:25 +08:00
-LAN- f8c958a409
refactor(iteration): introduce specific exceptions for iteration errors (#10366) 2024-11-07 14:02:55 +08:00
-LAN- 25785d8c3f
refactor(knowledge-retrieval): improve error handling with custom exceptions (#10385) 2024-11-07 14:02:46 +08:00
-LAN- 35d3da9697
refactor(tool-node): introduce specific exceptions for tool node errors (#10357) 2024-11-07 14:02:38 +08:00
-LAN- d3e9930235
refactor(question_classifier): improve error handling with custom exceptions (#10365) 2024-11-07 14:02:30 +08:00
Matsuda 1e8457441d
fix(model_runtime): remove vision from features for Claude 3.5 Haiku (#10360) 2024-11-06 17:42:18 +08:00
Infinitnet 5a9448245b
fix: remove unsupported vision in OpenRouter Haiku 3.5 (#10364) 2024-11-06 17:41:48 +08:00
Bowen Liang d45d90e8ae
chore: lazy import sagemaker (#10342) 2024-11-06 12:45:22 +08:00
方程 2b7341af57
Gitee AI tools (#10314) 2024-11-06 08:51:13 +08:00
Summer-Gu ce1f9d935d
feat: The SSRF request timeout configuration item is added (#10292) 2024-11-06 08:50:57 +08:00
Infinitnet bdadca1a65
feat: add support for anthropic/claude-3-5-haiku through OpenRouter (#10331) 2024-11-06 08:26:44 +08:00
Benjamin d7b4d0756e
feat(vannaai): add base_url configuration (#10294) 2024-11-05 20:58:49 +08:00
非法操作 d92e3bd620
fix: special prompt not work for comfyUI tool (#10307) 2024-11-05 18:21:41 +08:00
-LAN- ae254f0a10
fix(http_request): improve parameter initialization and reorganize tests (#10297) 2024-11-05 16:30:23 +08:00
pinsily 5f21d13572
fix: handle KeyError when accessing rules in CleanProcessor.clean (#10258) 2024-11-05 14:47:15 +08:00
非法操作 bf9349c4dc
feat: add xAI model provider (#10272) 2024-11-05 14:42:47 +08:00
Matsuda 4847548779
feat(model_runtime): add new model 'claude-3-5-haiku-20241022' (#10285) 2024-11-05 14:41:39 +08:00
Matsuda cb245b5435
fix(model_runtime): fix wrong max_tokens for Claude 3.5 Haiku on Amazon Bedrock (#10286) 2024-11-05 14:41:15 +08:00
-LAN- 08c731fd84
fix(node): correct file property name in function switch (#10284) 2024-11-05 14:23:18 +08:00
Novice d1505b15c4
feat: Iteration node support parallel mode (#9493) 2024-11-05 10:32:49 +08:00
-LAN- 2c4d8dbe9b
feat(document_extractor): support tool file in document extractor (#10217) 2024-11-05 09:49:43 +08:00
Matsuda 9305ad2102
feat: support Claude 3.5 Haiku on Amazon Bedrock (#10265) 2024-11-05 09:42:51 +08:00
-LAN- 7a98dab6a4
refactor(parameter_extractor): implement custom error classes (#10260) 2024-11-05 09:27:51 +08:00
guogeer 971defbbbd
fix: buitin tool aippt (#10234) 
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
 2024-11-04 18:46:39 +08:00
-LAN- 6b0de08157
fix(validation): allow to use 0 in the inputs form (#10255) 2024-11-04 18:34:55 +08:00
方程 2aa171c348
Using a dedicated interface to obtain the token credential for the gitee.ai provider (#10243) 2024-11-04 17:22:02 +08:00
-LAN- 6452342222
feat(workflow): add configurable workflow file upload limit (#10176) 
Co-authored-by: JzoNg <jzongcode@gmail.com>
 2024-11-04 15:55:34 +08:00
-LAN- 9369cc44e6
refactor(list_operator): replace ValueError with InvalidKeyError (#10222) 2024-11-04 15:23:08 +08:00
-LAN- 38bca6731c
refactor(workflow): introduce specific error handling for LLM nodes (#10221) 2024-11-04 15:22:58 +08:00
-LAN- 2adab7f71a
refactor(http_request): add custom exception handling for HTTP request nodes (#10219) 2024-11-04 15:22:50 +08:00
-LAN- be96f6e62d
refactor(workflow): introduce specific exceptions for code validation (#10218) 2024-11-04 15:22:41 +08:00
-LAN- 8b5ea39916
chore(llm_node): remove unnecessary type ignore for context assignment (#10216) 2024-11-04 15:22:31 +08:00
Jyong 1024fc623e
fix the ssrf of docx file extractor external images (#10237) 2024-11-04 15:22:07 +08:00
Jiang 0c9e79cd67
Add Lindorm as a VDB choice (#10202) 
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
 2024-11-04 09:10:26 +08:00
-LAN- 61da0f08dd
refactor(validation): improve input validation logic (#10175) 2024-11-03 11:55:46 +08:00
-LAN- 1432c268a8
chore(list_operator): refine exception handling for error specificity (#10206) 2024-11-03 11:55:19 +08:00
-LAN- ec6a03afdd
fix(document_extractor): update base exception class (#10208) 2024-11-03 11:55:07 +08:00
Xiao Ley b28cf68097
chore: enable vision support for models in OpenRouter that should have supported vision (#10191) 2024-11-02 19:45:20 +08:00
-LAN- 53a7cb0e9d
feat(document_extractor): integrate unstructured API for PPTX extraction (#10180) 2024-11-01 23:19:11 +08:00
-LAN- 86739bea8b
fix(tools): suppress RuntimeWarnings in podcast audio generator (#10182) 2024-11-01 20:59:40 +08:00
Lawrence Li 76b0328eb1
feat: add gpustack model provider (#10158) 2024-11-01 17:23:30 +08:00
-LAN- 3c85136279
refactor(tools): Avoid warnings. (#10161) 2024-11-01 17:17:27 +08:00
Jyong 82033af097
clean un-allowed special charters when doing indexing estimate (#10153) 2024-11-01 15:09:22 +08:00
larcane97 8d5456b6d0
Add VESSL AI OpenAI API-compatible model provider and LLM model (#9474) 
Co-authored-by: moon <moon@vessl.ai>
 2024-11-01 13:38:52 +08:00
Coal Pigeon 4d5546953a
add llm: ernie-4.0-turbo-128k of wenxin (#10135) 
Co-authored-by: Pigeon姚宏锋 <pigeon.yhf@galaxyoversea.com>
 2024-10-31 21:49:04 +08:00
Shili Cao b61baa87ec
fix: avoid unexpected error when create knowledge base with baidu vector database and wenxin embedding model (#10130) 2024-10-31 21:34:23 +08:00
llinvokerl 805c701767
fix: bar chart issue with duplicate x-axis labels being incorrectly ignored (#10134) 
Co-authored-by: liusurong.lsr <liusurong.lsr@alibaba-inc.com>
 2024-10-31 21:25:47 +08:00
Jyong dad041c49f
fix issue: query is none when doing retrieval (#10129) 2024-10-31 21:25:00 +08:00
omr 11ca1bec0b
fix: optimize unique document filtering with set (#10082) 2024-10-31 16:32:58 +08:00
非法操作 bd6175157c
feat: enhance comfyui workflow (#10085) 2024-10-31 10:00:22 +08:00
Bowen Liang 0bdae34b5e
improve: significantly speed up the server launching time by async preloading tool providers (#9146) 2024-10-31 00:21:01 +08:00
Charlie.Wei f6fecb957e
fix azure chatgpt o1 parameter error (#10067) 2024-10-30 22:08:56 +08:00
-LAN- 3b53e06e0d
fix(workflow): refine variable type checks in LLMNode (#10051) 2024-10-30 16:23:12 +08:00
zhuhao 92a3898540
fix: resolve the incorrect model name of hunyuan-standard-256k (#10052) 2024-10-30 15:43:29 +08:00
zhuhao 7433095240
chore: use dify_config.TIDB_SPEND_LIMIT instead of constant value (#10038) 2024-10-30 15:43:07 +08:00
zhuhao 0095896051
feat: add YAML type in document extractor node (#9997) 2024-10-30 13:47:19 +08:00
Jyong 9ebd453b87
add rerank check when doing mutil-retrieval (#9998) 2024-10-30 11:17:39 +08:00
非法操作 c7fb8a4f20
fix: conversation variable may not change in the answer node (#10034) 2024-10-30 11:10:31 +08:00
-LAN- eb87e690ed
fix(llm-node): handle NoneSegment variables properly (#9978) 2024-10-30 08:46:11 +08:00
Hiroshi Fujita 539fc8b760
Fix content-type header case sensitivity (#9961) 2024-10-30 02:11:18 +08:00
powerfool 878d13ef42
Added OceanBase as an option for the vector store in Dify (#10010) 2024-10-29 21:10:18 +08:00
Jyong 5580bcf870
add tidb spend limit config (#9999) 2024-10-29 17:51:13 +08:00
非法操作 12adcf8925
fix: gemini model use some tools raise error (#9993) 2024-10-29 16:09:29 +08:00
roadgoat19 c8ef9223e5
feat: couchbase integration (#6165) 
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Elliot Scribner <elliot.scribner@couchbase.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
 2024-10-29 15:00:23 +08:00
Jyong f47177ecb4
add top_k for es full text search (#9963) 2024-10-28 23:04:54 +08:00
-LAN- 4da0b70694
feat(http-request-executor): enhance file handling in HTTP requests (#9944) 2024-10-28 17:51:01 +08:00
Xiao Ley 7056009b6a
feat(tools): add Baidu translation tool (#9943) 2024-10-28 17:18:28 +08:00
非法操作 ddb960ddfb
feat: support Vectorizer can be used in workflow (#9932) 2024-10-28 16:52:57 +08:00
方程 0ebd985672
feat: add models for gitee.ai (#9490) 2024-10-28 16:52:12 +08:00
zhuhao aa11141660
feat: add stable-diffusion-3-5-large for the text-to-image tool with siliconflow (#9909) 2024-10-27 21:17:36 +08:00
zhuhao 8bb5b943d7
fix(tools): remove the undefined variable parameter_type (#9908) 2024-10-27 11:56:29 +08:00
ice yao 22776f24ab
chore: Extract common functions of the base model in Azure OpenAI Provider (#9907) 2024-10-27 11:56:17 +08:00
Zixuan Cheng 216442ddc1
feat(workflow): Support JSON type in document extractor node (#9899) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-10-26 20:29:48 +08:00
-LAN- 72ea3d6b98
fix(workflow): Take back LLM streaming output after IF-ELSE (#9875) 2024-10-25 22:33:34 +08:00
virgosoy 17cacf258e
fix: wrong element object (#9868) 2024-10-25 22:32:41 +08:00
非法操作 ace7ffab5f
feat: support comfyui workflow tool image generate image (#9871) 2024-10-25 18:48:07 +08:00
非法操作 1b5adf40da
fix: moonshot response_format raise error (#9847) 2024-10-25 14:59:55 +08:00
Jyong 18106a4fc6
add tidb on qdrant type (#9831) 
Co-authored-by: Zhaofeng Miao <522856232@qq.com>
 2024-10-25 13:57:03 +08:00
crazywoola 5b7b765090
fix: yuque book id should be string (#9819) 2024-10-25 11:11:18 +08:00
非法操作 ac9f1e9de5
fix: duckduckgo image search not work (#9821) 2024-10-25 10:11:33 +08:00
非法操作 2346b0ab99
chore: make doc extractor node also can extract text by file extension (#9543) 2024-10-24 22:54:48 +08:00
Zixuan Cheng 88dec6ef2b
Added description for .ppt, specify the reason for unstructured.io (#9452) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-10-24 22:13:06 +08:00
guogeer 70ddc0ce43
openai compatiable api usage and id (#9800) 
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
 2024-10-24 21:51:36 +08:00
非法操作 e2710161f6
fix: chart tool can't display chinese (#9686) 2024-10-24 18:49:49 +08:00
Jyong 5f11fe521d
remove unstructured pdf extract (#9794) 2024-10-24 18:13:05 +08:00
-LAN- d018b32d0b
fix(workflow): enhance prompt handling with vision support (#9790) 2024-10-24 17:52:11 +08:00
luckylhb90 400392230b
fixed: variable reference error (#9722) 
Co-authored-by: hobo.l <hobo.l@binance.com>
 2024-10-23 19:17:06 +08:00
-LAN- e11d5ac708
feat(model_runtime): add new model 'claude-3-5-sonnet-20241022' (#9708) 2024-10-23 17:03:30 +08:00
Jyong 3e9d271b52
nltk security issue and upgrade unstructured (#9558) 2024-10-23 16:23:55 +08:00
Pan, Wen-Ming ecc8beef3f
feat: added claude 3.5 sonnet v2 model to Google Cloud Vertex AI (#9688) 2024-10-23 16:13:51 +08:00
ybalbert001 4989d0c904
add bedrock claude 3.5 v2 support (#9685) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-10-23 13:54:21 +08:00
-LAN- 9a5bdae07f
feat(condition): add support for 'exists' and 'not exists' operators (#9687) 2024-10-23 13:25:17 +08:00
ice yao ceb2c4f3ef
chore: reuse existing test functions with upstash vdb (#9679) 2024-10-23 10:42:11 +08:00
-LAN- d5a93a6400
fix(variable_pool): handle invalid attributes in variable lookup (#9646) 2024-10-23 10:19:33 +08:00
Zven 8e7a752b2a
feat: add upstash as a new vector database provider (#9644) 2024-10-23 09:16:35 +08:00
feiyang_deepnova 999d3f1539
fix: add downstream nodes of this branch (#9640) 2024-10-23 01:20:02 +08:00
Kota-Yamaguchi a7ee51e5d8
feat: add code generator (#9051) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2024-10-22 21:57:54 +08:00
走在修行的大街上 a9db06f5e7
feat(Tools): Refactor the base table plugin (#9182) 
Co-authored-by: 黎斌 <libin.23@bytedance.com>
 2024-10-22 21:31:34 +08:00
-LAN- 5267f34e76
fix(segments): return empty string instead of "null" for text, log, and markdown properties (#9651) 2024-10-22 17:52:22 +08:00
-LAN- 36f66d40e5
refactor(api): simplify limit retrieval and return types (#9641) 2024-10-22 16:34:16 +08:00
非法操作 5f12616cb9
fix: file type document is not supported (#9618) 2024-10-22 16:33:50 +08:00
-LAN- 7263af13ed
fix(http_request): simplify JSON handling in requests (#9616) 2024-10-22 15:37:37 +08:00
zhuhao d992a809f5
fix: update the default model to gpt-4o-mini for duckduckgo ai chat (#9614) 2024-10-22 15:37:16 +08:00
-LAN- 5f12c17355
fix(core): use CreatedByRole enum for role consistency (#9607) 2024-10-22 13:03:50 +08:00
Bowen Liang 4d9160ca9f
refactor: use dify_config to replace legacy usage of flask app's config (#9089) 2024-10-22 11:01:32 +08:00
-LAN- 8f670f31b8
refactor(variables): replace deprecated 'get_any' with 'get' method (#9584) 2024-10-22 10:49:19 +08:00
-LAN- 5838345f48
fix(entities): add validator for `VisionConfig` to handle None values (#9598) 2024-10-22 10:49:03 +08:00
-LAN- ac24300274
refactor(template_transform): use keyword-only arguments (#9575) 2024-10-22 09:00:21 +08:00
-LAN- 2e657b7b12
fix(workflow): handle NoneSegments in variable extraction (#9585) 2024-10-22 08:59:04 +08:00
-LAN- c063617553
fix(workflow): improve database session handling and variable management (#9581) 2024-10-22 00:42:40 +08:00
-LAN- 38a4f0234d
fix(http_request): handle empty and string data inputs (#9579) 2024-10-21 23:35:25 +08:00
-LAN- 740a723072
fix(validation): improve variable handling and validation (#9578) 2024-10-21 23:33:16 +08:00
-LAN- 4ae0bb83f1
fix(file upload): correct upload method key for image config (#9568) 2024-10-21 20:40:47 +08:00
-LAN- 5459d812e7
fix(iteration): handle empty iterator gracefully (#9565) 2024-10-21 20:16:46 +08:00
-LAN- faad247d85
fix(upload): correct incorrect dictionary key usage (#9563) 2024-10-21 19:42:22 +08:00
ice yao 1e829ceaf3
chore: format get_customizable_model_schema return value (#9335) 2024-10-21 19:05:44 +08:00
AAEE86 9b32bfb3db
feat: Updata tongyi models (#9552) 2024-10-21 19:04:45 +08:00
非法操作 f83ed19dfe
fix: list filter node some operator raise error (#9539) 2024-10-21 15:33:42 +08:00
非法操作 53b14bde4d
fix: list filter node url not work (#9540) 2024-10-21 15:32:28 +08:00
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
非法操作 853b0e84cc
fix: draft run workflow node with image will raise error (#9406) 2024-10-21 09:05:42 +08:00
chzphoenix 42fe208eda
refactor wenxin rerank (#9486) 
Co-authored-by: cuihz <cuihz@knowbox.cn>
 2024-10-21 09:03:25 +08:00
ice yao 95ce10f23b
feat: Add custom username and avatar define in discord tool (#9514) 2024-10-20 22:06:18 +08:00
Ziyu Huang 660fc3bb34
Resolve 9508 openai compatible rerank (#9511) 2024-10-20 21:59:58 +08:00
Oliver Lee 424a7da470
add yuqye（https://www.yuque.com）tools (#8960) 
Co-authored-by: 佐井 <chengwu.lcw@alibaba-inc.com>
 2024-10-18 18:15:34 +08:00
Tao Wang b92504bebc
Added Llama 3.2 Vision Models Speech2Text Models for Groq (#9479) 2024-10-18 18:10:33 +08:00
zhuhao e0846792d2
feat: add yi custom llm intergration (#9482) 2024-10-18 17:23:21 +08:00
zhuhao b3cde9900c
feat: add parameter top-k for the llm model provided by openrouter and siliconflow (#9455) 2024-10-18 08:21:54 +08:00
ice yao 2155bba5b0
fix: update mismatch vector type (#9462) 2024-10-18 08:21:41 +08:00
zhuhao 3fc0ebdd51
feat: add yi-lightning llm model for yi (#9458) 2024-10-18 08:19:58 +08:00
chzphoenix 211f416806
feat:add wenxin rerank (#9431) 
Co-authored-by: cuihz <cuihz@knowbox.cn>
Co-authored-by: crazywoola <427733928@qq.com>
 2024-10-17 19:18:32 +08:00
zhuhao b90ad587c2
refactor: move the embedding to the rag module and abstract the rerank runner for extension (#9423) 2024-10-17 19:12:42 +08:00
zhuhao a45f8969a0
fix: remove the undefined variable line (#9446) 2024-10-17 17:25:14 +08:00
非法操作 d3c06a3f76
feat: add the workflow tool of comfyUI (#9447) 2024-10-17 16:48:42 +08:00
ybalbert001 fdcf87c70c
fix https://github.com/langgenius/dify/issues/9409 (#9433) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-10-17 10:47:56 +08:00
zhuhao 86594851cb
refactor: update the default values of top-k parameter in vdb to be consistent (#9367) 2024-10-16 16:00:21 +08:00
Jyong 50635e9c15
Fix/economical knowledge retrieval (#9396) 2024-10-16 15:13:45 +08:00
zhuhao 7d3dad3d1d
feat: add timezone conversion for time tool (#9393) 2024-10-16 11:17:40 +08:00
ice yao dd22e78515
fix: Deprecated gemma2-9b model in Fireworks AI Provider (#9373) 2024-10-16 10:44:54 +08:00
crazywoola 423df67042
fix: use gpt-4o-mini for validating credentials (#9387) 2024-10-16 10:18:06 +08:00
非法操作 da25b91980
fix: remove the stream option of zhipu and gemini (#9319) 2024-10-15 19:13:43 +08:00
Jason Tan 9b8aa9b75d
feat: add minimax abab6.5t support (#9365) 2024-10-15 19:00:05 +08:00
非法操作 4ffaabcc04
feat: add glm-4-flashx, deprecated chatglm_turbo (#9357) 2024-10-15 17:33:34 +08:00
Warren Wong b597a0d31c
fix: Azure OpenAI o1 max_completion_token and get_num_token_from_messages error (#9326) 
Co-authored-by: wwwc <wwwc@outlook.com>
 2024-10-15 16:26:44 +08:00
Wei-shun Bao fb32e5ca9a
fix: In the output, the order of 'ta' is sometimes reversed as 'at'. #8015 (#8791) 2024-10-15 16:24:29 +08:00
zhuhao cd7ab6231f
refactor: Add an enumeration type and use the factory pattern to obtain the corresponding class (#9356) 2024-10-15 12:51:13 +08:00
ice yao 5908fd6552
Adapt input type parameter with MiniMax embedding model (#9342) 2024-10-15 09:01:00 +08:00
ice yao 3f9d6759d4
feat: Add qwen2.5 72B Instruct model in Fireworks AI (#9340) 2024-10-14 23:15:34 +08:00
ice yao aba70207ab
feat: Add fireworks custom llm intergration (#9333) 2024-10-14 22:50:31 +08:00
Hash Brown fa47f0c707
chore: disable chat service API passing `parent_message_id` (#8984) 2024-10-14 19:13:16 +08:00
非法操作 ffc3f33670
chore: remove the copied zhipu_ai sdk (#9270) 2024-10-14 10:53:45 +08:00
kurokobo 857055b797
fix: remove the latest message from the user that does not have any answer yet (#9297) 2024-10-13 23:25:50 +08:00
ice yao d15ba3939d
Add Volcengine VikingDB as new vector provider (#9287) 2024-10-13 21:26:05 +08:00
zhuhao d97d3ff5fc
chore: add abstract decorator and output log when query embedding fails (#9264) 2024-10-12 23:58:41 +08:00
Shili Cao 2ec6ffe478
feat:support baidu vector db (#9185) 2024-10-12 23:24:17 +08:00
takatost 23ce1fb1ba
chore: optimize the trace ops slow queries on node executions. (#9282) 2024-10-12 18:30:46 +08:00
takatost 29188e0562
chore: use cache instead of re-querying node record during workflow execution (#9280) 2024-10-12 17:48:59 +08:00
crazywoola 93af87a9e0
fix: move exception to debug mode (#9258) 2024-10-12 09:28:45 +08:00
Jyong 42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 2024-10-11 19:21:03 +08:00
AkisAya d7b8e071dd
fix:#9222 create or update custum tools error (#9228) 2024-10-11 17:12:30 +08:00
Jyong 80b62d50f5
Fix/add es num_candidates (#9225) 2024-10-11 16:04:23 +08:00
AAEE86 fe41e8bc18
feat: add siliconflow custom add model interface (#8745) 2024-10-11 11:56:11 +08:00
Fei He 5c76131d3d
feat: add gte rerank for tongyi (#9153) 2024-10-11 10:35:56 +08:00
Jyong cabdb4ef17
fix retrieval resource positon missed (#9155) 
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
 2024-10-11 10:32:42 +08:00
zhuhao 05c1ef75c4
feat: add allow_llm_to_see_data flag for vanna (#9156) 2024-10-10 17:39:26 +08:00
Sa Zhang 75f0a5e36a
fix: Typo Correction in jina.yaml (#9161) 2024-10-10 17:00:34 +08:00
takatost 477beae3bb
fix: missing usage of metadata in the chatflow app (#9167) 2024-10-10 16:34:06 +08:00
Charlie.Wei 6b6e94da08
Fix code indentation errors (#9164) 2024-10-10 15:26:38 +08:00
Ziyu Huang fc60b554a1
Fixes #9159: Modify to make it works to llama.cpp rerank API (#9160) 2024-10-10 15:18:07 +08:00
Joe e947103b6d
Feat/add workflow sys params (#9108) 
Co-authored-by: Joel <iamjoel007@gmail.com>
 2024-10-10 11:15:52 +08:00
ronaksingh27 62051d5171
Corrected type annotation to "Any" from "any" all files in "model_providers" folder (#9135) 2024-10-10 10:34:25 +08:00
luckylhb90 2024a6c941
fix: vertex ai remote url error(Error: not enough values to unpack) (#9134) 
Co-authored-by: hobo.l <hobo.l@binance.com>
 2024-10-10 10:16:42 +08:00
呆萌闷油瓶 060897b25b
chore:add azure openai api version 2024-09-01-preview (#9141) 2024-10-10 10:07:49 +08:00
非法操作 499cc57082
fix: response_format of model_parameters will not be removed (#9148) 2024-10-10 10:07:21 +08:00
Hash Brown 511ffa4698
fix: follow-up (suggested questions) does not refer to the most recen… (#9122) 2024-10-09 21:10:55 +08:00
pinsily 7a1da2409d
add generate conversation name error log (#9117) 2024-10-09 21:09:36 +08:00
Charlie.Wei 55679b4389
azure add o1-mini、o1-preview models (#9088) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2024-10-09 16:15:03 +08:00
Bowen Liang 240b66d737
chore: avoid implicit optional in type annotations of method (#8727) 2024-10-09 14:36:43 +08:00
zhuhao 5fcd614186
feat: output the execution results of tool should only in debug mode (#9104) 2024-10-09 12:53:55 +08:00
zhuhao 4be1aa516c
feat: add tags for vanna tools (#9102) 2024-10-09 12:53:03 +08:00
zhuhao 5e250403d3
chore: add the missing tool names to the _position file (#9099) 2024-10-09 11:04:26 +08:00
SebastjanPrachovskij f8af9c6ad0
refactor: Update countries & languages list for SearchApi engines (#9090) 2024-10-09 10:24:09 +08:00
ybalbert001 57994e4a24
fix s3 presign url check problem, support two versions(v2,v4) (#9093) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-10-09 10:23:21 +08:00
crazywoola 3a0734d94c
Feat/9081 add support for llamaguard through groq provider (#9083) 2024-10-09 01:00:10 +08:00
zhuhao 5b7de7705e
feat: add timestamp conversion and timestamp retrieval for time tool (#9085) 2024-10-08 23:25:11 +08:00
zhuhao 5213650fed
feat: update the xinf tool's API key to optional (#9073) 2024-10-08 19:07:53 +08:00
Infinitnet e741ee2f45
Correct max_tokens for OpenRouter Sonnet 3.5 (#9068) 2024-10-08 16:06:47 +08:00
非法操作 966e65bb66
fix: zhipu ai web_search not work (#9058) 2024-10-08 15:36:31 +08:00
aiscrm 2ab8bc679f
fix: Missing model information in llm span of Langfuse #9029 (#9030) 
Co-authored-by: corel <corelchen@qq.com>
 2024-10-07 18:03:30 +08:00
zg0d233 fcfa1252a0
fix bug when adding openai or openai-compatible stt model instance (#9006) 2024-10-07 11:06:38 +08:00
Giannis Kepas dc5839b6bb
feat: Update AWS Bedrock supported regions (#8992) 2024-10-03 15:17:28 +08:00
zhaoyi233 4373777871
Update json_in_md_parser.py (#8983) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-10-03 10:20:56 +08:00
ice yao 415d27c8bf
feat(Tools): add discord incoming webhook for sending messages (#7852) 2024-10-02 13:18:35 +08:00
zhuhao 24ba9fdf6c
feat: enhance stepfun image generation tool (#8954) 2024-10-01 10:55:54 +08:00
zhuhao 824a0dd63e
feat: add qwen2.5-72b and llama3.2 for openrouter (#8956) 2024-10-01 10:55:51 +08:00
omr 2deaece7e2
refactor: remove unnecessary comment (#8949) 2024-10-01 09:14:49 +08:00
CXwudi 0d84221b2c
chore: sort Gemini models (#8951) 2024-10-01 09:14:36 +08:00
CXwudi cdd7e55a88
chore: add missing models from Voyage (#8950) 2024-10-01 09:14:21 +08:00
Jyong 625e4c4c72
fix multiple retrieval in knowledge node (#8942) 2024-09-30 23:07:04 +08:00
Aurelius Huang 4585cffce1
fix: Compatible with special characters in pg full-text search. (#8921) 
Co-authored-by: Aurelius Huang <cm.huang@aftership.com>
 2024-09-30 16:32:23 +08:00
Jyong 9d221a5e19
external knowledge api (#8913) 
Co-authored-by: Yi <yxiaoisme@gmail.com>
 2024-09-30 15:38:43 +08:00
zhuhao 77aef9ff1d
refactor: optimize the calculation of rerank threshold and the logic for forbidden characters in model_uid (#8879) 2024-09-30 12:55:01 +08:00
zhuhao 503561f464
fix: fix the data validation consistency issue in keyword content review (#8908) 2024-09-30 12:52:18 +08:00
-LAN- ada9d408ac
refactor(api/variables): VariableError as a ValueError. (#8554) 2024-09-30 12:48:58 +08:00
Zhaofeng Miao 369e1e6f58
feat(website-crawl): add jina reader as additional alternative for website crawling (#8761) 2024-09-30 09:57:19 +08:00
zhuhao fb49413a41
feat: add voyage ai as a new model provider (#8747) 2024-09-29 16:55:59 +08:00
zhuhao 42dfde6546
docs: add english versions for the files customizable_model_scale_out and predefined_model_scale_out (#8871) 2024-09-29 16:16:56 +08:00
chenxu9741 c531b4a911
fix: #8843 event: tts_message_end always return in api streaming resp… (#8846) 2024-09-29 16:13:20 +08:00
longzhihun e4ed916baa
Add Jamba and Llama3.2 model support (#8878) 2024-09-29 16:12:56 +08:00
Bowen Liang 74f58f29f9
chore: bump ruff to 0.6.8 for fixing violation in SIM910 (#8869) 2024-09-29 00:29:59 +08:00
zhuhao f97607370a
refactor: update Callback to an abstract class (#8868) 2024-09-28 21:41:02 +08:00
zhuhao 850492dafa
feat: deprecate gte-Qwen2-7B-instruct embedding model (#8866) 2024-09-28 21:40:27 +08:00
zhuhao 61c89a9168
feat: add internlm2.5-20b and qwen2.5-coder-7b model (#8862) 2024-09-28 16:31:02 +08:00
takatost 49af18fbd6
fix: customize model credentials were invalid despite the provider credentials being active (#8864) 2024-09-28 15:54:26 +08:00
zhuhao 6cd22f3bca
fix: update qwen2.5-coder-7b model name (#8861) 2024-09-28 15:01:27 +08:00
ice yao 27e33fb15c
chore: fix wrong VectorType match case (#8857) 2024-09-28 10:54:04 +08:00
zhuhao 55e6123db9
feat: add min-connection and max-connection for pgvector (#8841) 2024-09-27 18:16:20 +08:00
走在修行的大街上 c828a5dfdf
feat(Tools): add feishu tools (#8800) 
Co-authored-by: 黎斌 <libin.23@bytedance.com>
 2024-09-27 17:31:45 +08:00
CXwudi 0603359e2d
fix: delete harm catalog settings for gemini (#8829) 2024-09-27 13:49:03 +08:00
HowardChan bb781764b8
Add Llama3.2 models in Groq provider (#8831) 2024-09-27 12:13:00 +08:00
zhuhao 29275c7447
feat: deprecate mistral model for siliconflow (#8828) 2024-09-27 12:11:56 +08:00
8bitpd 4c1063e1c5
fix: AnalyticdbVector retrieval scores (#8803) 2024-09-27 12:05:21 +08:00
Shai Perednik a36117e12d
Updated the YouTube channel to Dify's (#8817) 2024-09-27 09:15:33 +08:00
CXwudi e5efd09ebb
chore: massive update of the Gemini models based on latest documentation (#8822) 2024-09-27 09:14:33 +08:00
wenmeng zhou ecc951609d
add more detailed doc for models of qwen series (#8799) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-09-26 22:32:33 +08:00
ice yao 063474f408
Add llama3.2 model in fireworks provider (#8809) 2024-09-26 22:21:01 +08:00
AAEE86 9a4b53a212
feat: add stream for Gemini (#8678) 2024-09-26 19:08:59 +08:00
AAEE86 03edfbe6f5
feat: add qwen to add custom model parameters (#8759) 2024-09-26 19:04:25 +08:00
zhuhao 008e0efeb0
refactor: update delete method as an abstract method (#8794) 2024-09-26 16:36:21 +08:00
cx 128a66f7fe
fix: Ollama modelfeature set vision, and an exception occurred at the… (#8783) 2024-09-26 16:34:40 +08:00
非法操作 d1173a69f8
fix: the Image-1X tool (#8787) 2024-09-26 13:48:06 +08:00
Shenghang Tsai a0b0809b1c
Add more models for SiliconFlow (#8779) 2024-09-26 11:29:53 +08:00
Aaron Ji 4c9ef6e830
fix: update usage for Jina Embeddings v3 (#8771) 2024-09-26 11:29:35 +08:00
非法操作 0c96f0aa51
fix: credential *** should be string (#8785) 2024-09-26 11:24:03 +08:00
zhuhao ac73763726
chore: add input_type param desc for the _invoke method of text_embedding (#8778) 2024-09-26 11:23:09 +08:00
非法操作 5ba19d64e9
fix: TavilySearch tool get api link (#8780) 2024-09-26 11:22:18 +08:00
Qun fefbc43fb0
chore: fix comfyui tool doc url (#8775) 2024-09-26 08:18:13 +08:00
Pan, Wen-Ming 02ff6cca70
feat: add support for Vertex AI Gemini 1.5 002 and experimental models (#8767) 2024-09-25 21:27:26 +08:00
cherryhuahua d0e0111f88
fix:Spark's large language model token calculation error #7911 (#8755) 2024-09-25 14:51:42 +08:00
crazywoola bf64ff215b
fix: . is missing in file_extension (#8736) 2024-09-25 10:09:20 +08:00
ybalbert001 68c7e68a8a
Fix Issue: switch LLM of SageMaker endpoint doesn't take effect (#8737) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-09-25 09:12:35 +08:00
ice yao 91f70d0bd9
Add embedding models in fireworks provider (#8728) 2024-09-25 08:47:11 +08:00
Jyong 4669eb24be
add embedding input type parameter (#8724) 2024-09-24 21:53:50 +08:00
Sa Zhang debe5953a8
Fix/update jina ai products labels and descriptions (#8730) 
Co-authored-by: sa zhang <sa.zhang@jina.ai>
 2024-09-24 21:19:49 +08:00
Shota Totsuka 1c7877b048
fix: remove harm category setting from vertex ai (#8721) 2024-09-24 20:53:26 +08:00
ice yao 64baedb484
fix: update nomic model provider token calculation (#8705) 2024-09-24 14:04:07 +08:00
Benjamin 4638f99aaa
fix: change model provider name issue Ref #8691 (#8710) 2024-09-24 13:26:58 +08:00
AAEE86 aebe5fc68c
fix: Remove unsupported parameters in qwen model (#8699) 2024-09-24 13:06:21 +08:00
zhuhao 1ecf70dca0
feat: add mixedbread as a new model provider (#8523) 2024-09-24 11:20:15 +08:00
ybalbert001 7c485f8bb8
fix llm integration problem: It doesn't work on docker env (#8701) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-09-24 10:33:30 +08:00
themanforfree 21e9608b23
feat: add xinference sd web ui api tool (#8385) 
Signed-off-by: themanforfree <themanforfree@gmail.com>
 2024-09-24 10:20:06 +08:00
Sa Zhang 7f1b028840
fix: change the brand name to Jina AI (#8691) 
Co-authored-by: sa zhang <sa.zhang@jina.ai>
 2024-09-23 21:39:26 +08:00
Nam Vu bef83a4d2e
fix: typos and improve naming conventions: (#8687) 2024-09-23 21:32:58 +08:00
crazywoola 8cc9e68363
fix: prompt for the follow-up suggestions (#8685) 2024-09-23 20:00:34 +08:00
ice yao d7aada38a1
Add nomic embedding model provider (#8640) 2024-09-23 19:57:21 +08:00
Nam Vu c7eacd1aac
chore: Optimize I18nObject class for better performance and readability (#8681) 2024-09-23 18:40:40 +08:00
AAEE86 a126d535cf
add Spark Max-32K (#8676) 2024-09-23 16:39:46 +08:00
AAEE86 3554a803e7
add zhipuai web search (#8668) 2024-09-23 16:19:42 +08:00
AAEE86 c66cecaa55
add Qwen model translate (#8674) 2024-09-23 16:18:55 +08:00
Bowen Liang 86f90fd9ff
chore: skip PLR6201 linter rule (#8666) 2024-09-23 15:28:57 +08:00
haike-1213 4c7beb9d7b
fix: Assignment exception (#8663) 
Co-authored-by: fum <fum@investoday.com.cn>
 2024-09-23 15:23:52 +08:00
Aaron Ji 3618a97c20
feat: extend api params for Jina Embeddings V3 (#8657) 2024-09-23 13:45:09 +08:00
Shota Totsuka 03fdf5e7f8
chore: Enable Japanese descriptions for Tools (#8646) 2024-09-23 09:06:01 +08:00
zhuhao e34f04380d
feat: add deepseek-v2.5 for model provider siliconflow (#8639) 2024-09-22 21:44:06 +08:00
zhuhao 6df77038a2
docs: fix predefined_model_scale_out.md redirect error (#8633) 2024-09-22 16:45:45 +08:00
zhuhao 45c0a44411
feat: add qwen2.5 for model provider siliconflow (#8630) 2024-09-22 16:42:34 +08:00
Nam Vu eaa7e9b1f0
fix: llm_generator.py JSONDecodeError (#8504) 2024-09-22 14:02:12 +08:00
omr 8fd297f8b4
fix: redundant check for available_document_count (#8491) 2024-09-22 13:39:41 +08:00
CXwudi 97895ec41a
chore: add Gemini newest experimental models (close #7121) (#8621) 2024-09-22 13:38:08 +08:00
sino 6d56d5c1f6
feat: support o1 series models for openrouter (#8358) 2024-09-22 10:23:50 +08:00
AAEE86 c9f1e18df1
Add model parameter translation (#8509) 
Co-authored-by: swingchen01 <swings@126.com>
Co-authored-by: 陈长君 <chenchangjun@shuwen.com>
 2024-09-22 10:14:33 +08:00
Waffle 740fad06c1
feat(tools/cogview): Updated cogview tool to support cogview-3 and the latest cogview-3-plus (#8382) 2024-09-22 10:14:14 +08:00
ice yao 0665268578
Add Fireworks AI as new model provider (#8428) 2024-09-22 10:13:00 +08:00
呆萌闷油瓶 c8b9bdebfe
feat:use xinference tts stream mode (#8616) 2024-09-22 10:08:35 +08:00
Shota Totsuka a587f0d3f1
docs: Add Japanese documentation for tools (#8469) 2024-09-22 09:04:00 +08:00
Hash Brown 8c51d06222
feat: regenerate in `Chat`, `agent` and `Chatflow` app (#7661) 2024-09-22 03:15:11 +08:00
zhuhao 831c5a93af
refactor(ops): Optimize the iteration for filter_none_values and use logging.error to record logs when an exception occurs (#8461) 2024-09-21 22:56:37 +08:00
AAEE86 1a8dcae10e
add Qwen custom add model interface (#8565) 2024-09-21 22:52:10 +08:00
Nam Vu 8219f9e090
fix: api/core/ops/ops_trace_manager.py (#8501) 2024-09-21 20:49:01 +08:00
AAEE86 5ddb601e43
add MixtralAI Model (#8517) 2024-09-21 18:08:07 +08:00
Hongbin 5541248264
Update the PerfXCloud provider model list，Update PerfXCloudProvider validate_provider_credentials method. (#8587) 
Co-authored-by: xhb <466010723@qq.com>
 2024-09-21 17:33:15 +08:00
takatost e0a3307563
fix(workflow): "Max submit count reached" error occurred when executing workflow as tool in iteration (#8595) 2024-09-20 19:47:25 +08:00
Qun 1583283635
ComfyUI tool use the new internal enumeration class "VariableKey" (#8533) 2024-09-20 17:42:47 +08:00
Su Yang c87f710d58
Fix: update qwen model and model config (#8584) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-09-20 17:05:57 +08:00
Su Yang 1568c5cae9
fix: fix qwen series model type (#8580) 2024-09-20 15:29:33 +08:00
MuYu a03919c3b3
feat: add hunyuan-vision (#8529) 2024-09-19 18:08:01 +08:00
Su Yang d6de96c4b4
feat: sync Qwen API with Aliyun Bailian (#8538) 2024-09-19 17:08:59 +08:00
takatost ffd2f61dd9
fix: thread_pool submit count in parallel workflow not releasing (#8549) 2024-09-19 15:34:56 +08:00
takatost 54b9e1f6d1
fix: ci issues(missing duckduckgo-search==6.2.11, ruff lint issue) (#8543) 2024-09-19 11:43:00 +08:00
Wang Bo 6f222b49f2
refactor: rename task_type to task for jina embeddings v3 (#8488) 2024-09-18 14:53:15 +08:00
-LAN- 8dfe8c773a
chore: Deprecate gpt-3.5-turbo-0613 and gpt-3.5-turbo-16k-0613 models (#8500) 2024-09-18 14:38:09 +08:00
Qun cf645c3ba1
feat: Add ComfyUI tool for Stable Diffusion (#8160) 2024-09-18 10:56:29 +08:00
Xiao Ley 6dba68f62d
feat: Add base URL settings and secure_ascii options to the Brave search tool (#8463) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-09-15 17:38:43 +08:00
非法操作 3d083b758f
feat: add flux dev of siliconflow image-gen tool (#8450) 2024-09-15 17:14:12 +08:00
takatost bf16de50fe
fix: internal error when tool authorization (#8449) 2024-09-14 21:50:02 +08:00
Jyong 7e611ffbf3
multi-retrival use dataset's top-k (#8416) 2024-09-14 21:48:44 +08:00
走在修行的大街上 72b7f8a949
Bugfix/fix feishu plugins (#8443) 
Co-authored-by: 黎斌 <libin.23@bytedance.com>
 2024-09-14 18:59:06 +08:00
takatost 88c9834ef2
chore(workflow): Optimize the iteration when selecting a variable from a branch in the output variable causes iteration index err (#8440) 2024-09-14 18:02:43 +08:00
ybalbert001 b6ad7a1e06
Fix: https://github.com/langgenius/dify/issues/8190 (Update Model nam… (#8426) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-09-14 17:14:18 +08:00
Aaron Ji 6f7625fa47
chore: update Jina embedding model (#8376) 2024-09-14 16:21:17 +08:00
takatost f01602b570
fix(workflow): the answer node after the iteration node containing the answer was output prematurely (#8419) 2024-09-14 14:02:09 +08:00
HowardChan 0123498452
fix:logs and rm unused codes in CacheEmbedding (#8409) 2024-09-14 12:56:45 +08:00
ybalbert001 b613b11422
Fix: Support Bedrock cross region inference #8190 (Update Model name to distinguish between different region groups) (#8402) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-09-14 11:06:20 +08:00
crazywoola 71b4480c4a
fix: o1-mini 65563 -> 65536 (#8388) 2024-09-14 02:39:58 +08:00
Bowen Liang 5b98acde2f
chore: improve usage of striping prefix or suffix of string with Ruff 0.6.5 (#8392) 2024-09-13 23:34:39 +08:00
Bowen Liang aad6f340b3
fix (#8322 followup): resolve the violation of pylint rules (#8391) 2024-09-13 23:19:36 +08:00
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2024-09-13 22:42:08 +08:00
xiandan-erizo 1ab81b4972
support hunyuan-turbo (#8372) 
Co-authored-by: sunkesi <sunkesi@hosecloud.com>
 2024-09-13 20:21:48 +08:00
非法操作 06b66216d7
chore: update firecrawl scrape to V1 api (#8367) 2024-09-13 20:02:00 +08:00
takatost cd3eaed335
fix(workflow): both parallel and single branch errors occur in if-else (#8378) 2024-09-13 19:55:54 +08:00
takatost 24af4b9313
fix: o1-series model encounters an error when the generate mode is blocking (#8363) 2024-09-13 15:37:54 +08:00
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2024-09-13 14:24:49 +08:00
-LAN- 08c486452f
fix: score_threshold handling in vector search methods (#8356) 2024-09-13 14:24:35 +08:00
sino a45ac6ab98
fix: ark token usage is none (#8351) 2024-09-13 14:19:24 +08:00
takatost 4637ddaa7f
feat: add o1-series models support in Agent App (ReACT only) (#8350) 2024-09-13 13:08:27 +08:00
Jyong 49cee773c5
fixed score threshold is none (#8342) 2024-09-13 10:21:58 +08:00
takatost e90d3c29ab
feat: add OpenAI o1 series models support (#8328) 2024-09-13 02:15:19 +08:00
Nam Vu 153807f243
fix: response_format label (#8326) 2024-09-12 23:17:29 +08:00
Ikko Eltociear Ashimine 5db0b56c5b
docs: update lambda_translate_utils.yaml (#8293) 2024-09-12 20:33:07 +08:00
Tamer 404db1ae5b
Fix VariableEntityType Bug external-data-tool -> external_data_tool (#8299) 2024-09-12 20:27:55 +08:00
呆萌闷油瓶 02c4b1af71
chore:add Azure openai api version 2024-08-01-preview (#8291) 2024-09-12 20:22:57 +08:00
ybalbert001 d4985fb3aa
Fix: Support Bedrock cross region inference [#8190](https://github.com/langgenius/dify/issues/8190) (#8317) 2024-09-12 19:15:20 +08:00
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2024-09-12 15:50:49 +08:00
Bowen Liang c69f5b07ba
chore: apply ruff E501 line-too-long linter rule (#8275) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-09-12 14:00:36 +08:00
takatost 56c90e212a
fix(workflow): missing content in the answer node stream output during iterations (#8292) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-09-12 13:59:48 +08:00
Bowen Liang 0f14873255
chore: cleanup ruff flake8-simplify linter rules (#8286) 
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-09-12 12:55:45 +08:00
Bowen Liang 781d294f49
chore: cleanup pycodestyle E rules (#8269) 2024-09-11 18:55:00 +08:00
yalei f515af2232
let claude models in bedrock support the response_format parameter (#8220) 
Co-authored-by: duyalei <>
 2024-09-11 18:24:50 +08:00
crazywoola 4d2cd6703b
chore: remove useless code (#8198) 2024-09-11 18:19:34 +08:00
Bowen Liang 292220c596
chore: apply pep8-naming rules for naming convention (#8261) 2024-09-11 16:40:52 +08:00
HowardChan 53f37a6704
fix:ollama text embedding 500 error (#8252) 2024-09-11 16:23:19 +08:00
Leo.Wang 75c1a82556
Update Gitlab query field, add query by path (#8244) 2024-09-11 16:09:53 +08:00
Nam Vu 342607f4a4
fix: truthy value (#8208) 2024-09-11 15:44:53 +08:00
takatost 5f4cdd66fa
fix(workflow): IF-ELSE nodes connected to the same subsequent node cause execution to stop (#8247) 2024-09-11 12:28:32 +08:00
HowardChan 82c42b9ec5
fix:error when adding the ollama embedding model (#8236) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-09-11 10:25:45 +08:00
takatost cee0c51dbb
feat: add from_variable_selector for stream chunk / message event (#8228) 2024-09-10 22:15:50 +08:00
takatost fdbbdb706f
fix(workflow): answers are output simultaneously across different braches in the question classifier node. (#8225) 2024-09-10 21:11:35 +08:00
takatost f6dfe23cf8
fix(workflow): in multi-parallel execution with multiple conditional branches (#8221) 2024-09-10 21:09:18 +08:00
Jyong bb3002b173
revert page column (#8217) 2024-09-10 18:21:22 +08:00
Bowen Liang 2cf1187b32
chore(api/core): apply ruff reformatting (#7624) 2024-09-10 17:00:20 +08:00
takatost dabfd74622
feat: Parallel Execution of Nodes in Workflows (#8192) 
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Yi <yxiaoisme@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-09-10 15:23:16 +08:00
-LAN- ed37439ef7
refactor(api/core): Improve type hints and apply ruff formatter in agent runner and model manager. (#8166) 2024-09-10 15:00:25 +08:00
Jyong af92f19291
filter excel empty sheet (#8194) 2024-09-10 14:55:08 +08:00
Jyong 2d690801d1
nvidia rerank top n missed (#8185) 2024-09-10 13:17:48 +08:00
-LAN- 4313d92e6b
feat(api/core/model_runtime/entities/defaults.py): Add TOP_K in default parameters. (#8167) 2024-09-10 09:11:31 +08:00
Nam Vu 0695543f63
Fix variable typo (cont) (#8161) 2024-09-09 23:46:13 +08:00
crazywoola 0bec6a037c
update qwen-long (#8157) 2024-09-09 19:09:42 +08:00
AAEE86 fa34b9aed6
Modify model parameters in Spark LLMs and zhipuai LLMs (#8078) 
Co-authored-by: Charlie.Wei <luowei@cvte.com>
 2024-09-09 15:36:47 +08:00
crazywoola a27d4d58ec
fix: ollama text embedding 500 error (#8131) 2024-09-09 15:27:49 +08:00
邹成卓 a15791e788
Fix: tongyi code wrapper works not stable (#7871) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2024-09-09 11:15:17 +08:00
ybalbert001 954580a4af
feat: support more model types and builtin tools on aws/sagemaker (#8061) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-09-09 10:34:11 +08:00
crazywoola ab7d79275e
fix: Claude can not validate credientials (#8109) 2024-09-09 10:22:42 +08:00
呆萌闷油瓶 d28446301f
feat:add fishaudio in xinference (#8100) 2024-09-08 23:58:02 +08:00
Charlie.Wei feefeb44d7
fix LangSmith project config error (#7996) 2024-09-08 13:25:27 +08:00
Nam Vu 2d7954c7da
Fix variable typo (#8084) 2024-09-08 13:14:11 +08:00
AAEE86 0cef25ef8c
Revert "fix: parameter rule" (#8070) 2024-09-07 10:44:56 +08:00
crazywoola 900fd82a92
fix: parameter rule (#8064) 2024-09-06 19:15:24 +08:00
crazywoola 44f963f281
If else add regexmatch (#8059) 
Co-authored-by: 罗威 <luowei@cvte.com>
 2024-09-06 18:35:51 +08:00
Charlie.Wei 01858e1caf
ifEsle node add regex match (#8007) 2024-09-06 17:44:09 +08:00
ChengZi 2060db8e11
fix: change milvus init args from (host, port) to (url, token) (#8019) 
Signed-off-by: ChengZi <chen.zhang@zilliz.com>
 2024-09-06 17:32:48 +08:00
tmuife 89aede80cc
Add OCI(Oracle Cloud Infrastructure) Generative AI Service as a Model Provider (#7775) 
Co-authored-by: Walter Jin <jinshuhaicc@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: walter from vm <walter.jin@oracle.com>
 2024-09-06 14:15:40 +08:00
Byeongjin Kang d489b8b3e0
feat: return page number of pdf documents upon retrieval (#7749) 2024-09-05 16:43:26 +08:00
Leng Yue bd0992275c
feat: support fish audio TTS (#7982) 2024-09-05 14:18:39 +08:00
非法操作 3e7597f2bd
feat: add gpt-4o-2024-08-06 and json_schema for azure openAI service (#7648) 2024-09-04 21:56:08 +08:00
Jyong 0e71f6db84
fix spliter length missed (#7987) 2024-09-04 21:47:12 +08:00
wochuideng f6b9982c23
Concurrent calls to the Wenxin model, and the exception problem when obtaining the token is fixed (#7976) 
Co-authored-by: puqs1 <puqs1@lenovo.com>
 2024-09-04 21:44:57 +08:00
非法操作 0f72a8e89d
chore: refactor the beichuan model (#7953) 2024-09-04 16:22:31 +08:00
KVOJJJin 14af87527f
Feat:remove estimation of embedding cost (#7950) 
Co-authored-by: jyong <718720800@qq.com>
 2024-09-04 14:41:47 +08:00
呆萌闷油瓶 83494cb4f5
fix:empty voice occurs when xinference CosyVoice tts model (#7958) 2024-09-04 13:04:31 +08:00
Sumkor 571415d1a4
fix: split text keep separator (#7930) 2024-09-04 12:59:10 +08:00
Joe fee4d3f6ca
feat: ops trace add llm model (#7306) 2024-09-04 10:39:00 +08:00
陳鈞 80d14c9b22
fix(api): Code-Based Extension cause error on position map sorting (#7934) 
Signed-off-by: 陳鈞 <jim60105@gmail.com>
 2024-09-04 08:41:12 +08:00
crazywoola 596f160a1e
Chore/add default step 1x url (#7933) 2024-09-04 08:32:22 +08:00
Jyong d8b6c053a2
fix rerank model value is empty string (#7937) 2024-09-03 21:25:21 +08:00
Jyong 01581dd35f
improve the notion table extract (#7925) 2024-09-03 17:52:07 +08:00
Jyong 6f33351eb3
ignore linked images when image id is none (#7890) 2024-09-02 19:37:05 +08:00
Fei He a8b9e01b3e
fix: fixed typo on loading reranking_mode (#7887) 2024-09-02 16:18:47 +08:00
Joshua 7193e189f3
Add perplexity search as a new tool (#7861) 2024-09-02 14:48:13 +08:00
orangeclk 3f2a806abe
fix: glm models prices and max_tokens correction (#7882) 2024-09-02 14:29:09 +08:00
sino 1f56a20b62
feat: support auth by api key for ark provider (#7845) 2024-08-31 10:56:32 +08:00
Bowen Liang 0c2a62f847
fix: correct http timeout configs‘ default values and ignorance by HttpRequestNode (#7762) 2024-08-30 19:09:10 +08:00
非法操作 dc015c380a
feat: add zhipu glm_4_plus and glm_4v_plus model (#7824) 2024-08-30 15:08:31 +08:00
hisir f0273f00e1
Fixed when testing the openai compatible interface model, an error is reported when no object is returned (#7808) 2024-08-29 18:58:19 +08:00
Yeuoly 962cdbbebd
chore: add app generator overload (#7792) 2024-08-29 16:04:01 +08:00
Bowen Liang 1262277714
chore: improve http executor configs (#7730) 2024-08-28 17:46:37 +08:00
zhuhao 26abbe8e5b
feat(Tools): add a tool to query the stock price from Alpha Vantage (#7019) (#7752) 2024-08-28 17:27:20 +08:00
Leheng Lu 5d0914daea
fix: not able to pass array of string/number/object into variable aggregator groups (#7757) 2024-08-28 17:25:20 +08:00
sino 7cfebffbb8
chore: update default endpoint for ark provider (#7741) 2024-08-28 13:56:50 +08:00
走在修行的大街上 92cab33b73
feat(Tools): add feishu document and message plugins (#6435) 
Co-authored-by: 黎斌 <libin.23@bytedance.com>
 2024-08-27 20:21:42 +08:00
Bowen Liang 3f467613fc
feat: support configs for code execution request (#7704) 2024-08-27 19:38:33 +08:00
crazywoola da326baa5e
fix: tongyi Error: 'NoneType' object is not subscriptable (#7705) 2024-08-27 16:56:06 +08:00
Jyong 60001a62c4
fixed chunk_overlap is None (#7703) 2024-08-27 16:38:06 +08:00
sino ee7d5e7206
feat: support Moonshot and GLM models tool call for volc ark provider (#7666) 2024-08-27 14:43:37 +08:00
Kenn 122ce41020
feat: rewrite Elasticsearch index and search code to achieve Elasticsearch vector and full-text search (#7641) 
Co-authored-by: haokai <haokai@shuwen.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
Co-authored-by: wellCh4n <wellCh4n@foxmail.com>
 2024-08-27 11:43:44 +08:00
Charlie.Wei e7afee1176
Langfuse view button (#7684) 2024-08-27 11:25:56 +08:00
Bowen Liang a15080a1d7
bug: (#7586 followup) fix config of CODE_MAX_STRING_LENGTH (#7683) 2024-08-27 10:38:24 +08:00
Jyong 35431bce0d
fix dataset_id and index_node_id idx missed in document_segments tabl… (#7681) 2024-08-27 10:25:24 +08:00
Hélio Lúcio 7b7576ad55
Add Azure AI Studio as provider (#7549) 
Co-authored-by: Hélio Lúcio <canais.hlucio@voegol.com.br>
 2024-08-27 09:52:59 +08:00
Qin Liu 162faee4f2
fix: set score_threshold to zero if it is None for MyScale vectordb (#7640) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2024-08-27 09:47:16 +08:00
Zhi b7ff98d7ff
fix: Remove useless debug information. (#7647) 2024-08-26 20:40:26 +08:00
Shota Totsuka 430e100142
refactor: Add @staticmethod decorator in `api/core` (#7652) 2024-08-26 19:45:03 +08:00
Jyong 1473083a41
catch openai rate limit error (#7658) 2024-08-26 19:36:44 +08:00
代君 7c2bb31a55
[fix] openai's tool role dose not support name parameter. (#7659) 2024-08-26 18:52:34 +08:00
非法操作 ba82023445
fix: support float type for tool parameter's default value (#7644) 2024-08-26 17:10:54 +08:00
Jyong 7ae728a9a3
fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2024-08-26 15:14:05 +08:00
非法操作 556f4ad5df
feat: add siliconflow text2img tool (#7612) 2024-08-25 14:39:58 +08:00
Seayon 561a61e7fe
Improve MIME type detection for image URLs (#6531) 
Co-authored-by: seayon <zhaoxuyang@shouqianba.com>
 2024-08-25 13:36:16 +08:00
sino efc136cce5
feat: Introduce Ark SDK v3 and ensure compatibility with models of SDK v2 (#7579) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-08-24 19:29:45 +08:00
Bowen Liang 3ace01cfb3
chore: cleanup and rearrange unclassified configs into feature config groups (#7586) 2024-08-23 22:40:07 +08:00
Junyan Qin e3d7c7c6f9
fix(onebot): use yarl to format url (#7589) 2024-08-23 22:22:42 +08:00
Junyan Qin 8807d880dc
Feat: add OneBot protocol tool (#7583) 2024-08-23 19:16:30 +08:00
Jie.F 70d6ab0bf5
Update stable_diffusion.py (#7536) 2024-08-23 18:58:13 +08:00
Amos e42848f4b7
Do not pass query parameter when the value is empty (#7585) 2024-08-23 18:50:38 +08:00
张皮皮 f29685f8a1
fix score_threshold is none, return all top K documents (#7581) 2024-08-23 16:59:34 +08:00
噢哎哟喂 ad13011043
add JSON Mode support for moonshot models (#7568) 2024-08-23 16:24:45 +08:00
Charlie.Wei 9864b35465
langfuser add view button (#7571) 2024-08-23 15:53:49 +08:00
Fei He 6025002971
add qwen text-embedding-v3 support. (#7567) 2024-08-23 15:32:38 +08:00
orangeclk a24717765e
feat: forward zhipu finish_reason (#7560) 2024-08-23 11:15:38 +08:00
AllenWriter 931e6f1625
Added Space between Chinese and English within tools' description (#7545) 2024-08-22 19:20:13 +08:00
orangeclk f53454f81d
add finish_reason to the LLM node output (#7498) 2024-08-21 17:29:30 +08:00
Yeuoly 784b11ce19
Chore/remove python dependencies selector (#7494) 2024-08-21 16:57:14 +08:00
Jyong 715eb8fa32
fix rerank mode is none (#7496) 2024-08-21 16:42:28 +08:00
Yeuoly a02118d5bc
Fix/incorrect code template (#7490) 2024-08-21 15:31:13 +08:00
Nam Vu 85fc0fdb51
chore: support CODE_MAX_PRECISION (#7484) 2024-08-21 15:11:56 +08:00
非法操作 f7af8c7cc7
feat: gpt-4o-mini-2024-07-18 support json schema (#7489) 2024-08-21 15:11:29 +08:00
Xiao Ley 0c99a3d0c5
fix the issue of the refine_switches at param being invalid in the Novita.AI tool (#7485) 2024-08-21 15:09:05 +08:00
hisir 6435b4eb44
Separate CODE_MAX_DEPTH and set it as an environment variable (#7474) 2024-08-21 12:48:25 +08:00
Xiyuan Chen 4e7b6aec3a
feat: support pinning, including, and excluding for model providers and tools (#7419) 
Co-authored-by: GareArc <chen4851@purude.edu>
 2024-08-21 11:16:43 +08:00
luckylhb90 9a715f6b68
fix(tool): tool node error (#7459) 
Co-authored-by: hobo.l <hobo.l@binance.com>
 2024-08-21 09:04:54 +08:00
wellCh4n b7778de224
fix: document error message can not be cleared (#7453) 2024-08-20 19:30:57 +08:00
KinWang e35e251863
feat: Sort conversations by updated_at desc (#7348) 
Co-authored-by: wangpj <wangpj@hundsunc.om>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-08-20 17:55:44 +08:00
-LAN- 4f5f27cf2b
refactor(api/core/workflow/enums.py): Rename SystemVariable to SystemVariableKey. (#7445) 2024-08-20 17:52:06 +08:00
-LAN- a10b207de2
refactor(api/core/app/app_config/entities.py): Move Type to outside and add EXTERNAL_DATA_TOOL. (#7444) 2024-08-20 17:30:14 +08:00
-LAN- 4f64a5d36d
refactor(api/core/workflow/nodes/variable_assigner): Split into multi files. (#7434) 2024-08-20 15:40:19 +08:00
非法操作 53146ad685
feat: support line break of tooltip content (#7424) 2024-08-20 11:03:55 +08:00
Byeongjin Kang 0223fc6fd5
feat: add pgvector full_text_search (#7396) 2024-08-20 11:01:13 +08:00
Nam Vu 6991a243aa
chore: correct _tts_invoke_streaming max length (#7423) 2024-08-20 10:20:04 +08:00
Chengyu Yan 1f944c6eeb
feat(api): support wenxin bge-large and tao embedding model. (#7393) 2024-08-19 22:25:09 +08:00
RookieAgent 4ff4859036
add CrossRef builtin tool: doi query and title query (#7406) 2024-08-19 19:14:20 +08:00
Xiao Ley 53cf756207
feat: OpenRouter add gpt-4o-2024-08-06 model (#7409) 2024-08-19 19:14:08 +08:00
-LAN- 0087afc2e3
fix(api/core/model_runtime/model_providers/__base/large_language_model.py): Add TEXT type checker (#7407) 2024-08-19 18:45:30 +08:00
SoaringEthan acd72e3ab2
feat: support xinference's auth system (#7369) 2024-08-19 12:41:56 +08:00
Bowen Liang bbb6fcc4f0
chore: update ruff from 0.5.x to 0.6.x (#7384) 2024-08-19 09:21:11 +08:00
非法操作 a0c689c273
feat: add jina tokenizer tool (#7375) 2024-08-19 09:15:46 +08:00
Chengyu Yan bfd905602f
feat(api): support wenxin text embedding (#7377) 2024-08-19 09:15:19 +08:00
sino a0a67873aa
chore: optimize ark model parameters (#7378) 2024-08-19 08:44:19 +08:00
噢哎哟喂 baaa3f7f42
add base url for moonshot model (#7360) 2024-08-17 10:28:09 +08:00
Weaxs 3a33062405
feat: support siliconflow rerank (#7337) 2024-08-16 20:21:41 +08:00
Leo.Wang 5a729a69cd
feat: tools/gitlab (#7329) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-08-16 16:54:49 +08:00
Nam Vu dbc1ae45de
chore: update docstrings (#7343) 2024-08-16 14:19:01 +08:00
Xiyuan Chen c7df6783df
Revert "feat: support pinning, including, and excluding for Model Providers and Tools" (#7324) 2024-08-15 23:51:00 +08:00
噢哎哟喂 6fdbc7dbf3
fix error when use farui-plus model (#7316) 
Co-authored-by: 雪风 <xuefeng@shifaedu.cn>
 2024-08-15 20:14:13 +08:00
Hongbin d1a6702aa4
Update PerfXCloud Model List (#7212) 
Co-authored-by: xhb <466010723@qq.com>
 2024-08-15 19:42:15 +08:00
Nam Vu ed85d8281a
fix: null annotation (#7313) 2024-08-15 19:20:14 +08:00
-LAN- 3f9720bca0
fix(api/core/app/segments/segments.py): Fix file to markdown. (#7293) 2024-08-15 13:09:49 +08:00
Xiyuan Chen 7619850855
feat: support pinning, including, and excluding for Model Providers and Tools (#7283) 2024-08-15 12:58:38 +08:00
-LAN- 8f16165f92
chore(api/core): Improve FileVar's type hint and imports. (#7290) 2024-08-15 12:43:18 +08:00
非法操作 6ff7fd80a1
feat: support OPENAI json_schema (#7258) 2024-08-15 11:29:19 +08:00
非法操作 5aa373dc04
feat: add chatgpt-4o-latest (#7289) 2024-08-15 11:19:10 +08:00
-LAN- 32dc963556
feat(api/workflow): Add `Conversation.dialogue_count` (#7275) 2024-08-15 10:53:05 +08:00
Nam Vu d2ccd8ba53
fix: #7222 docstrings (#7276) 2024-08-15 09:47:26 +08:00
Xiyuan Chen d29b32fce2
fix: typo in upstage/llm/_position.yaml (#7286) 2024-08-15 08:39:35 +08:00
pp 101db126c8
fix: missed rerank_mode when convert to DatasetEntity (#7269) 2024-08-15 00:41:12 +08:00
mochi ba79088ffc
Fix SQL parser Error in MyScale vdb. (#7255) 2024-08-14 16:41:18 +08:00
非法操作 3a27166c2e
chore: allow download audio/video through HTTP node (#7224) 2024-08-14 16:25:59 +08:00
噢哎哟喂 52383d0161
add support for tongyi-farui (#7248) 
Co-authored-by: 雪风 <xuefeng@shifaedu.cn>
 2024-08-14 14:09:13 +08:00
-LAN- 48d2febebf
fix(api/core/tools/entities/tool_entities.py): Fix type define. (#7250) 2024-08-14 14:08:54 +08:00
Leo.Wang 986fd5bfc6
Add gitlab support (#7179) 
Co-authored-by: crazywoola <427733928@qq.com>
 2024-08-13 17:36:45 +08:00
miendinh f104b930cf
feat: support elasticsearch vector database (#3558) 
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
 2024-08-13 17:36:20 +08:00
Onelevenvy 0f59d76997
fix: add context_size and max_chunks to Tongyi embedding to resolve issue #7189 (#7227) 2024-08-13 16:35:22 +08:00
非法操作 b3743a9ae5
chore: refactor searXNG tool (#7220) 2024-08-13 15:34:29 +08:00
KVOJJJin 935e72d449
Feat: conversation variable & variable assigner node (#7222) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
 2024-08-13 14:44:10 +08:00
shAlfred a12ddc47e7
feat: add support of speech2text function for OpenAI-API-compatible and Siliconflow (#7197) 2024-08-12 21:38:59 +08:00
Weaxs 67b9fdaad7
siliconflow support bge-3 && bce-v1 embedding (#7198) 2024-08-12 19:14:43 +08:00
Bowen Liang ccb6ddd840
chore: bump Ruff to 0.5.7 (#7174) 2024-08-12 10:24:48 +08:00
ybalbert001 f2cb1fb09f
Fix : Workflow "start" paste url not support s3 pre-signed URL (#6855) 
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
 2024-08-11 16:45:15 +08:00
灰灰 ac60182c91
fix: solving http-request-tool bugs in workflow (#6685) 2024-08-11 16:32:06 +08:00
crazywoola 8b5761efb2
change secret input to text input in searxng (#7160) 2024-08-10 16:58:22 +08:00
Yanyi Liu 5b32f2e0dd
Feat: Add model provider Text Embedding Inference for embedding and rerank (#7132) 2024-08-09 19:12:13 +08:00
Yanyi Liu 4cbeb6815b
Fix: Wrong cutoff length lead to empty input in openai compatible embedding model. (#7133) 2024-08-09 19:11:57 +08:00
Jeff Li d338f69837
feat: add decode option to json process tools (#7138) 2024-08-09 19:05:27 +08:00
Joe 425174e82f
feat: update ops trace (#7102) 2024-08-09 15:22:16 +08:00
Joe 7201b56a6d
fix: workflow log run time error (#7130) 2024-08-09 14:46:31 +08:00
Matri 4dfa8eedb8
Feat/tool-D-ID (#6278) 2024-08-09 11:05:33 +08:00
forrestlinfeng 07511dfaf4
update stepfun model (#7118) 
Co-authored-by: chenlinfeng <chenlinfeng@step.ai>
Co-authored-by: Tfsh <tianfs_fight@163.com>
 2024-08-08 20:40:37 +08:00
小羽 7944ce0594
feat: wenxin add yi-34b-chat (#7117) 2024-08-08 20:01:21 +08:00
Aero Kang ad682c394d
fix annotation reply is null (#7103) 2024-08-08 19:07:50 +08:00
orangeclk 83acb53c08
feat: add zhipu embedding-3 (#7100) 2024-08-08 17:08:46 +08:00
shAlfred a7162240e6
feat: add text-embedding functon and LLM models to Siliconflow (#7090) 2024-08-08 17:08:28 +08:00
Jyong 12095f8cd6
extract docx filter comment element (#7092) 2024-08-08 16:53:29 +08:00
zhuhao 4ffa706e4f
feat: add a builtin tool to support regex extraction. (#7081) (#7087) 2024-08-08 14:23:57 +08:00
Jyong 169cde6c3c
add nltk punkt resource (#7063) 2024-08-08 14:23:22 +08:00
小羽 34a9dbe826
Feat/add 360-zhinao provider (#7069) 2024-08-08 14:23:08 +08:00
orangeclk f288d367ac
Add price info for zhipu models (#7084) 2024-08-08 14:17:05 +08:00
Waffle 5e2fa13126
feat: support glm-4-long (#7070) 
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2024-08-08 10:54:39 +08:00
-LAN- 67a2f14cef
fix(api/core/workflow/nodes/tool/tool_node.py): Keep None value in tool params. (#7066) 2024-08-07 19:36:21 +08:00
Joe d7bb422a5c
fix: hunyuan assistant_prompt_message pydantic error (#7062) 2024-08-07 18:31:40 +08:00
8bitpd 40c6f3c724
fix: add redis lock to AnalyticdbVector init (#6859) 
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
 2024-08-07 17:32:06 +08:00
-LAN- df8f8c9a2c
feat(api/core/rag/datasource/vdb/analyticdb/analyticdb_vector.py): Checking config before init analyticdb (#7050) 2024-08-07 17:31:36 +08:00
-LAN- 536c43257b
refactor(*): Update hard-code '[__HIDDEN__]' to the constant. (#7048) 2024-08-07 17:30:56 +08:00
-LAN- 4e8f6b3603
chore(api/core/app/segments/segments.py): Remove todo tags. (#7052) 2024-08-07 17:29:35 +08:00
Jyong 80c94f02e9
add vector field for other vectordb (#7051) 2024-08-07 17:14:03 +08:00
-LAN- aad02113c6
fix(api/core/app/segments): Allow to contains boolean value in object segment (#7047) 2024-08-07 16:20:22 +08:00
chenxu9741 72c75b75cf
feat: Add hyperlink parsing to the DOCX document. (#7017) 2024-08-07 16:01:14 +08:00
majian 99b78dd198
feat: add gpt-4o-2024-08-06 (#7046) 2024-08-07 15:35:57 +08:00
Achim a93bc83c8d
Provide output data also in json property of workflow tool (#6924) (#7027) 2024-08-07 08:54:51 +08:00
crazywoola 3516989738
fix: typos in wenxin llm (#7021) 2024-08-06 22:33:03 +08:00
Sa Zhang 26991443ed
fix: Fix incorrect context size for jina-reranker-v2 model (#7006) 2024-08-06 21:08:29 +08:00
Bryan eece50acec
fix: tran list issue (#7009) 
Co-authored-by: libing <libing@healink.cn>
 2024-08-06 21:01:38 +08:00
Jyong 28d4e5b045
Fix/reranking mode is null (#7012) 2024-08-06 19:12:04 +08:00
yanghx c53875ce8c
fix #6902 .docx handles images within tables and handles cross-column tables (#6951) 2024-08-06 17:14:24 +08:00
灰灰 96dcf0fe8a
fix: code tool fails when null property exists in object (#6988) 2024-08-06 16:11:00 +08:00
Yefori bd3ed89516
feat: add function calling for deepseek models (#6990) 2024-08-06 13:37:27 +08:00
小羽 23ed15d19f
feat:nvidia add nemotron4-340b and microsoft/phi-3 (#6973) 2024-08-06 10:16:41 +08:00
非法操作 312d905c9b
chore: update duckduckgo tool (#6983) 2024-08-06 10:16:04 +08:00
takatost 6da14c2d48
security: fix api image security issues (#6971) 2024-08-05 20:21:08 +08:00
Pedro Gomes a34285196b
Revise the wrong pricing of certain LLM models. (#6967) 2024-08-05 18:41:44 +08:00