Commit Graph

1894 Commits

Author SHA1 Message Date
-LAN- c6996a48a4
refactor(api/core/app/segments): Support more kinds of Segments. (#6706)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 15:03:56 +08:00
chenxu9741 6b50bb0fe6
issues #6655 Open ai tts issues (#6696) 2024-07-26 14:55:49 +08:00
Sangmin Ahn ecb9c311b5
chore: make prompt generator max tokens configurable (#6693) 2024-07-26 10:20:23 +08:00
Yeuoly 79cb23e8ac
security/SSRF vulns (#6682) 2024-07-25 20:50:26 +08:00
longzhihun c5ac004f15
[seanguo] fix: unsupported filename in windows & add Mistral Large 2 (#6679) 2024-07-25 19:26:46 +08:00
RookieAgent 78a339a794
modify llama3-1 yaml filename to support Windows pull operations (#6677) 2024-07-25 18:58:55 +08:00
灰灰 5e4ac11df3
fix: code block segmentation problem of markdown document (#6465) 2024-07-25 17:24:37 +08:00
tmuife 16b4f560cd
fix bugs(when using Oracle23ai as Vector DB) (#6658) 2024-07-25 17:07:14 +08:00
-LAN- 75e6576c67
refactor(api/core/app/segments): implement `to_object` in ObjectVariable and ArrayVariable. (#6671)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 17:06:38 +08:00
Seayon 0b4c26578e
Enhance database URI security and add URL encoding (#6668) 2024-07-25 16:48:00 +08:00
xielong ebcc07e3e9
feat: support max_retries in jina requests (#6585) 2024-07-25 13:10:39 +08:00
-LAN- 55c2b61921
fix(api/fields/workflow_fields.py): Add check in environment variables (#6621) 2024-07-25 11:30:52 +08:00
Giga Group ca696fe94c
Add support of tool-call for model provider "hunyuan" (#6656)
Co-authored-by: sun <sun@centen.cn>
2024-07-25 11:27:58 +08:00
longzhihun 9815aab7a3
[seanguo] feat: add llama 3.1 support in bedrock (#6645) 2024-07-25 11:20:37 +08:00
yanghx 349ec0db77
fix tencent_cos_storage image-preview error is not a byte (#6652) 2024-07-25 11:20:20 +08:00
majian a876baf0a9
Resolve variable type parameter error (#6646) 2024-07-25 11:15:54 +08:00
Jyong 91fd8521c3
fix reranking model field error (#6654) 2024-07-25 10:07:55 +08:00
-LAN- 4ec9a87e46
fix(api/core/workflow/nodes/iteration/iteration_node.py): Extend output in iteration if output is a array. (#6647)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 00:32:39 +08:00
Vico Chu fb5e3662d5
Chores: add missing profile for middleware docker compose cmd and fix ssrf-proxy doc link (#6372)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-24 19:36:06 +08:00
-LAN- 31efe10c75
refactor(api/core/workflow/workflow_engine_manager.py): Remove (#6630)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:40 +08:00
-LAN- 72bc9d5f2b
feat(api/core/app/segments/variables.py): Support description in Variable. (#6636)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:22 +08:00
Jyong 600f13436d
remove rerank model must be required when retrieval_model is multiple (#6640) 2024-07-24 19:34:41 +08:00
Joe b347a2f839
Feat/user session id search (#6638) 2024-07-24 19:34:23 +08:00
zhangzhiqiangcs d4c55748f1
doc: fix about model features (#6619) 2024-07-24 19:12:10 +08:00
takatost 0625db0bf5
chore: optimize asynchronous workflow deletion performance of app related data (#6639) 2024-07-24 19:00:37 +08:00
takatost 05141ede16
chore: optimize asynchronous deletion performance of app related data (#6634) 2024-07-24 18:15:03 +08:00
dufei 5af2df0cd5
fix: qwen fc error (#6620)
Co-authored-by: dufei <du_fei@venusgroup.com.cn>
2024-07-24 16:56:06 +08:00
crazywoola f324374b95
Fix/6615 40 varchar limit on model name (#6623) 2024-07-24 16:23:16 +08:00
Jyong e4bb943fe5
Feat/delete single dataset retrival (#6570) 2024-07-24 12:50:11 +08:00
takatost 0fb741f269
fix: downgraded sentry-sdk to 1.44.1 due to claude LLM token returning 0 (#6597) 2024-07-24 04:49:03 +08:00
takatost 4c85393a1d
feat: add GroqCloud llama3.1 series models support (#6596) 2024-07-24 00:41:58 +08:00
sino d5c2680fde
feat: support llama3.1 series models for openrouter provider (#6595) 2024-07-24 00:37:48 +08:00
takatost 49729647ea
bump to 0.6.15 (#6592) 2024-07-23 22:46:42 +08:00
-LAN- 85a883e281
fix(variables): NoneVariable should inherit from NoneSegment. (#6584) 2024-07-23 21:46:08 +08:00
Joe 8123a00e97
feat: update prompt generate (#6516) 2024-07-23 19:52:14 +08:00
-LAN- 2bc0632d0d
fix(segments): Support NoneType. (#6581) 2024-07-23 17:59:32 +08:00
-LAN- ad7552ea8d
fix(api/core/workflow/nodes/llm/llm_node.py): Fix LLM Node error. (#6576) 2024-07-23 17:09:16 +08:00
非法操作 c0ada940bd
fix: tool params not work as expected when develop a tool (#6550) 2024-07-23 17:00:39 +08:00
takatost 1690788827
fix: name 'current_app' is not defined in recommended_app_service (#6574) 2024-07-23 16:48:21 +08:00
Lance Mao 7c55c39085
feat: add tencent asr (#6091) 2024-07-23 16:38:39 +08:00
非法操作 f17d4fe412
fix: extract only `like` feedback to caculate User Satisfaction (#6553) 2024-07-23 16:32:36 +08:00
-LAN- f019bc4bd7
feat(variables): Support `to_object`. (#6572) 2024-07-23 16:22:06 +08:00
-LAN- cfc408095c
fix(api/nodes): Fallback to `get_any` in some nodes that use object or array. (#6566) 2024-07-23 15:51:07 +08:00
takatost 6b5fac3004
fix: fetch context error in llm node (#6562) 2024-07-23 15:04:51 +08:00
崔亮 0569c547ee
fix the issue of MILVUS_DATABASE has no effect. (#6424) 2024-07-23 15:03:55 +08:00
tmuife 06fc1bce9e
Add search by full text when using Oracle23ai as vector DB (#6559) 2024-07-23 15:03:21 +08:00
Sangmin Ahn 093b8ca475
fix: escape double quotation marks in the vector DB search query (#6506) 2024-07-23 15:02:25 +08:00
Ryan Tian 5fcc2caeed
feat: add Mingdao HAP tool, implemented read and maintain HAP application worksheet data. (#6257)
Co-authored-by: takatost <takatost@gmail.com>
2024-07-23 14:34:19 +08:00
dependabot[bot] 642723d09e
chore(deps): bump sentry-sdk from 1.39.2 to 2.8.0 in /api (#6517)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-23 13:48:23 +08:00
-LAN- cd7fa8027a
fix(api/core/model_manager.py): Avoid mutation during iteration. (#6536) 2024-07-22 22:58:22 +08:00
-LAN- 617847e3c0
fix(api/services/app_generate_service.py): Remove wrong type hints. (#6535) 2024-07-22 22:58:07 +08:00
-LAN- 5e6fc58db3
Feat/environment variables in workflow (#6515)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-22 15:29:39 +08:00
Benjamin a67831773f
refactor: handle missing position file gracefully (#6513) 2024-07-22 13:24:32 +08:00
sino dfb6f4fec6
fix: extract tool calls correctly while arguments is empty (#6503) 2024-07-22 07:43:18 +08:00
Jyong f38034e455
clean vector collection redis cache (#6494) 2024-07-21 15:09:09 +08:00
Shoya SHIRAKI c57b3931d5
refactor(api): switch to dify_config in controllers/console (#6485) 2024-07-21 01:11:40 +08:00
Jyong f73a3a58ae
update delete embeddings by id (#6489) 2024-07-20 09:04:21 +08:00
Jyong 1e0e573165
update clean embedding cache query logic (#6483) 2024-07-20 01:29:25 +08:00
Joe 27e08a8e2e
Fix/extra table tracing app config (#6487) 2024-07-20 00:53:31 +08:00
Matri 49ef9ef225
feat(tool): getimg.ai integration (#6260) 2024-07-19 20:32:42 +08:00
Even c013086e64
fix: next suggest question logic problem (#6451)
Co-authored-by: evenyan <yikun.yan@ubtrobot.com>
2024-07-19 20:26:11 +08:00
sino 4f9f175f25
fix: correct gpt-4o-mini max token (#6472)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-19 18:24:58 +08:00
Jyong 57729823a0
fix wrong method using (#6459) 2024-07-19 13:48:13 +08:00
sino 9e168f9d1c
feat: support gpt-4o-mini for openrouter provider (#6447) 2024-07-19 13:09:41 +08:00
Weaxs ea45496a74
update ernie models (#6454) 2024-07-19 13:08:39 +08:00
Waffle 2ba05b041f
refactor(myscale):Set the default value of the myscale vector db in DifyConfig. (#6441) 2024-07-19 10:57:45 +08:00
Richards Tu 8e49146a35
[EMERGENCY] Fix Anthropic header issue (#6445) 2024-07-19 07:38:15 +08:00
takatost dad3fd2dc1
feat: add gpt-4o-mini (#6442) 2024-07-19 01:53:43 +08:00
Jyong e493ce9981
update clean embedding cache logic (#6434) 2024-07-18 20:25:28 +08:00
Weishan-0 7b45a5d452
fix: Unable to display images generated by Dall-E 3 (#6155) 2024-07-18 19:37:04 +08:00
ybalbert001 4a026fa352
Enhancement: add model provider - Amazon Sagemaker (#6255)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-18 19:32:31 +08:00
leoterry dc847ba145
Fix the vector retrieval sorting issue (#6431)
Co-authored-by: weifj <“weifj@tuyuansu.com.cn”>
2024-07-18 19:25:41 +08:00
-LAN- c0ec40e483
fix(api/core/tools/provider/builtin/spider/tools/scraper_crawler.yaml): Fix wrong placeholder config in scraper crawler tool. (#6432) 2024-07-18 19:23:18 +08:00
themanforfree ba181197c2
feat: api_key support for xinference (#6417)
Signed-off-by: themanforfree <themanforfree@gmail.com>
2024-07-18 18:58:46 +08:00
Songyawn 218930c897
fix tool icon get failed (#6375)
Co-authored-by: songyawen <songyawen@zkme.xyz>
2024-07-18 18:55:48 +08:00
Poorandy c8f5dfcf17
refactor(rag): switch to dify_config. (#6410)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-18 18:40:36 +08:00
非法操作 afe95fa780
feat: support get workflow task execution status (#6411) 2024-07-18 15:06:14 +08:00
William Espegren 588615b20e
feat: Spider web scraper & crawler tool (#5725) 2024-07-18 14:29:33 +08:00
listeng d5dca46854
feat: add a Tianditu tool (#6320)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-18 13:04:03 +08:00
Xiao Ley 23e5eeec00
feat: added custom secure_ascii to the json_process tool (#6401) 2024-07-18 08:43:14 +08:00
Masashi Tomooka 5236cb1888
fix: kill signal is not passed to the main process (#6159) 2024-07-18 07:50:54 +08:00
forrestlinfeng 3b5b548af3
Add Stepfun LLM Support (#6346) 2024-07-18 07:47:18 +08:00
Richards Tu 4782fb50c4
Support new Claude-3.5 Sonnet max token limit (#6335) 2024-07-18 07:47:06 +08:00
Jyong f55876bcc5
fix web import url is too long (#6402) 2024-07-18 01:14:36 +08:00
Poorandy 8a80af39c9
refactor(models&tools): switch to dify_config in models and tools. (#6394)
Co-authored-by: Poorandy <andymonicamua1@gmail.com>
2024-07-17 22:26:18 +08:00
Jyong 443e96777b
update empty document caused delete exist collection (#6392) 2024-07-17 20:38:32 +08:00
xielong f3f052ba36
fix: rename model from ernie-4.0-8k-Latest to ernie-4.0-8k-latest (#6383) 2024-07-17 19:07:47 +08:00
Jyong 1bc90b992b
Feat/optimize clean dataset logic (#6384) 2024-07-17 17:36:11 +08:00
-LAN- fc37887a21
refactor(api/core/workflow/nodes/http_request): Remove `mask_authorization_header` because its alwary true. (#6379) 2024-07-17 16:52:14 +08:00
Lion 4ed1476531
fix: incorrect config key name (#6371)
Co-authored-by: LionYuYu <lyu@theknotww.com>
2024-07-17 15:52:51 +08:00
FamousMai 20f73cb756
fix: default model set wrong(#6327) (#6332)
Co-authored-by: maiyouming <maiyouming@yafex.cn>
2024-07-17 14:14:12 +08:00
Weaxs 4e2fba404d
WebscraperTool bypass cloudflare site by cloudscraper (#6337) 2024-07-17 14:13:57 +08:00
Bowen Liang 7943f7f697
chore: fix legacy API usages of Query.get() by Session.get() in SqlAlchemy 2 (#6340) 2024-07-17 13:54:35 +08:00
Jyong 7c397f5722
update celery beat scheduler time to env (#6352) 2024-07-17 02:31:30 +08:00
Charlie.Wei 06fcc0c650
Fix tts api err (#6349)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-07-16 21:53:57 +08:00
Jyong 0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2024-07-16 19:09:04 +08:00
longzhihun ed9e692263
feat: bedrock model runtime enhancement (#6299) 2024-07-16 15:54:39 +08:00
svcvit cc0c826f36
Add tool: Google Translate (#6156) 2024-07-16 15:28:33 +08:00
Jyong 988aa4b5da
update clean_unused_datasets_task timedelta (#6324) 2024-07-16 13:43:04 +08:00
Bowen Liang c5d06e7943
dep: bump Pydantic from 2.7 to 2.8 (#6273) 2024-07-16 13:40:58 +08:00
呆萌闷油瓶 d66d7146a3
chore:update azure GA version 2024-06-01 (#6307) 2024-07-16 10:32:18 +08:00
takatost eabfd84ceb
bump to 0.6.14 (#6294) 2024-07-15 21:01:09 +08:00
Jyong d320d1468d
Feat/delete file when clean document (#5882) 2024-07-15 19:57:05 +08:00
Onelevenvy b47fa27a35
fix: zhipuai validate error when user's api key not support for chatglm_turbo in issue #6289 (#6290) 2024-07-15 19:27:18 +08:00
thibautleaux-kreactive 96c171805a
Update bedrock.yaml (#6281) 2024-07-15 16:53:03 +08:00
takatost 46a5294d94
feat(backend): support import DSL from URL (#6287) 2024-07-15 16:23:40 +08:00
Benjamin ec181649ae
Update model provider configuration for Triton Inference Server and X… (#6274) 2024-07-15 15:07:28 +08:00
guogeer 4fdcb30ff8
fix: custom tool input number fail (#6200)
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
2024-07-14 22:11:13 +08:00
Waffle 07add06c59
Feat/add zhipu CogView 3 tool (#6210) 2024-07-13 17:39:17 +08:00
tangyoha 0cbbaf3f68
fix: markdown proc will remove image (#5855) 2024-07-12 20:07:22 +08:00
Little 羊 7c2c949f01
Update ernie_bot.py (#6236) 2024-07-12 19:54:53 +08:00
天魂 1df71ec64d
refactor(api): switch to dify_config with Pydantic in controllers and schedule (#6237) 2024-07-12 16:51:43 +08:00
Matri a9ee52f2d7
Fix/firecrawl parameters issue (#6213) 2024-07-12 12:59:50 +08:00
Waffle 7b225a5ab0
refactor(services/tasks): Swtich to dify_config witch Pydantic (#6203) 2024-07-12 12:25:38 +08:00
耐小心 d7a6f25c63
fix: differentiate prompts fields based on function_calling_type (#5880) 2024-07-12 11:07:38 +08:00
crazywoola ee3936916f
upgrade deepseek params (#6215) 2024-07-12 10:55:44 +08:00
dufei 109de52fe2
Fix: When editing an Agent, selecting custom tools does not allow filtering by labels. (#6197)
Co-authored-by: dufei <du_fei@venusgroup.com.cn>
2024-07-12 09:02:25 +08:00
Little 羊 2f064c68bc
Create ernie-4.0-turbo-8k-preview (#6132) 2024-07-11 20:20:07 +08:00
JasonVV 0e82072323
Fix if_else node compatibility with historical workflows. (#6186) 2024-07-11 17:13:16 +08:00
Jyong 678ad6b7eb
Fix/file stream azure blob (#6196) 2024-07-11 17:01:03 +08:00
Zhuo Qiu 63e34e5227
feat: support MyScale vector database (#6092) 2024-07-11 15:21:59 +08:00
非法操作 5660878f7b
chore: update the tool's doc (#6167) 2024-07-11 11:02:58 +08:00
liuzhenghua 9622fbb62f
feat: app rate limit (#5844)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-10 21:31:35 +08:00
crazywoola cc8dc6d35e
Revert "chore: update the tool's doc" (#6153) 2024-07-10 19:57:12 +08:00
Su Yang 215661ef91
feat: add PerfXCloud, Qwen series #6116 (#6117) 2024-07-10 18:26:10 +08:00
Joe 5a3e09518c
feat: add if elif (#6094) 2024-07-10 18:22:51 +08:00
非法操作 1d2ab2126c
chore: update the tool's doc (#6122) 2024-07-10 12:42:34 +08:00
Bowen Liang f9d00e0498
chore: use poetry for linter tools installation and bump Ruff from 0.4 to 0.5 (#6081) 2024-07-09 23:06:23 +08:00
sino d27e3ab99d
chore: remove unresolved reference (#6110) 2024-07-09 23:04:44 +08:00
Joe ce930f19b9
fix dataset operator (#6064)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-09 17:47:54 +08:00
8bitpd 7c70eb87bc
feat: support AnalyticDB vector store (#5586)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-07-09 13:32:04 +08:00
chenxu9741 6ef401a9f0
feat:add tts-streaming config and future (#5492) 2024-07-09 11:33:58 +08:00
takatost 17f22347ae
bump to 0.6.13 (#6078) 2024-07-08 23:23:07 +08:00
takatost 68b1d063f7
chore: remove tsne unused code (#6077) 2024-07-08 21:25:19 +08:00
Xiao Ley 6610b4cee5
feat: add request_params field to jina_reader tool (#5610) 2024-07-08 18:11:50 +08:00
Jyong cbbe28f40d
fix azure stream download (#6063) 2024-07-08 17:13:16 +08:00
75py 610da4f662
Fix authorization header validation to handle bearer types correctly - "authorization config header is required" error (#6040) 2024-07-08 00:09:59 +08:00
crazywoola 3ec80f9dda
Fix/6034 get random order of categories in explore and workflow is missing in zh hant (#6043) 2024-07-07 17:06:47 +08:00
Mab 91c5818236
Modify slack webhook url validation to allow workflow (#6041) (#6042)
Co-authored-by: Shunsuke Mabuchi <mabuchs@amazon.co.jp>
2024-07-07 14:09:20 +08:00
-LAN- c436454cd4
fix(configs): Update pydantic settings in config files (#6023) 2024-07-07 12:18:15 +08:00
Yeuoly a877d4831d
Fix/incorrect parameter extractor memory (#6038) 2024-07-07 12:17:34 +08:00
takatost d522308a29
chore: optimize memory fetch performance (#6039) 2024-07-07 08:54:24 +08:00
sino 85744b72e5
feat: support moonshot and glm base models for volcengine provider (#6029) 2024-07-07 01:17:33 +08:00
Cherilyn Buren f0b7051e1a
Optimize db config (#6011) 2024-07-07 01:06:51 +08:00
Masashi Tomooka 3b23d6764f
fix: token count includes base64 string of input images (#5868) 2024-07-06 16:53:32 +08:00
Bowen Liang 9b7c74a5d9
chore: skip pip upgrade preparation in api dockerfile (#5999) 2024-07-06 14:17:34 +08:00
-LAN- 4d105d7bd7
feat(*): Swtich to dify_config. (#6025) 2024-07-06 12:05:13 +08:00
非法操作 eee779a923
fix: the input field of tool panel not worked as expected (#6003) 2024-07-06 09:54:30 +08:00
ahasasjeb ab847c81fa
Add 2 firecrawl tools : Scrape and Search (#6016)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-06 09:45:39 +08:00
-LAN- b217ee414f
test(test_rerank): Remove duplicate test cases. (#6024) 2024-07-06 09:44:50 +08:00
takatost 23dc6edb99
chore: optimize memory messages fetch count limit (#6021) 2024-07-06 03:25:38 +08:00
takatost 79df8825c8
Revert "feat: knowledge admin role" (#6018) 2024-07-05 21:31:34 +08:00
K8sCat 71c50b7e20
feat: add Llama 3 and Mixtral model options to ddgo_ai.yaml (#5979)
Signed-off-by: K8sCat <k8scat@gmail.com>
2024-07-05 21:11:15 +08:00
opriuwohg af98fd29bf
fix: add status_code 304 (#6000)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-07-05 21:10:33 +08:00
crazywoola cddea83e65
6014 i18n add support for spanish (#6017) 2024-07-05 21:05:33 +08:00
Joe 3f0da88ff7
fix: update workflow trace query (#6010) 2024-07-05 18:37:26 +08:00
ahasasjeb cc63af8e72
Removed firecrawl-py, fixed and improved firecrawl tool (#5896)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-05 18:04:51 +08:00
非法操作 bf2268b0af
fix API tool's schema not support array (#6006) 2024-07-05 17:11:59 +08:00
xielong 00b4cc3cd4
feat: implement forgot password feature (#5534) 2024-07-05 13:38:51 +08:00
Aurelius Huang f546db5437
fix: document truncation and loss in notion document sync (#5631)
Co-authored-by: Aurelius Huang <cm.huang@aftership.com>
2024-07-05 11:48:17 +08:00
orangeclk f8aaa57f31
feat: add retry mechanism for zhipuai (#5926) 2024-07-05 10:49:18 +08:00
jianglin1008 cabcf94be3
fix: TENCENT_VECTOR_DB_REPLICAS can be set to 0 (#5968)
Co-authored-by: jianglin <jianglin@wangxiaobao.com>
2024-07-05 08:32:28 +08:00
legao 2d6624cf9e
typo: Update README.md (#5987) 2024-07-04 22:50:27 +08:00
-LAN- 02982df0d4
fix: Fix some type error in http executor. (#5915) 2024-07-04 19:34:37 +08:00
-LAN- d7f75d17cc
Chore/remove-unused-code (#5917) 2024-07-04 18:18:26 +08:00
Joe 5d9ad430af
feat: knowledge admin role (#5965)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2024-07-04 16:21:40 +08:00
Joe 688b8fe114
fix: langfuse logical operator error (#5948) 2024-07-04 13:47:15 +08:00
longzhihun aecdfa2d5c
feat: add claude3 function calling (#5889) 2024-07-03 22:21:02 +08:00
-LAN- cb8feb732f
refactor: Create a `dify_config` with Pydantic. (#5938) 2024-07-03 21:09:23 +08:00
orangeclk c490bdfbf9
fix: zhipuai pytest correction (#5934) 2024-07-03 19:19:33 +08:00
-LAN- e7494d632c
docs(api/core/tools/docs/en_US/tool_scale_out.md): Format by markdownlint. (#5903) 2024-07-03 13:13:38 +08:00
takatost e3006f98c9
chore: remove dify SaaS URL in default configs (#5888) 2024-07-02 22:49:18 +08:00
quicksand 372dc7ac1a
fix bug : TencentVectorDBConfig Add TENCENT_VECTOR_DB_DATABASE (#5879) 2024-07-02 21:31:14 +08:00
-LAN- 66a62e6c13
refactor(api/core/app/apps/base_app_generator.py): improve input validation and sanitization in BaseAppGenerator (#5866) 2024-07-02 18:58:07 +08:00
Jyong 0944ca9d91
Fix/remove tsne position test (#5858)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-07-02 17:57:42 +08:00
Masashi Tomooka 6e256507d3
doc: docker-compose won't start due to wrong README (#5859) 2024-07-02 16:10:22 +08:00
Joe 59ad091e69
feat: add export permission (#5841) 2024-07-02 13:37:37 +08:00
Joe 598e030a7e
feat: update LangfuseConfig host config (#5846) 2024-07-02 13:14:07 +08:00
-LAN- 32d85fb896
chore: Update some type hints in config. (#5833) 2024-07-02 08:50:02 +08:00
Jyong af308b99a3
sync delete app table record when delete app (#5819) 2024-07-02 08:48:29 +08:00
quicksand 2a27568537
Enhance: tools wecom bot support markdown message (#5791) 2024-07-01 18:19:47 +08:00
hymvp 1d3e96ffa6
add support oracle oci object storage (#5616) 2024-07-01 17:21:44 +08:00
Joe b7b1396c51
fix: ops trace slow db (#5812) 2024-07-01 17:09:53 +08:00
Jyong 71bcf75d9a
Feat/add delete knowledge confirm (#5810) 2024-07-01 17:06:51 +08:00
Charles Zhou 850c2273ee
feat: Nominatim OpenStreetMap search tool (#5789) 2024-07-01 16:34:32 +08:00
Charles Zhou cb09dbef66
feat: correctly delete applications using Celery workers (#5787) 2024-07-01 14:21:17 +08:00
longzhihun fdfbbde10d
[seanguo] modify bedrock Claude3 invoke method to converse API (#5768)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-07-01 04:36:13 +08:00
Joe f637ae4794
fix: langsmith message_trace end_user_data session_id error (#5759) 2024-06-30 01:12:16 +08:00
Joe ffb07eb24b
fix: workflow trace none type error (#5758) 2024-06-29 23:32:52 +08:00
Yeuoly f101fcd0e7
fix: missing process data in parameter extractor (#5755) 2024-06-29 23:29:43 +08:00
takatost 1e045a0187
fix: slow sql of ops tracing (#5749) 2024-06-29 20:28:30 +08:00
takatost 8fd75e6965
bump to 0.6.12-fix1 (#5743) 2024-06-29 17:43:20 +08:00
takatost d56cedfc67
fix: app config does not use empty string in the env (#5741) 2024-06-29 17:15:25 +08:00
takatost 906857b28a
fix: couldn't log in or resetup after a failed setup (#5739) 2024-06-29 17:07:21 +08:00
takatost 6d0cea5fe6
bump to 0.6.12 (#5712) 2024-06-28 22:00:19 +08:00
takatost 0bf4817474
fix: _convert_prompt_message_to_dict parameters err (#5716) 2024-06-28 21:00:00 +08:00
takatost 8e5569f773
fix: fix-app-site-missing command (#5714) 2024-06-28 20:33:53 +08:00
takatost d30c13891b
feat: add fix-app-site-missing command (#5711) 2024-06-28 20:20:23 +08:00
takatost 017d2c804b
fix: do not remove (#5706) 2024-06-28 19:33:42 +08:00
呆萌闷油瓶 68ac433218
feat: add support Spark4.0 (#5688) 2024-06-28 17:39:11 +08:00
Joe dd5f3873da
feat: change TRACE_QUEUE_MANAGER_INTERVAL default value (#5698)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-28 17:34:58 +08:00
scotlandowl 73ce945d40
Feat/add json process tool (#5555) 2024-06-28 11:57:32 +08:00
luckylhb90 d37ee498cd
fix: do not remove (#5682)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-06-28 11:19:34 +08:00
Kevin b3d6726f65
Feature/add qwen llm (#5659) 2024-06-28 11:06:29 +08:00
William Espegren f9e4b4e74c
Fix docker command (#5681) 2024-06-28 01:23:01 +08:00
liuzhenghua 2b080b5cfc
feature: Add presence_penalty and frequency_penalty parameters to the … (#5637)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-06-28 00:27:20 +08:00
Joe e8b8f6c6dd
Feat/fix ops trace (#5672)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-28 00:24:37 +08:00
Bowen Liang 2a13ef9ae0
chore: rearrange python dependencies in groups (#5603) 2024-06-27 17:52:54 +08:00
takatost 3ccad33194
feat: add jina new pre-defined rerankers, include: jina-reranker-v2 (#5657) 2024-06-27 13:45:35 +08:00
sunxichen bafc8a0bde
fix: tool call message role according to credentials (#5625)
Co-authored-by: sunxichen <sun.xc@digitalcnzz.com>
2024-06-27 12:35:27 +08:00
非法操作 92c56fdf2b
fix: HTTP request header is overwritten when user set Content-Type (#5628) 2024-06-27 12:31:37 +08:00
Bowen Liang dcb72e0067
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-27 11:21:31 +08:00
luckylhb90 2e718b85e9
fix(api): language list (#5649)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-06-27 08:46:53 +08:00
-LAN- 17d2f0bb0d
fix(api/configs): Ignore empty environment variables when loading config. (#5647) 2024-06-26 21:39:19 +08:00
takatost 0dfdb61ee9
fix: type error in config (#5643) 2024-06-26 21:01:16 +08:00
非法操作 e1a72e0e2b
fix: ro-RO is not a valid language (#5635) 2024-06-26 18:56:31 +08:00
Diego Romero-Lovo 4c0a31d38b
FR: #4048 - Add color customization to the chatbot (#4885)
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-26 17:51:00 +08:00
Joe 4e2de638af
feat: add ops trace (#5483)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-26 17:33:29 +08:00
Bowen Liang 31a061ebaa
chore: cleanup test_delete_by_document_id method in opensearch vdb test (#5619) 2024-06-26 17:21:36 +08:00
-LAN- f7234c93af
chore(pyproject.toml): Add Ruff formatter config. (#5627) 2024-06-26 16:30:28 +08:00
Bowen Liang d0fe56a98e
fix: populate app configs to system environment variables (#5590) 2024-06-26 14:27:49 +08:00
非法操作 b8926ea267
fix: DuckDuckGo image search tool error (#5606) 2024-06-26 13:21:40 +08:00
Jyong 43335b5c87
delete the deprecated method (#5612) 2024-06-26 12:51:50 +08:00
Pan, Wen-Ming 964f0e1400
fix: Modify the incorrect configuration name for Google storage (#5595)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-26 07:54:22 +08:00
Bowen Liang 87ee3e627f
chore: fix typo in config descriptions (#5585) 2024-06-25 21:19:56 +08:00
-LAN- 45a3ea6fed
fix: add support for FILE type in ToolParameterConverter (#5578) 2024-06-25 18:47:59 +08:00
Bowen Liang 2a0f03a511
refactor: extract cors configs into dify config and cleanup the config class (#5507)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-25 15:48:02 +08:00
takatost ec1d3ddee2
feat: support importing and overwriting workflow DSL (#5511)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-06-25 15:46:12 +08:00
keita69 cdc2a6f637
The firecrawl tool now supports self-hosting (#5528)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-25 15:15:21 +08:00
Yeuoly 023dba9475
fix: revert CI path filters (#5561) 2024-06-24 23:46:15 +08:00
sino 877a2c144b
feat: support predefined models for openrouter (#5494) 2024-06-24 16:31:53 +08:00
非法操作 f7900f298f
chore: refactor the http executor node (#5212) 2024-06-24 16:14:59 +08:00
非法操作 1e28a8c033
chore: add create_json_message api for tools (#5440) 2024-06-24 15:46:16 +08:00
-LAN- ba67206bb9
fix(api/model_runtime/azure/llm): Switch to tool_call. (#5541) 2024-06-24 15:35:21 +08:00
Xiaoguang Sun 13fcd7a901
feat: Add program_name attribute to TiDB connection (#5499)
Signed-off-by: Xiaoguang Sun <sunxiaoguang@gmail.com>
2024-06-24 14:41:07 +08:00
Jyong 756d9a4bc2
add opensearch default value (#5536) 2024-06-24 14:33:31 +08:00
takatost 4a031de0d9
feat: make Citations and Attributions display enable default (#5508)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-06-24 13:03:49 +08:00
crazywoola 47a5d4527b
feat: use root dir to start python and celery (#5515) 2024-06-24 09:53:26 +08:00
Xiao Ley dcec9d7bb7
feat: add new features to enhance image and link handling in Jina tool (#5517) 2024-06-24 01:06:26 +08:00
kurokobo ea29007bc0
fix: apply best practices for the latest buildkit (#5527) 2024-06-24 00:45:33 +08:00
Xiao Ley 3a626cd251
fix: added error handling for novita ai tool query (#5506)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-23 17:59:03 +08:00
Nam Vu e9ce0b10de
feat: add Asia/Ho_Chi_Minh timezone (#5521) 2024-06-23 16:47:44 +08:00
kurokobo c5d64baba4
fix: correct typos (#5510) 2024-06-22 23:01:02 +08:00
Bowen Liang 29ca6815ae
chore: use singular style in middleware config class name (#5502) 2024-06-22 18:26:38 +08:00
Bowen Liang 5217f7cf69
refactor: extract hosted service configs into dify config (#5504) 2024-06-22 17:41:17 +08:00
非法操作 57063095c1
fix: summary of duckduckgo_search (#5488) 2024-06-22 13:58:30 +08:00
vccler 48757e581e
fix: zhipu tool calling, this PR fixes the bug described in issue #5496 (#5469)
Co-authored-by: vccler <vccler@163.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-22 12:41:24 +08:00
LXM e8ad0339a3
fix: tongyi json output (#5396) 2024-06-22 12:25:23 +08:00
Bowen Liang f67b164b0d
refactor: extract db configs and celery configs into dify config (#5491) 2024-06-22 10:29:56 +08:00
Bowen Liang b05cc3a1e4
refactor: extract storage provider configs into dify configs (#5443) 2024-06-22 10:07:03 +08:00
Bowen Liang 8890978ad3
chore: use singular style in config class name (#5489) 2024-06-22 09:54:25 +08:00
takatost 9a5c423d59
chore: remove pip support for api service (#5453)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
2024-06-22 02:05:50 +08:00
tmuife 6a09409ec9
Add Oracle23ai as a vector datasource (#5342)
Co-authored-by: walter from vm <walter.jin@oracle.com>
2024-06-22 01:48:07 +08:00
Bowen Liang 27f0ae8416
build: support Poetry for depencencies tool in api's Dockerfile (#5105)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-22 01:34:08 +08:00
crazywoola 91d38a535f
fix: max_tokens of qwen-plus & qwen-plus-chat (#5480) 2024-06-21 16:49:33 +08:00
Pan, Wen-Ming 95c882934e
feat: add support for Vertex AI claude-3-5-sonnet@20240620 (#5475)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-21 16:45:56 +08:00
crazywoola 92ddb410cd
feat: option to hide workflow steps (#5436) 2024-06-21 12:51:10 +08:00
-LAN- 1336b844fd
feat(api/auth): switch-to-stateful-authentication (#5438) 2024-06-21 12:39:07 +08:00
Su Yang 26b6fd2236
feat: add support for bedrock claude-3-5-sonnet-20240620 (#5461) 2024-06-21 10:21:35 +08:00
takatost ff0f02d809
feat: add support for claude-3-5-sonnet-20240620 (#5452) 2024-06-21 00:23:15 +08:00
Bowen Liang 65d34ebb96
refactor: extract vdb configs into pydantic-setting based dify configs (#5426) 2024-06-20 16:24:10 +08:00
-LAN- 142dc0afd7
refactor: Remove unused code in large_language_model.py (#5433) 2024-06-20 16:20:40 +08:00
Bowen Liang 39c14ec7c1
improve: unify Excel files parsing in either xls or xlsx file format by Pandas (#4965) 2024-06-20 16:14:49 +08:00
-LAN- 23fa3dedc4
fix(core): Fix incorrect type hints. (#5427) 2024-06-20 15:16:21 +08:00
takatost a51ec2094f
fix: sentry config float type err (#5416) 2024-06-20 11:28:52 +08:00
Bowen Liang aed56b1a8f
fix: Revert "feat: initial support for Milvus 2.4.x (#3795)" downgrading to 2.3.x for Linux arm64 installation failure (#5414) 2024-06-20 11:18:05 +08:00
takatost a88aa20824
fix: optional parameter missing default value None in http request node (#5413) 2024-06-20 11:07:01 +08:00
quicksand 0105129fa8
fix bug: tencent vdb #5378 (#5408) 2024-06-20 10:37:39 +08:00
Bowen Liang c923684edd
chore: extract retrival method literal values into enum (#5060) 2024-06-19 16:05:27 +08:00
liuzhenghua 9d5a89eab6
feat: add log date timezone (#4623)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-19 15:51:00 +08:00
-LAN- bdf3ea4369
docs(api/README): Remove unnecessary `=` (#5380) 2024-06-19 15:17:13 +08:00
Bowen Liang bb33ffc332
feat: initial support for Milvus 2.4.x (#3795) 2024-06-19 13:55:44 +08:00
Bowen Liang 3cc6093e4b
feat: introduce pydantic-settings for config definition and validation (#5202)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-19 13:41:12 +08:00
baojingyu d160d1ed02
feat: support opensearch approximate k-NN (#5322) 2024-06-19 12:44:33 +08:00
fishisnow e785cbb81d
Fix: multi image preview sign (#5376)
Co-authored-by: huangyusong <huangyusong@yingzi.com>
2024-06-19 12:36:40 +08:00
kurokobo 0e3113b7ce
feat: allow non-english wikipedias to be searched (#5371) 2024-06-19 10:06:47 +08:00
开坦克的贝塔 7d5ebbb611
docs(readme): Optimize the content in the readme file (#5364)
Co-authored-by: 开坦克的贝塔 <k@aircode.io>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 18:33:22 +08:00
horochx 85eee0dfbb
Update README.md (#5359) 2024-06-18 18:21:45 +08:00
Xiao Ley 369a395ee9
fix: resolve issue with cot_agent_runner not analyzing user-uploaded images correctly (#5360)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 18:15:41 +08:00
-LAN- 4e3d76a1d1
chore: add `novita_client` to `pyproject.toml` (#5349) 2024-06-18 14:52:20 +08:00
Bowen Liang 7450b9acf3
dep: bump chromadb from 0.5.0 to 0.5.1 (#5345) 2024-06-18 14:05:14 +08:00
Bowen Liang c7d378555a
chore: set build system to Poetry and remove unnecessary settings with package mode disabled (#5263) 2024-06-18 13:27:03 +08:00
Bowen Liang 5f0ce5811a
feat: add `flask upgrade-db` command for running db upgrade with redis lock (#5333) 2024-06-18 13:26:01 +08:00
rerorero 9b7fdadce4
fix: wrong token usage in iteration node for streaming result (#5336) 2024-06-18 13:08:40 +08:00
Xiao Ley 132f5fb3de
feat: add Novita AI image generation tool, implemented model search, text-to-image and create tile functionalities (#5308)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-06-18 11:08:25 +08:00
Ikko Eltociear Ashimine 8266842809
chore: update llm.py (#5335) 2024-06-18 09:29:14 +08:00
sino d7213b12cc
fix: extract params by function calling for models supporting tool call (#5334) 2024-06-17 23:25:29 +08:00
Richards Tu c163521b9e
Update and fix the model param of Deepseek (#5329) 2024-06-17 21:40:04 +08:00
Mitsuki Ogasahara 7305713b97
fix: allow special characters in email (#5327)
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-17 21:32:59 +08:00
sino edffa5666d
fix: got unknown type of prompt message in multi-round ReAct agent chat (#5245) 2024-06-17 21:20:17 +08:00
-LAN- 54756cd3b2
chore(core/workflow/utils/variable_template_parser): Refactor VariableTemplateParser class for better readability and maintainability. (#5328) 2024-06-17 21:18:56 +08:00
-LAN- b73ec87afc
fix(core/workflow): Handle special values in node run result outputs (#5321) 2024-06-17 20:41:57 +08:00
Justin Wu 61f4f08744
Add bedrock command r models (#4521)
Co-authored-by: Justin Wu <justin.wu@ringcentral.com>
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-06-17 20:37:46 +08:00
Jyong 07387e9586
add the filename length limit (#5326) 2024-06-17 20:36:54 +08:00
quicksand 147a39b984
feat: support tencent cos storage (#5297) 2024-06-17 19:18:52 +08:00
Bowen Liang 7a758a35fe
fix: pin tenacity to 8.3.0 (#5319) 2024-06-17 18:03:42 +08:00
sino be3512aa57
fix: unable to reindex documents (#5276) 2024-06-17 17:19:43 +08:00
Charles Zhou cc4a4ec796
feat: permission and security fixes (#5266) 2024-06-17 16:06:32 +08:00
非法操作 24282236f0
fix: not checked require_summary of duckduckgo search raise error (#5303) 2024-06-17 14:18:49 +08:00
-LAN- 5a99aeb864
fix(core): Reorder `field_validator` and `classmethod` to fit Pydantic V2. (#5257) 2024-06-17 10:04:28 +08:00