Commit Graph

851 Commits

Author SHA1 Message Date
takatost 9175eb455f fix context 2024-03-18 21:11:27 +08:00
takatost 977020f580 lint fix 2024-03-18 20:59:22 +08:00
takatost a2195c813c fix file render 2024-03-18 20:59:11 +08:00
jyong d5a404236a knowledge fix 2024-03-18 20:54:50 +08:00
jyong 4a483a8754 Merge remote-tracking branch 'origin/feat/workflow-backend' into feat/workflow-backend 2024-03-18 20:35:23 +08:00
jyong a4f367b8ff knowledge fix 2024-03-18 20:35:10 +08:00
Yeuoly e225a3d33c
linter 2024-03-18 20:22:25 +08:00
Yeuoly e7d6def1e8
fix: trim file extension 2024-03-18 19:59:54 +08:00
takatost 387a6cfee4 remove answer as end 2024-03-18 19:25:18 +08:00
jyong e66c55ba9e fix enable annotation reply when collection is None 2024-03-18 19:21:36 +08:00
Yeuoly 487efcb206
fix: support deprecated tools 2024-03-18 18:45:29 +08:00
takatost 34695f02fb add model config for conversation 2024-03-18 18:25:46 +08:00
Su Yang 45e51e7730
feat: AWS Bedrock Claude3 (#2864)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-03-18 18:16:36 +08:00
takatost aa421269c4 deduct llm quota use llm node func 2024-03-18 18:01:57 +08:00
takatost 09cfbe117e fix annotation bugs 2024-03-18 17:57:10 +08:00
takatost 0ea233edbe Merge branch 'main' into feat/workflow-backend 2024-03-18 17:20:25 +08:00
Yeuoly 95b74c211d
Feat/support tool credentials bool schema (#2875) 2024-03-18 16:55:26 +08:00
takatost d69e0a79d4 fix file upload config internal err 2024-03-18 16:55:15 +08:00
takatost 61b41ca04b fix retriever resource 2024-03-18 16:38:39 +08:00
Onelevenvy cb79a90031
feat: Add tools for open weather search and image generation using the Spark API. (#2845) 2024-03-18 16:22:48 +08:00
jyong 5ed181dd42 knowledge entities fix 2024-03-18 15:54:59 +08:00
jyong 41d9fdee50 Merge remote-tracking branch 'origin/feat/workflow-backend' into feat/workflow-backend 2024-03-18 15:40:26 +08:00
jyong 9e37021387 knowledge entities fix 2024-03-18 15:40:11 +08:00
takatost a93a2e2e0c Merge branch 'main' into feat/workflow-backend 2024-03-18 15:35:04 +08:00
Onelevenvy 4502436c47
feat:Embedding models Support for the Aliyun dashscope text-embedding-v1 and text-embedding-v2 (#2874) 2024-03-18 15:21:26 +08:00
takatost 02337cbb09 fix answer message save 2024-03-18 15:07:56 +08:00
takatost 958da42f74 fix advanced chat answer 2024-03-18 14:28:07 +08:00
orangeclk e7343cc67c
add max_tokens parameter rule for zhipuai glm4 and glm4v (#2861) 2024-03-18 13:19:36 +08:00
VoidIsVoid 83145486b0
fix: fix unstable function call response arguments missing (#2872) 2024-03-18 13:17:16 +08:00
takatost 69c8e4ddd1 fix source handle 2024-03-18 13:11:58 +08:00
Su Yang 6fd1795d25
feat: Allow users to specify AWS Bedrock validation models (#2857) 2024-03-18 00:44:09 +08:00
takatost 96f38b2d15 fix bug 2024-03-18 00:13:34 +08:00
takatost 8a27e51658 add Bad Request when generating 2024-03-17 21:40:59 +08:00
takatost 8ecec84dcf Merge branch 'main' into feat/workflow-backend
# Conflicts:
#	api/core/application_manager.py
2024-03-17 21:38:33 +08:00
takatost a2b3096159 add text chunk subscribe for advanced chat blocking mode 2024-03-17 21:36:22 +08:00
takatost 80f1fbba56 add image file as markdown stream outupt 2024-03-17 21:27:08 +08:00
Su Yang f770232b63
feat: add model for 01.ai, yi-chat-34b series (#2865) 2024-03-17 21:24:01 +08:00
Yeuoly d8ab611480
fix: code 2024-03-17 21:08:41 +08:00
Yeuoly b99eadecf6
fix: code template 2024-03-17 16:18:15 +08:00
Bowen Liang a8e694c235
fix: print exception logs for ValueError and InvokeError (#2823) 2024-03-17 14:34:32 +08:00
takatost d2d47d0e0e fix bug 2024-03-16 15:09:47 +08:00
takatost 11dfdb236d lint fix 2024-03-16 14:45:39 +08:00
takatost 6df520ebc6 add skip ran node 2024-03-16 14:45:16 +08:00
jyong 1df68a546e variable assigner node 2024-03-16 01:15:40 +08:00
jyong 5013ea09d5 variable assigner node 2024-03-16 00:54:29 +08:00
jyong d92d952e76 Merge remote-tracking branch 'origin/feat/workflow-backend' into feat/workflow-backend 2024-03-16 00:37:15 +08:00
jyong 4af304e6ae question classifier 2024-03-16 00:36:58 +08:00
takatost 62846be275 refactor app generate pipeline 2024-03-15 21:42:22 +08:00
jyong 9b57b4c6c8 dataset retrival 2024-03-15 18:22:48 +08:00
jyong 785dfc5c00 dataset retrival 2024-03-15 18:22:48 +08:00
takatost 12eb236364 answer stream output support 2024-03-15 18:22:48 +08:00
Yeuoly 1cfeb989f7 fix: code default output 2024-03-15 18:22:47 +08:00
Yeuoly ede65eca4d fix: tool 2024-03-15 18:22:47 +08:00
Yeuoly dc53362506 fix: conversation_id equals to none 2024-03-15 18:22:47 +08:00
takatost 72d2f76d24 fix default configs 2024-03-15 18:22:47 +08:00
Yeuoly 87a36a1fc8 fix: linter 2024-03-15 18:22:47 +08:00
Yeuoly c2ded79cb2 fix: node type 2024-03-15 18:22:47 +08:00
Yeuoly 6633a92e1a fix: http 2024-03-15 18:22:47 +08:00
takatost 44c4d5be72 add answer output parse 2024-03-15 18:22:47 +08:00
Yeuoly 0614ddde7d fix: allow None AuthorizationConfig 2024-03-15 18:22:47 +08:00
takatost e5ff06bcb7 fix err typo 2024-03-15 18:22:47 +08:00
takatost 735b55e61b add if-else node 2024-03-15 18:22:47 +08:00
takatost 7e53625eae fix value type 2024-03-15 18:22:47 +08:00
takatost 5213b0aade add sequence_number for workflow_started event 2024-03-15 18:22:47 +08:00
takatost 2b4b6817a3 record inputs and process data when node failed 2024-03-15 18:22:47 +08:00
takatost da3e1e9d14 add deduct quota for llm node 2024-03-15 18:22:47 +08:00
Yeuoly e6572ef2d7 fix: linter 2024-03-15 18:22:47 +08:00
Yeuoly 2182533af8 feat: javascript code 2024-03-15 18:22:47 +08:00
takatost d88ac6c238 add llm node 2024-03-15 18:22:47 +08:00
Yeuoly 92c1da8dbe fix: remove answer 2024-03-15 18:22:47 +08:00
Yeuoly b102562614 fix: forward-ref 2024-03-15 18:22:47 +08:00
Yeuoly 2c2b9e7389 test: template transform 2024-03-15 18:22:47 +08:00
Yeuoly 513a8655b1 test: tool 2024-03-15 18:22:47 +08:00
Yeuoly d3385a2715 feat 2024-03-15 18:22:47 +08:00
Yeuoly ebf9c41adb feat: http 2024-03-15 18:22:47 +08:00
jyong 7372776992 knowledge node 2024-03-15 18:22:47 +08:00
takatost f2bb0012fd add debug code 2024-03-15 18:22:47 +08:00
takatost 33113034ea add single step run 2024-03-15 18:22:47 +08:00
Yeuoly 88c29f613f fix: typing 2024-03-15 18:22:47 +08:00
Yeuoly f318fa058c feat: add variable selector mapping 2024-03-15 18:22:47 +08:00
Yeuoly 407bfb8182 feat: add user uid 2024-03-15 18:22:47 +08:00
Yeuoly 91845fc9f6 fix: linter 2024-03-15 18:22:47 +08:00
Yeuoly f911b1c488 feat: support empty code output children 2024-03-15 18:22:47 +08:00
takatost 7a6fa3655f add user for node 2024-03-15 18:22:47 +08:00
Yeuoly 5eb7b4d56a feat: tool entity 2024-03-15 18:22:47 +08:00
Yeuoly 5e4bd9fc38 feat: tool node 2024-03-15 18:22:47 +08:00
Yeuoly f8cba2679e fix: linter 2024-03-15 18:22:47 +08:00
Yeuoly e0883302d2 feat: jinja2 2024-03-15 18:22:47 +08:00
takatost a0a1618869 add tenant_id / app_id / workflow_id for nodes 2024-03-15 18:22:47 +08:00
takatost be68369983 add workflow_app_log codes 2024-03-15 18:22:47 +08:00
Yeuoly 8031262006 feat: workflow mock test 2024-03-15 18:22:47 +08:00
takatost 751489fa54 modify readme 2024-03-15 18:22:47 +08:00
Yeuoly 1e6feadc7e fix: code node dose not work as expected 2024-03-15 18:22:47 +08:00
takatost 2d8497f79b add readme for db connection management in App Runner and Task Pipeline 2024-03-15 18:22:47 +08:00
takatost 61a1aadf9c optimize workflow db connections 2024-03-15 18:22:47 +08:00
takatost 8b832097de optimize db connections 2024-03-15 18:22:45 +08:00
takatost 7e4daf131e optimize db connections 2024-03-15 18:17:05 +08:00
takatost de3978fdbb optimize db connections 2024-03-15 18:17:05 +08:00
Yeuoly 51f6ab49cf fix: linter 2024-03-15 18:17:05 +08:00
Yeuoly 2895c3bc8c feat: template transform 2024-03-15 18:17:05 +08:00
Yeuoly 3d5f9b5a1e fix: missing _extract_variable_selector_to_variable_mapping 2024-03-15 18:17:05 +08:00
Yeuoly 614bc2e075 feat: http reqeust 2024-03-15 18:17:05 +08:00
Yeuoly 193bcce236 feat: http request 2024-03-15 18:17:05 +08:00
Yeuoly a0fd731170 feat: mapping variables 2024-03-15 18:17:05 +08:00
takatost 2f57d090a1 refactor pipeline and remove node run run_args 2024-03-15 18:17:05 +08:00
Yeuoly 4c5822fb6e fix: transform 2024-03-15 18:17:05 +08:00
takatost e90637f67a fix generate bug 2024-03-15 18:17:05 +08:00
Yeuoly 9b0f83f807 fix: add max number array length 2024-03-15 18:17:05 +08:00
takatost fc573564b4 refactor workflow runner 2024-03-15 18:17:05 +08:00
Yeuoly 5596b3b00b fix: linter 2024-03-15 18:17:05 +08:00
Yeuoly cb02b1e12e feat: code 2024-03-15 18:17:05 +08:00
Yeuoly 736e386f15 fix: bugs 2024-03-15 18:17:05 +08:00
takatost c152d55f68 fix workflow app bugs 2024-03-15 18:17:05 +08:00
takatost 1a0b6adc2c fix stream bugs 2024-03-15 18:17:05 +08:00
takatost 1914dfea77 fix bugs 2024-03-15 18:17:05 +08:00
takatost 1f986a3abb fix bugs 2024-03-15 18:17:05 +08:00
takatost 8684b172d2 add start, end, direct answer node 2024-03-15 18:17:05 +08:00
takatost 3e54cb26be move funcs 2024-03-15 18:17:05 +08:00
takatost 079cc082a3 use callback to filter workflow stream output 2024-03-15 18:17:05 +08:00
takatost a1bc6b50c5 refactor workflow generate pipeline 2024-03-15 18:17:05 +08:00
takatost 7d28fe8ea5 completed workflow engine main logic 2024-03-15 18:17:05 +08:00
takatost 79a10e9729 add updated_at to sync workflow api 2024-03-15 18:17:04 +08:00
takatost bc4edbfc2b lint fix 2024-03-15 18:17:04 +08:00
takatost 75f1355d4c add few workflow run codes 2024-03-15 18:17:04 +08:00
takatost 1a86e79d4a lint fix 2024-03-15 18:17:04 +08:00
takatost c8a1f923f5 lint fix 2024-03-15 18:17:04 +08:00
takatost df753e84a3 fix workflow api return 2024-03-15 18:17:04 +08:00
takatost 3086893ee7 fix typo 2024-03-15 18:17:04 +08:00
takatost 242fcf0145 fix typo 2024-03-15 18:17:04 +08:00
takatost df809ff435 add get default node config 2024-03-15 18:17:04 +08:00
takatost 75559bcbf9 replace block type to node type 2024-03-15 18:17:04 +08:00
takatost d9b8a938c6 use enum instead 2024-03-15 18:17:04 +08:00
takatost e9004a06a5 lint fix 2024-03-15 18:17:04 +08:00
takatost be709d4b84 add AdvancedChatAppGenerateTaskPipeline 2024-03-15 18:17:04 +08:00
takatost 602bc67495 lint fix 2024-03-15 18:17:04 +08:00
takatost e498efce2d refactor app generate 2024-03-15 18:17:04 +08:00
takatost b80092ea12 lint fix 2024-03-15 18:17:04 +08:00
takatost 2eaae6742a lint fix 2024-03-15 18:17:04 +08:00
takatost 3f5d1a79c6 refactor apps 2024-03-15 18:17:04 +08:00
takatost 15c7e0ec2f lint fix 2024-03-15 18:17:04 +08:00
takatost 43b0440358 support workflow features 2024-03-15 18:17:03 +08:00
takatost 7bff65304f add features structure validate 2024-03-15 18:15:54 +08:00
takatost 8a8882ed8d move workflow_id to app 2024-03-15 18:15:54 +08:00
takatost 9467fe9aa9 lint fix 2024-03-15 18:15:54 +08:00
takatost 799db69e4f refactor app 2024-03-15 18:15:48 +08:00
takatost 896c200211 fix import problem 2024-03-15 18:15:17 +08:00
takatost d741527ae4 lint 2024-03-15 18:15:17 +08:00
takatost 77618823a5 add features update api
refactor app model config validation
2024-03-15 18:15:17 +08:00
takatost 27ba5a0bce refactor app mode
add app import and export
2024-03-15 18:15:13 +08:00
takatost 77f04603b3 fix bugs 2024-03-15 18:13:55 +08:00
takatost 34ed5e428c fix bugs 2024-03-15 18:13:55 +08:00
takatost 98cb17e79e lint fix 2024-03-15 18:13:55 +08:00
takatost fce20e483c restore completion app 2024-03-15 18:13:55 +08:00
takatost 2ba7ac8bc1 add expert mode of chatapp convert command 2024-03-15 18:13:55 +08:00
takatost 0806b3163a add to http request node convert tests 2024-03-15 18:13:55 +08:00
takatost 45621ba4d7 add api extension to http request node convert 2024-03-15 18:13:55 +08:00
takatost 6aecf42b6e fix prompt transform bugs 2024-03-15 18:13:55 +08:00
takatost 3b234febf5 fix bugs and add unit tests 2024-03-15 18:13:55 +08:00
takatost 8642354a2a lint 2024-03-15 18:13:55 +08:00
takatost c028e5f889 add app convert codes 2024-03-15 18:13:55 +08:00
takatost 3642dd3a73 add workflow logics 2024-03-15 18:13:55 +08:00
takatost d430136f65 lint 2024-03-15 18:13:55 +08:00
takatost 381b3d5016 optimize get app model to wraps 2024-03-15 18:13:55 +08:00
Yeuoly cef16862da
fix: charts encoding (#2848) 2024-03-15 14:02:52 +08:00
Yeuoly 742be06ea9
Fix/localai (#2840) 2024-03-15 11:41:51 +08:00
Bowen Liang 19d3a56194
feat: add weekday calculator in time tool (#2822) 2024-03-14 17:01:48 +08:00
Qun 1e5455e266
enhance: use override_settings for concurrent stable diffusion (#2818) 2024-03-14 15:26:07 +08:00
Eric Wang 4fe585acc2
feat(llm/models): add claude-3-haiku-20240307 (#2825) 2024-03-14 10:08:24 +08:00
呆萌闷油瓶 e52448b84b
feat:add api-version selection for azure openai APIs (#2821) 2024-03-14 09:14:27 +08:00
Bowen Liang 8b15b742ad
generalize position helper for parsing _position.yaml and sorting objects by name (#2803) 2024-03-13 20:29:38 +08:00
Mark Sun 510f8ede10
Improve automatic prompt generation (#2805) 2024-03-13 14:10:47 +08:00
呆萌闷油瓶 8f9125b08a
fix:typo (#2808) 2024-03-13 13:00:46 +08:00
呆萌闷油瓶 e5e97c0a0a
fix:change azure openai api_version default value to 2024-02-15-preview (#2797) 2024-03-12 22:07:06 +08:00
Weaxs 20bd49285b
excel: get keys from every sheet (#2796) 2024-03-12 16:59:25 +08:00
crazywoola 6bd2730317
Fix/2770 suggestions for next steps (#2788) 2024-03-12 16:27:55 +08:00
Yeuoly f734cca337
enhance: add stable diffusion user guide (#2795) 2024-03-12 14:45:48 +08:00
Bowen Liang f82a64d149
feat: add DingTalk(钉钉) tool for sending message to chat group bot via webhook (#2693) 2024-03-12 13:45:59 +08:00
呆萌闷油瓶 f49b1afd6c
feat:support azure tts (#2751) 2024-03-12 12:06:35 +08:00
Jyong e54c9cd401
Feat/open ai compatible functioncall (#2783)
Co-authored-by: jyong <jyong@dify.ai>
2024-03-11 19:48:21 +08:00
Jyong 6454e1d644
chunk-overlap None check (#2781)
Co-authored-by: jyong <jyong@dify.ai>
2024-03-11 15:36:56 +08:00
Yeuoly 82d0732c12
fix: aippt default styles (#2779) 2024-03-11 14:04:09 +08:00
Yeuoly 53cd125780
fix: deep copy of model-tool label (#2775) 2024-03-11 10:27:00 +08:00
takatost f073dca22a
feat: optimize db connection when llm invoking (#2774) 2024-03-10 15:48:31 +08:00
Yeuoly ce58f0607b
Feat/tool secret parameter (#2760) 2024-03-08 20:31:13 +08:00
洪朔 60e7e17c86
feat: Add new Azure OpenAI Embedding models (#2758) 2024-03-08 19:04:20 +08:00
Vikey Chen 237bb8514e
replace message content type list to string when file_objs is empty .. (#2745) 2024-03-08 18:46:31 +08:00
Yeuoly b6b58da2d2
enhance: custom tool timeout (#2754) 2024-03-08 15:26:08 +08:00
Yeuoly 40c646cf7a
Feat/model as tool (#2744) 2024-03-08 15:22:55 +08:00
Yeuoly 3231a8c51c
fix: image tokenizer (#2752) 2024-03-08 14:50:51 +08:00
Bowen Liang 4170d6a491
use SVG icons for built-in tools (#2748) 2024-03-08 10:21:26 +08:00
Bowen Liang 0b50c525cf
feat: support error correction and border size in qrcode tool (#2731) 2024-03-07 20:54:14 +08:00
Jyong 8ba38e8e74
fix overlap and splitter optimization (#2742)
Co-authored-by: jyong <jyong@dify.ai>
2024-03-07 18:25:49 +08:00
Bowen Liang b163545771
Use `python-docx` to extract docx files (#2654) 2024-03-07 18:24:55 +08:00
Yash Parmar c0b82f8e58
UPDATE: Twilio tool crdential verification (#2741) 2024-03-07 18:08:52 +08:00
呆萌闷油瓶 b75ff5fa03
fix:missing import (#2739) 2024-03-07 17:31:30 +08:00
Yeuoly 24809fce07
fix: missing en_name of aippt (#2737) 2024-03-07 16:37:12 +08:00
呆萌闷油瓶 9819ad347f
feat:support azure whisper model and fix:rename text-embedidng-ada-002.yaml to text-embedding-ada-002.yaml (#2732) 2024-03-07 16:36:58 +08:00
Yeuoly 8fe83750b7
Fix/jina tokenizer cache (#2735) 2024-03-07 16:32:37 +08:00
Yeuoly 1809f05904
Feat/add groq (#2733) 2024-03-07 16:00:40 +08:00
Bowen Liang 0ac250a035
fix: check webhook key of Wecom tool in valid UUID form and fix typo (#2719) 2024-03-07 15:51:06 +08:00