Commit Graph

281 Commits

Author SHA1 Message Date
liuzhenghua d05f189049
Fix: RateLimit requests were not released when a streaming generation exception occurred (#11540) 2024-12-11 19:16:35 +08:00
Novice 79a710ce98
Feat: continue on error (#11458)
Co-authored-by: Novice Lee <novicelee@NovicedeMacBook-Pro.local>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
2024-12-11 14:22:42 +08:00
yihong 225fcd5e41
Revert "fix: total tokens is wrong which is zero in inter way, close … (#11536) 2024-12-11 09:54:46 +08:00
-LAN- fd354d999d
fix(app_generator_service): overload type hints (#11507)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-12-10 09:06:34 +08:00
yihong d9d5d35a77
fix: issue #10596 by making the iteration node outputs right (#11394)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-12-07 16:28:15 +08:00
Jyong a8d32f9964
fix external retrieval without segment id (#11423) 2024-12-06 14:45:15 +08:00
yihong 5669cac16d
fix: some typos using typos (#11374)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2024-12-05 13:24:06 +08:00
Yi Xiao e135ffc2c1
Feat: upgrade variable assigner (#11285)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-12-03 13:56:40 +08:00
Hash Brown c4fad66f2a
fix: `dialogue_count` incorrect in chatflow when there's... (#11175) 2024-12-02 16:09:26 +08:00
-LAN- 3c8efe7c0a
fix(workflow_cycle_manage): Handle special values in the process_data. (#11253)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-12-02 13:53:43 +08:00
-LAN- c34bdb74e6
Fix/type-error (#11240)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-12-02 10:24:21 +08:00
yihong fd4be36991
fix: total tokens is wrong which is zero in inter way, close #11221 (#11224)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2024-11-30 23:18:24 +08:00
-LAN- 8d5a1be227
fix: Cannot use files in the user inputs. (#11112) 2024-11-26 13:43:38 +08:00
-LAN- 98d85e6b74
fix: WorkflowNodeExecution.created_at may be earlier than WorkflowRun.created_at (#11070) 2024-11-25 18:16:55 +08:00
-LAN- 3eb51d85da
fix(workflow_entry): Support receive File and FileList in single step run. (#10947)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-11-25 12:46:50 +08:00
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 2024-11-24 13:28:46 +08:00
yihong 0181f1c08c
fix: wrong convert in PromptTemplateConfigManager (#11016)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2024-11-24 12:18:19 +08:00
yihong 7f00c5a02e
fix: uuid not import bug (#11014)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2024-11-24 11:17:55 +08:00
-LAN- c5f7d650b5
feat: Allow using file variables directly in the LLM node and support more file types. (#10679)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-11-22 16:30:22 +08:00
yihong 0067b16d1e
fix: refactor all 'or []' and 'or {}' logic to make code more clear (#10883)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2024-11-21 10:34:43 +08:00
KVOJJJin 328965ed7c
Fix: crash of workflow file upload (#10831)
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-11-19 14:15:18 +08:00
crazywoola 2fed55ae6b
Fix: number maybe empty string (#10743) 2024-11-15 16:31:10 +08:00
Bowen Liang 51db59622c
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 2024-11-15 15:41:40 +08:00
Novice f414d241c1
Feat/iteration single run time (#10512) 2024-11-11 14:47:52 +08:00
-LAN- 172c7eb270
fix(file_upload): correct validation method and add unit tests (#10477) 2024-11-08 21:55:01 +08:00
-LAN- 25ca0278dd
refactor(core): Remove extra_config from File. (#10203) 2024-11-08 18:13:24 +08:00
Bowen Liang 0ebe198ff1
chore: use DEBUG in dify_config instead of parsing raw system environment variable in place (#10437) 2024-11-08 09:34:11 +08:00
Bowen Liang 574c4a264f
chore(lint): Use logging.exception instead of logging.error (#10415) 2024-11-07 21:13:02 +08:00
Novice d1505b15c4
feat: Iteration node support parallel mode (#9493) 2024-11-05 10:32:49 +08:00
-LAN- 6b0de08157
fix(validation): allow to use 0 in the inputs form (#10255) 2024-11-04 18:34:55 +08:00
-LAN- 6452342222
feat(workflow): add configurable workflow file upload limit (#10176)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-11-04 15:55:34 +08:00
-LAN- 61da0f08dd
refactor(validation): improve input validation logic (#10175) 2024-11-03 11:55:46 +08:00
luckylhb90 400392230b
fixed: variable reference error (#9722)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-10-23 19:17:06 +08:00
-LAN- 36f66d40e5
refactor(api): simplify limit retrieval and return types (#9641) 2024-10-22 16:34:16 +08:00
-LAN- c063617553
fix(workflow): improve database session handling and variable management (#9581) 2024-10-22 00:42:40 +08:00
-LAN- 740a723072
fix(validation): improve variable handling and validation (#9578) 2024-10-21 23:33:16 +08:00
-LAN- 4ae0bb83f1
fix(file upload): correct upload method key for image config (#9568) 2024-10-21 20:40:47 +08:00
-LAN- faad247d85
fix(upload): correct incorrect dictionary key usage (#9563) 2024-10-21 19:42:22 +08:00
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
Hash Brown fa47f0c707
chore: disable chat service API passing `parent_message_id` (#8984) 2024-10-14 19:13:16 +08:00
takatost 23ce1fb1ba
chore: optimize the trace ops slow queries on node executions. (#9282) 2024-10-12 18:30:46 +08:00
takatost 29188e0562
chore: use cache instead of re-querying node record during workflow execution (#9280) 2024-10-12 17:48:59 +08:00
crazywoola 93af87a9e0
fix: move exception to debug mode (#9258) 2024-10-12 09:28:45 +08:00
takatost 477beae3bb
fix: missing usage of metadata in the chatflow app (#9167) 2024-10-10 16:34:06 +08:00
Joe e947103b6d
Feat/add workflow sys params (#9108)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-10-10 11:15:52 +08:00
pinsily 7a1da2409d
add generate conversation name error log (#9117) 2024-10-09 21:09:36 +08:00
-LAN- ada9d408ac
refactor(api/variables): VariableError as a ValueError. (#8554) 2024-09-30 12:48:58 +08:00
chenxu9741 c531b4a911
fix: #8843 event: tts_message_end always return in api streaming resp… (#8846) 2024-09-29 16:13:20 +08:00
cherryhuahua d0e0111f88
fix:Spark's large language model token calculation error #7911 (#8755) 2024-09-25 14:51:42 +08:00
haike-1213 4c7beb9d7b
fix: Assignment exception (#8663)
Co-authored-by: fum <fum@investoday.com.cn>
2024-09-23 15:23:52 +08:00
Hash Brown 8c51d06222
feat: regenerate in `Chat`, `agent` and `Chatflow` app (#7661) 2024-09-22 03:15:11 +08:00
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2024-09-13 22:42:08 +08:00
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2024-09-13 14:24:49 +08:00
Tamer 404db1ae5b
Fix VariableEntityType Bug external-data-tool -> external_data_tool (#8299) 2024-09-12 20:27:55 +08:00
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2024-09-12 15:50:49 +08:00
Bowen Liang c69f5b07ba
chore: apply ruff E501 line-too-long linter rule (#8275)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 14:00:36 +08:00
Bowen Liang 0f14873255
chore: cleanup ruff flake8-simplify linter rules (#8286)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 12:55:45 +08:00
Bowen Liang 292220c596
chore: apply pep8-naming rules for naming convention (#8261) 2024-09-11 16:40:52 +08:00
takatost cee0c51dbb
feat: add from_variable_selector for stream chunk / message event (#8228) 2024-09-10 22:15:50 +08:00
Bowen Liang 2cf1187b32
chore(api/core): apply ruff reformatting (#7624) 2024-09-10 17:00:20 +08:00
takatost dabfd74622
feat: Parallel Execution of Nodes in Workflows (#8192)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Yi <yxiaoisme@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-10 15:23:16 +08:00
Fei He a8b9e01b3e
fix: fixed typo on loading reranking_mode (#7887) 2024-09-02 16:18:47 +08:00
Yeuoly 962cdbbebd
chore: add app generator overload (#7792) 2024-08-29 16:04:01 +08:00
Jyong 715eb8fa32
fix rerank mode is none (#7496) 2024-08-21 16:42:28 +08:00
KinWang e35e251863
feat: Sort conversations by updated_at desc (#7348)
Co-authored-by: wangpj <wangpj@hundsunc.om>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-08-20 17:55:44 +08:00
-LAN- 4f5f27cf2b
refactor(api/core/workflow/enums.py): Rename SystemVariable to SystemVariableKey. (#7445) 2024-08-20 17:52:06 +08:00
-LAN- a10b207de2
refactor(api/core/app/app_config/entities.py): Move Type to outside and add EXTERNAL_DATA_TOOL. (#7444) 2024-08-20 17:30:14 +08:00
Nam Vu dbc1ae45de
chore: update docstrings (#7343) 2024-08-16 14:19:01 +08:00
Nam Vu ed85d8281a
fix: null annotation (#7313) 2024-08-15 19:20:14 +08:00
-LAN- 3f9720bca0
fix(api/core/app/segments/segments.py): Fix file to markdown. (#7293) 2024-08-15 13:09:49 +08:00
-LAN- 8f16165f92
chore(api/core): Improve FileVar's type hint and imports. (#7290) 2024-08-15 12:43:18 +08:00
-LAN- 32dc963556
feat(api/workflow): Add `Conversation.dialogue_count` (#7275) 2024-08-15 10:53:05 +08:00
pp 101db126c8
fix: missed rerank_mode when convert to DatasetEntity (#7269) 2024-08-15 00:41:12 +08:00
KVOJJJin 935e72d449
Feat: conversation variable & variable assigner node (#7222)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-08-13 14:44:10 +08:00
Joe 425174e82f
feat: update ops trace (#7102) 2024-08-09 15:22:16 +08:00
Joe 7201b56a6d
fix: workflow log run time error (#7130) 2024-08-09 14:46:31 +08:00
Aero Kang ad682c394d
fix annotation reply is null (#7103) 2024-08-08 19:07:50 +08:00
-LAN- 4e8f6b3603
chore(api/core/app/segments/segments.py): Remove todo tags. (#7052) 2024-08-07 17:29:35 +08:00
Jyong 80c94f02e9
add vector field for other vectordb (#7051) 2024-08-07 17:14:03 +08:00
-LAN- aad02113c6
fix(api/core/app/segments): Allow to contains boolean value in object segment (#7047) 2024-08-07 16:20:22 +08:00
chenxu9741 dff3f41ef6
Workflow TTS playback node filtering issue. (#6877) 2024-08-04 14:28:56 +08:00
Joe 26e46d365c
fix: workflow trace user_id error (#6932) 2024-08-04 03:28:50 +08:00
Jyong 44801df8f8
fix score threshold limit be None (#6900) 2024-08-02 12:10:51 +08:00
Vicky Guo 829472a1d7
switch to diffy_config with Pydantic in files, moderation and app (#6747)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-07-29 02:57:45 +08:00
-LAN- 6a3bef8378
feat(api/core/app/segments): Update segment types and variables (#6734)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:51 +08:00
-LAN- 5d77dc4f58
feat(api/core/app/segments/parser.py): Remove blank segment in `convert_template` (#6709)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 18:19:33 +08:00
-LAN- c6996a48a4
refactor(api/core/app/segments): Support more kinds of Segments. (#6706)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 15:03:56 +08:00
-LAN- 75e6576c67
refactor(api/core/app/segments): implement `to_object` in ObjectVariable and ArrayVariable. (#6671)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 17:06:38 +08:00
-LAN- 72bc9d5f2b
feat(api/core/app/segments/variables.py): Support description in Variable. (#6636)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:22 +08:00
Jyong 600f13436d
remove rerank model must be required when retrieval_model is multiple (#6640) 2024-07-24 19:34:41 +08:00
Jyong e4bb943fe5
Feat/delete single dataset retrival (#6570) 2024-07-24 12:50:11 +08:00
-LAN- 85a883e281
fix(variables): NoneVariable should inherit from NoneSegment. (#6584) 2024-07-23 21:46:08 +08:00
-LAN- 2bc0632d0d
fix(segments): Support NoneType. (#6581) 2024-07-23 17:59:32 +08:00
-LAN- f019bc4bd7
feat(variables): Support `to_object`. (#6572) 2024-07-23 16:22:06 +08:00
-LAN- 5e6fc58db3
Feat/environment variables in workflow (#6515)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-22 15:29:39 +08:00
guogeer 4fdcb30ff8
fix: custom tool input number fail (#6200)
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
2024-07-14 22:11:13 +08:00
liuzhenghua 9622fbb62f
feat: app rate limit (#5844)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-07-10 21:31:35 +08:00
chenxu9741 6ef401a9f0
feat:add tts-streaming config and future (#5492) 2024-07-09 11:33:58 +08:00
-LAN- d7f75d17cc
Chore/remove-unused-code (#5917) 2024-07-04 18:18:26 +08:00
-LAN- 66a62e6c13
refactor(api/core/app/apps/base_app_generator.py): improve input validation and sanitization in BaseAppGenerator (#5866) 2024-07-02 18:58:07 +08:00
takatost 0bf4817474
fix: _convert_prompt_message_to_dict parameters err (#5716) 2024-06-28 21:00:00 +08:00
Bowen Liang dcb72e0067
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-27 11:21:31 +08:00
Joe 4e2de638af
feat: add ops trace (#5483)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-26 17:33:29 +08:00
非法操作 b8926ea267
fix: DuckDuckGo image search tool error (#5606) 2024-06-26 13:21:40 +08:00
takatost 4a031de0d9
feat: make Citations and Attributions display enable default (#5508)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2024-06-24 13:03:49 +08:00
rerorero 9b7fdadce4
fix: wrong token usage in iteration node for streaming result (#5336) 2024-06-18 13:08:40 +08:00
-LAN- b73ec87afc
fix(core/workflow): Handle special values in node run result outputs (#5321) 2024-06-17 20:41:57 +08:00
-LAN- 5a99aeb864
fix(core): Reorder `field_validator` and `classmethod` to fit Pydantic V2. (#5257) 2024-06-17 10:04:28 +08:00
takatost 415022aa14
fix: pydantic2 error (#5172) 2024-06-14 03:05:04 +08:00
Bowen Liang f976740b57
improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 2024-06-14 01:05:37 +08:00
Yeuoly 0cccf9c67d
feat: introduce APP_MAX_EXECUTION_TIME (#5167) 2024-06-13 23:08:05 +08:00
Yeuoly 80a87f36ea
fix: missing iterator in task pipeline (#4948) 2024-06-05 15:10:20 +08:00
takatost d1dbbc1e33
feat: backend model load balancing support (#4927) 2024-06-05 00:13:04 +08:00
Yeuoly e852a21634
Feat/workflow phase2 (#4687) 2024-05-27 22:01:11 +08:00
Bowen Liang 04ad46dd31
chore: skip unnecessary key checks prior to accessing a dictionary (#4497) 2024-05-19 18:30:45 +08:00
takatost d8926a2571
feat: hide node detail outputs in webapp & installed app in explore (#3954) 2024-05-11 13:40:11 +08:00
takatost c2f0f958ef
fix: passing in 0 as a numeric variable will be converted to null (#4148) 2024-05-07 16:38:23 +08:00
takatost b82a2d97ef
fix: db connections not being released during workflow execution (#3971) 2024-04-29 12:42:09 +08:00
takatost ff67a6d338
feat: llm text stream support for workflow app (#3798)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-04-28 17:37:00 +08:00
takatost 34bfb715e1
fix: citations always appear in the chatflow app (#3844) 2024-04-25 18:31:38 +08:00
takatost 3da179f77b
feat: add conversation_id and user_id in chatflow/workflow system vars (#3771)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-04-24 17:20:01 +08:00
takatost 2ea8c73cd8
fix: type num of variable converted to str (#3758) 2024-04-24 15:07:56 +08:00
liuzhenghua e02ee3bb2e
fix event/stream ping (#3553) 2024-04-17 18:28:24 +08:00
takatost 5b447d61a6
feat: refactor tongyi models (#3496) 2024-04-15 22:28:32 +08:00
takatost 12f1ce4794
feat: optimize the efficiency of generating chatbot conversation name (#3472) 2024-04-14 23:50:24 +08:00
LIU HONGWEI c227f3d985
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416) 2024-04-12 16:22:24 +08:00
Yeuoly cea107b165
Refactor/react agent (#3355) 2024-04-11 18:34:17 +08:00
Jyong b6de97ad53
Remove langchain dataset retrival agent logic (#3311) 2024-04-10 20:37:22 +08:00
Yeuoly 14bb0b02ac
Feat/Agent-Image-Processing (#3293)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-04-10 14:48:40 +08:00
takatost 9720d6b7a5
fix: metadata in generate npe issue (#3166) 2024-04-08 21:30:03 +08:00
takatost 7753ba2d37
FEAT: NEW WORKFLOW ENGINE (#3160)
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: nite-knite <nkCoding@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2024-04-08 18:51:46 +08:00