dify/api/controllers/console
-LAN- 559ab46ee1
fix: Removes redundant token calculations and updates dependencies
Eliminates unnecessary pre-calculation of token limits and recalculation of max tokens
across multiple app runners, simplifying the logic for prompt handling.

Updates tiktoken library from version 0.8.0 to 0.9.0 for improved tokenization performance.

Increases default token limit in TokenBufferMemory to accommodate larger prompt messages.

These changes streamline the token management process and leverage the latest
improvements in the tiktoken library.

Fixes potential token overflow issues and prepares the system for handling larger
inputs more efficiently.

Relates to internal optimization tasks.

Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-28 15:39:12 +08:00
..
app fix: add type hints for App model and improve error handling in audio services (#12677) 2025-01-13 15:55:16 +08:00
auth fix: Removes redundant token calculations and updates dependencies 2025-04-28 15:39:12 +08:00
billing feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
datasets chore: fix wrong VectorType match case (#13123) 2025-02-02 15:26:59 +08:00
explore feat: switch to chat messages before regenerated (#11301) 2025-01-31 13:05:10 +08:00
tag feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
workspace feat: account delete (#11829) 2024-12-30 11:33:42 +08:00
__init__.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
admin.py chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 2025-01-21 10:12:29 +08:00
apikey.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
error.py feat: account delete (#11829) 2024-12-30 11:33:42 +08:00
extension.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
feature.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
files.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
init_validate.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
ping.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
remote_files.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
setup.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
version.py feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
wraps.py fix: Removes redundant token calculations and updates dependencies 2025-04-28 15:39:12 +08:00