dify/api/controllers
-LAN- 559ab46ee1
fix: Removes redundant token calculations and updates dependencies
Eliminates unnecessary pre-calculation of token limits and recalculation of max tokens
across multiple app runners, simplifying the logic for prompt handling.

Updates tiktoken library from version 0.8.0 to 0.9.0 for improved tokenization performance.

Increases default token limit in TokenBufferMemory to accommodate larger prompt messages.

These changes streamline the token management process and leverage the latest
improvements in the tiktoken library.

Fixes potential token overflow issues and prepares the system for handling larger
inputs more efficiently.

Relates to internal optimization tasks.

Signed-off-by: -LAN- <laipz8200@outlook.com>
2025-04-28 15:39:12 +08:00
..
common fix: not install libmagic raise error (#13146) 2025-02-03 11:05:20 +08:00
console fix: Removes redundant token calculations and updates dependencies 2025-04-28 15:39:12 +08:00
files feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
inner_api feat: add inner API to create workspace without requiring email (#13021) 2025-01-26 15:36:56 +08:00
service_api fix: set indexing technique from dataset during update-by-text (#13155) 2025-02-03 11:06:03 +08:00
web feat: switch to chat messages before regenerated (#11301) 2025-01-31 13:05:10 +08:00
__init__.py chore(api/controllers): Apply Ruff Formatter. (#7645) 2024-08-26 15:29:10 +08:00