dify/api
QuantumGhost 10b738a296
feat: Persist Variables for Enhanced Debugging Workflow (#20699)
This pull request introduces a feature aimed at improving the debugging experience during workflow editing. With the addition of variable persistence, the system will automatically retain the output variables from previously executed nodes. These persisted variables can then be reused when debugging subsequent nodes, eliminating the need for repetitive manual input.

By streamlining this aspect of the workflow, the feature minimizes user errors and significantly reduces debugging effort, offering a smoother and more efficient experience.

Key highlights of this change:

- Automatic persistence of output variables for executed nodes.
- Reuse of persisted variables to simplify input steps for nodes requiring them (e.g., `code`, `template`, `variable_assigner`).
- Enhanced debugging experience with reduced friction.

Closes #19735.
2025-06-24 09:05:29 +08:00
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 2024-08-26 15:14:05 +08:00
.vscode feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
configs Feat/support sendgrid (#21011) 2025-06-19 10:27:38 +08:00
constants feat(api): Add image multimodal support for LLMNode (#17372) 2025-04-30 17:28:02 +08:00
contexts fix: Copy request context and current user in app generators. (#20240) 2025-05-27 10:56:23 +08:00
controllers feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
core feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
docker add MAX_TASK_PRE_CHILD for celery (#18985) 2025-04-28 17:06:00 +08:00
events Remove dead code (#17899) 2025-04-11 20:33:52 +08:00
extensions Feat/support sendgrid (#21011) 2025-06-19 10:27:38 +08:00
factories feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
fields fix(workflow_run): sequence_number race. (#21228) 2025-06-19 17:53:49 +08:00
libs feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
migrations fix(workflow_run): sequence_number race. (#21228) 2025-06-19 17:53:49 +08:00
models feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
schedule Feat/queue monitor (#20647) 2025-06-04 19:56:34 +08:00
services feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
tasks document indexing not bound to a Session (#21015) 2025-06-14 17:44:35 +02:00
templates Feat/queue monitor (#20647) 2025-06-04 19:56:34 +08:00
tests feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
.dockerignore Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 2025-04-29 18:04:33 +08:00
.env.example Feat/support sendgrid (#21011) 2025-06-19 10:27:38 +08:00
.ruff.toml feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
Dockerfile chore: bump uv to 0.7.x (#20692) 2025-06-06 09:09:31 +08:00
README.md chore: required pip and performance improvment in mypy checks (#19225) 2025-05-06 09:16:43 +08:00
app.py chore: avoid repeated type ignore noqa by adding flask_restful and flask_login in mypy import exclusions (#19224) 2025-05-06 11:58:49 +08:00
app_factory.py feat: add debug log for request and response (#19781) (#19783) 2025-05-17 17:31:09 +08:00
commands.py feat: add support for Matrixone database (#20714) 2025-06-19 10:20:12 +08:00
dify_app.py refactor: assembling the app features in modular way (#9129) 2024-11-30 23:05:22 +08:00
mypy.ini Feat/support sendgrid (#21011) 2025-06-19 10:27:38 +08:00
pyproject.toml feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00
pytest.ini Refactor/remove db from cycle manager (#20455) 2025-05-30 04:34:13 +08:00
uv.lock feat: Persist Variables for Enhanced Debugging Workflow (#20699) 2025-06-24 09:05:29 +08:00

README.md

Dify Backend API

Usage

[!IMPORTANT]

In the v1.3.0 release, poetry has been replaced with uv as the package manager for Dify API backend service.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    cp middleware.env.example middleware.env
    # change the profile to other vector database if you are not using weaviate
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

    cp .env.example .env 
    
  3. Generate a SECRET_KEY in the .env file.

    bash for Linux

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    

    bash for Mac

    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    
  4. Create environment.

    Dify API service uses UV to manage dependencies. First, you need to add the uv package manager, if you don't have it already.

    pip install uv
    # Or on macOS
    brew install uv
    
  5. Install dependencies

    uv sync --dev
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    uv run flask db upgrade
    
  7. Start backend

    uv run flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000.

  10. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.

uv run celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment

    uv sync --dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    uv run -P api bash dev/pytest/pytest_all_tests.sh