dify/api
Yansong Zhang 0c7e7e0c4e feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6)
Port the complete infrastructure for agent sandbox execution and skill system:

Sandbox & Virtual Environment (core/sandbox/, core/virtual_environment/):
- Sandbox entity with lifecycle management (ready/failed/cancelled states)
- SandboxBuilder with fluent API for configuring providers
- 5 VM providers: Local, SSH, Docker, E2B, AWS CodeInterpreter
- VirtualEnvironment base with command execution, file transfer, transport layers
- Channel transport: pipe, queue, socket implementations
- Bash session management and DifyCli binary integration
- Storage: archive storage, file storage, noop storage, presign storage
- Initializers: DifyCli, AppAssets, DraftAppAssets, Skills
- Inspector: file browser, archive/runtime source, script utils
- Security: encryption utils, debug helpers

Skill & App Assets (core/skill/, core/app_assets/, core/app_bundle/):
- Skill entity and manager
- App asset accessor, builder pipeline (file, skill builders)
- App bundle source zip extractor
- Storage and converter utilities

API Endpoints:
- CLI API blueprint (controllers/cli_api/) for sandbox callback
- Sandbox provider management (workspace/sandbox_providers)
- Sandbox file browser (console/sandbox_files)
- App asset management (console/app/app_asset)
- Skill management (console/app/skills)
- Storage file endpoints (controllers/files/storage_files)

Services:
- Sandbox service, provider service, file service
- App asset service, app bundle service

Config:
- CliApiConfig, CreatorsPlatformConfig, CollaborationConfig
- FILES_API_URL for sandbox file access

Note: Controller route registration temporarily commented out (marked TODO)
pending resolution of deep dependency chains (socketio, workflow_comment,
command node, etc.). Core sandbox modules are fully ported and syntax-validated.
110 files changed, 10,549 insertions.

Made-with: Cursor
2026-04-08 17:39:02 +08:00
..
.idea
.vscode chore(api): update launch.json.example to include new workflow_based_app_execution. (#32184) 2026-02-10 17:08:43 +08:00
commands refactor(api): type orphaned draft variable stats with TypedDict (#34590) 2026-04-06 11:30:53 +00:00
configs feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6) 2026-04-08 17:39:02 +08:00
constants feat(api): add Agent V2 node and new Agent app type (Phase 1-3) 2026-04-08 12:31:23 +08:00
context chore(api): align Python support with 3.12 (#34419) 2026-04-02 05:07:32 +00:00
contexts chore(api): align Python support with 3.12 (#34419) 2026-04-02 05:07:32 +00:00
controllers feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6) 2026-04-08 17:39:02 +08:00
core feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6) 2026-04-08 17:39:02 +08:00
docker feat(tasks): isolate summary generation to dedicated dataset_summary queue (#32972) 2026-03-06 14:35:28 +08:00
enterprise fix: upgrade langfuse SDK to v3+ for LLM-as-judge support (#34265) 2026-03-30 13:06:55 +00:00
enums feat: add trial model list in system features (#31313) 2026-01-26 11:52:05 +08:00
events refactor: use sessionmaker in controllers, events, models, and tasks 1 (#34693) 2026-04-07 23:47:20 +00:00
extensions feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6) 2026-04-08 17:39:02 +08:00
factories refactor(api): use standalone graphon package (#34209) 2026-03-27 21:05:32 +00:00
fields refactor(api): Extract shared ResponseModel (#34633) 2026-04-07 13:05:38 +00:00
libs feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6) 2026-04-08 17:39:02 +08:00
migrations chore: change draft var to user scoped (#33066) 2026-03-16 14:04:41 +08:00
models feat(api): add Agent V2 node and new Agent app type (Phase 1-3) 2026-04-08 12:31:23 +08:00
repositories refactor(api): type workflow run delete/count results with RunsWithRelatedCountsDict TypedDict (#34531) 2026-04-05 16:11:41 +00:00
schedule refactor: use EnumText for TidbAuthBinding.status and MessageFile.type (#33975) 2026-03-24 05:38:29 +09:00
services feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6) 2026-04-08 17:39:02 +08:00
tasks fix(api): resolve Agent V2 node E2E runtime issues 2026-04-08 16:21:12 +08:00
templates refactor: make url in email template more better (#31166) 2026-01-19 14:28:41 +08:00
tests feat(api): enable Agent mode in workflow/service APIs and add default config (Phase 7) 2026-04-08 12:41:37 +08:00
.dockerignore Enhance Code Consistency Across Repository with .editorconfig (#19023) 2025-04-29 18:04:33 +08:00
.env.example fix: Fix docker-compose.yaml's ENV variables (#31101) 2026-03-28 15:37:51 +00:00
.importlinter refactor(api): use standalone graphon package (#34209) 2026-03-27 21:05:32 +00:00
.ruff.toml refactor(api): replace test fixture side-effect imports (#34421) 2026-04-02 04:55:15 +00:00
AGENTS.md refactor(api): tighten phase 1 shared type contracts (#33453) 2026-03-17 17:50:51 +08:00
app_factory.py feat: enterprise otel exporter (#33138) 2026-03-27 07:56:31 +00:00
app.py chore(typing): reduce ty excludes for A1 (#31721) 2026-01-30 02:38:57 +08:00
celery_entrypoint.py chore(api): adjust monkey patching in gunicorn.conf.py (#26056) 2025-09-22 18:23:01 +08:00
celery_healthcheck.py fix: lighten the health checks for the Worker and Worker Beat services, and disable them by default (#34572) 2026-04-06 02:26:26 +00:00
cnt_base.sh add cnt script and one more example (#28272) 2025-11-18 16:44:14 +09:00
dify_app.py refactor(api): tighten login and wrapper typing (#34447) 2026-04-02 09:36:58 +00:00
Dockerfile ci: Simplify nltk data download in Dockerfile (#33495) 2026-03-16 12:06:20 +09:00
gunicorn.conf.py docs(api): update docs about gevent setup in app.py (#27611) 2025-10-30 15:43:08 +08:00
pyproject.toml chore(deps-dev): bump the dev group in /api with 6 updates (#34579) 2026-04-06 11:49:54 +00:00
pyrefly-local-excludes.txt refactor(api): use standalone graphon package (#34209) 2026-03-27 21:05:32 +00:00
pyrightconfig.json chore(api): align Python support with 3.12 (#34419) 2026-04-02 05:07:32 +00:00
pytest.ini chore: add pytest XML and branch coverage reports (#33730) 2026-03-19 17:08:34 +08:00
README.md refactor: introduce pnpm workspace (#34241) 2026-03-30 10:34:50 +00:00
uv.lock chore(deps-dev): bump the dev group across 1 directory with 20 updates (#34601) 2026-04-06 13:24:31 +00:00

Dify Backend API

Setup and Run

Important

In the v1.3.0 release, poetry has been replaced with uv as the package manager for Dify API backend service.

uv and pnpm are required to run the setup and development commands below.

The scripts resolve paths relative to their location, so you can run them from anywhere.

  1. Run setup (copies env files and installs dependencies).

    ./dev/setup
    
  2. Review api/.env, web/.env.local, and docker/middleware.env values (see the SECRET_KEY note below).

  3. Start middleware (PostgreSQL/Redis/Weaviate).

    ./dev/start-docker-compose
    
  4. Start backend (runs migrations first).

    ./dev/start-api
    
  5. Start Dify web service.

    ./dev/start-web
    

    ./dev/setup and ./dev/start-web install JavaScript dependencies through the repository root workspace, so you do not need a separate cd web && pnpm install step.

  6. Set up your application by visiting http://localhost:3000.

  7. Start the worker service (async and scheduler tasks, runs from api).

    ./dev/start-worker
    
  8. Optional: start Celery Beat (scheduled tasks).

    ./dev/start-beat
    

Environment notes

Important

When the frontend and backend run on different subdomains, set COOKIE_DOMAIN to the sites top-level domain (e.g., example.com). The frontend and backend must be under the same top-level domain in order to share authentication cookies.

  • Generate a SECRET_KEY in the .env file.

    bash for Linux

    sed -i "/^SECRET_KEY=/c\\SECRET_KEY=$(openssl rand -base64 42)" .env
    

    bash for Mac

    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    

Testing

  1. Install dependencies for both the backend and the test environment

    cd api
    uv sync --group dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml, more can check Claude.md

    cd api
    uv run pytest                           # Run all tests
    uv run pytest tests/unit_tests/         # Unit tests only
    uv run pytest tests/integration_tests/  # Integration tests
    
    # Code quality
    ./dev/reformat               # Run all formatters and linters
    uv run ruff check --fix ./   # Fix linting issues
    uv run ruff format ./        # Format code
    uv run basedpyright .        # Type checking