Commit Graph

70 Commits

Author SHA1 Message Date
FFXN
b68289f24a fix: prevent source deletion failures caused by UUID and text type mismatch 2026-08-06 14:40:30 +08:00
FFXN
f1e79a7ad6 feat: implement logging for durable deletion failures with job details 2026-08-05 18:57:12 +08:00
Jyong
90e373199c fix(knowledge-fs): use structured document sections 2026-08-04 23:46:13 -04:00
Jyong
4fd80c8d59 Improve knowledge grep matching for document projections 2026-08-04 05:41:52 -04:00
Jyong
fcf87ec68c fix(knowledge-fs): read current published fs paths 2026-08-04 03:46:00 -04:00
Jyong
3d9feaba0b fix(knowledge-fs): classify capability reads from operations 2026-08-04 03:17:15 -04:00
Jyong
c944ffe558 fix(knowledge-fs): honor capability grants in fs handlers 2026-08-04 02:56:03 -04:00
Jyong
87d305da1d chore(knowledge-fs): refresh contract subtree lock 2026-08-04 00:26:36 -04:00
Jyong
505fe93d2c fix(knowledge-fs): update vulnerable transitive dependencies 2026-08-04 00:17:57 -04:00
Jyong
e65905b4b3 Enrich research task progress with stage details 2026-08-03 05:38:52 -04:00
Jyong
1648d8ac6b fix(knowledge-fs): handle initial revisions and published evidence 2026-08-02 14:47:09 -04:00
Jyong
4a7195be12 Bound Dify embedding requests and preserve result ordering 2026-08-02 13:28:31 -04:00
Jyong
923507baeb Stream research task answer deltas through durable progress events 2026-08-02 12:45:51 -04:00
Jyong
4d5f845b8c Merge codex/golden-question-bulk-import into deploy/konwledge
# Conflicts:
#	api/knowledge-fs-contract.lock.json
#	api/services/knowledge_fs/data_facade.py
#	api/tests/unit_tests/services/test_knowledge_fs_data_facade.py
#	knowledge-fs/scripts/export-capability-v2-operations.test.mjs
#	packages/contracts/generated/api/console/knowledge-fs/orpc.gen.ts
2026-08-02 11:35:09 -04:00
Jyong
c9cdc34abc feat(dataset): add golden question bulk import 2026-08-02 11:29:11 -04:00
Jyong
737f315b53 Merge deploy/konwledge into codex/knowledge-fs-difyctl 2026-08-02 11:24:06 -04:00
Stephen Zhou
74ec0c78b9
test(knowledge-fs): update capability export count 2026-07-31 17:09:21 +08:00
Stephen Zhou
abee50b90e
fix(dataset): align New RAG activity filters 2026-07-31 17:00:59 +08:00
Stephen Zhou
e891790ce0
fix(dataset): connect New RAG overview data 2026-07-31 16:23:50 +08:00
Jyong
ce847f2b6f feat(cli): add KnowledgeFS filesystem commands 2026-07-31 04:11:14 -04:00
Stephen Zhou
480deebf02
fix(knowledge-fs): harden research progress and scoring 2026-07-31 11:39:36 +08:00
Jyong
f1045bc099 Retry provider errors in document compilation runtime 2026-07-30 23:35:31 -04:00
Stephen Zhou
049208c095
fix(knowledge-fs): fence capability profile activation 2026-07-31 00:54:37 +08:00
Jyong
f39b15f76d Resume document compilation from persisted checkpoints 2026-07-30 12:03:59 -04:00
Stephen Zhou
3adb119dd3
test(knowledge-fs): update capability export count 2026-07-30 21:46:43 +08:00
Stephen Zhou
13778d96a0
fix(dataset): wire New RAG document actions 2026-07-30 21:37:05 +08:00
Stephen Zhou
bf5f916cd4
fix(knowledge-fs): improve semantic extraction resilience 2026-07-30 20:36:53 +08:00
Jyong
02e8867588 feat(knowledge-fs): add semantic LLM research retrieval 2026-07-30 07:35:31 -04:00
Jyong
0e06266770 Aggregate knowledge-space overview queries across all members 2026-07-30 05:20:20 -04:00
Jyong
4b53ad8b9d Route knowledge graph ingestion through space-scoped reasoning models 2026-07-30 04:54:09 -04:00
Jyong
a82290fe8f perf(knowledge-fs): reduce capability request overhead 2026-07-30 03:14:51 -04:00
Jyong
0ec4940c9a fix research result partial refresh 2026-07-30 02:49:10 -04:00
Jyong
79984e1c84 perf(knowledge-fs): eliminate graph and publication query hot spots
Fixes five scaling hot spots in the KnowledgeFS repository layer. All changes
preserve existing behavior and dual-dialect (Postgres/TiDB) parity; verified via
the full packages/api suite and by generating the emitted SQL for both dialects.

- Graph traversal (#2): restrict the relation_fanout CTE to relations whose
  subject is the start entity or one of its objects, so the ROW_NUMBER window no
  longer ranks every relation in the space. maxDepth is capped at 2, so the
  reachable-subject seed is a provable superset of the visited frontier; results
  are unchanged. Uses the existing graph_relations_subject_traversal_idx.
- Community materialization (#3): bound the per-entity traversal fan-out with a
  concurrency limiter instead of an unbounded Promise.all, preventing connection
  pool exhaustion. Identical queries and results.
- Profile-migration PageIndex promotion (#4): replace the up-to-100k per-row
  SELECT ... FOR UPDATE loop with one set-based UPDATE plus a NOT EXISTS
  completeness fence, keeping the safety bound and error code.
- Chunk snapshot publish (#5): batch the per-chunk INSERT loop into multi-row
  VALUES statements (<=1000 rows/batch, under the bind-parameter limit).
- Graph batch upsert read-back (#7): replace the per-row SELECT after each batch
  upsert with one indexed IN-list query per (space, generation) group, preserving
  the mismatch, duplicate, and did-not-persist fences.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-30 02:27:43 -04:00
Stephen Zhou
b66c7c9a52
Remove KnowledgeFS full-chain validation record 2026-07-30 14:23:25 +08:00
Jyong
e052b2e27f Support emoji icons and map Knowledge FS bad requests 2026-07-30 01:34:56 -04:00
Jyong
5869016c42 Restore Research answer synthesis routing 2026-07-29 13:32:01 -04:00
Jyong
e653935288 Normalize retrieval scores before fusion and ranking 2026-07-29 12:45:45 -04:00
Jyong
3a42945fcc Refresh retry base revision and preserve immutable candidates 2026-07-29 11:14:51 -04:00
Jyong
b8a2f991c1 Keep interactive retrieval evidence-only and isolate Research synthesis 2026-07-29 11:14:51 -04:00
Jyong
5c359b710a Normalize Unstructured layout and enable coordinates 2026-07-29 11:14:51 -04:00
Jyong
dd1d24e341 Preserve Dify route identity across upstream model aliases 2026-07-29 07:27:19 -04:00
Jyong
5270f78ff1 Merge remote-tracking branch 'origin/deploy/konwledge' into deploy/konwledge
# Conflicts:
#	api/knowledge-fs-contract.lock.json
2026-07-29 06:22:07 -04:00
Jyong
34f4e3b145 Update frontend components and application workflows 2026-07-29 06:18:05 -04:00
Stephen Zhou
5c311d3eef
feat(dataset): add New Knowledge overview 2026-07-29 17:20:40 +08:00
Jyong
333c50f663 Increase preflight reasoning output token limit 2026-07-29 04:10:35 -04:00
Jyong
5e7ea24340 fix(knowledge-fs): use declared startup probe table 2026-07-29 01:39:16 -04:00
Jyong
71d07d8770 fix(knowledge-fs): retry database startup recovery 2026-07-29 00:51:28 -04:00
Stephen Zhou
20a06fdb94
feat(dataset): add New RAG quality control 2026-07-29 10:49:52 +08:00
Stephen Zhou
3a7a5075de
feat(dataset): add New RAG retrieval test 2026-07-28 23:34:06 +08:00
Jyong
ff07021c22 feat(knowledge-fs): automate greenfield workspace cutover 2026-07-28 09:12:50 -04:00