Commit Graph

70 Commits

Author SHA1 Message Date
Jyong
b79b8a879b feat(knowledge-fs): record and count every knowledge space query
Workflow KnowledgeFS retrieval nodes ran through `retrieval-tests`, which
never wrote an AnswerTrace or an overview event, so their queries were
missing from the retrieval history and from the space overview; the history
also only ever showed each member their own traces.

- AnswerTrace gains a `source` (retrieval_test | workflow | service_api |
  agent | mcp; migration 0051_answer_trace_source) derived from the
  Capability v2 caller kind. The retrieval-tests route records one trace per
  run (stages, evidence bundle, profile metadata), returns its id as
  `answerTraceId`, and the workflow node's failed-retrieval capture attaches
  to that trace instead of creating a second record.
- The quality trace list exposes and filters by `source`; traces from other
  caller kinds are visible to any current reader of the space, and counts and
  scores fall back to the evidence embedded in the trace when no bundle row
  exists.
- Overview accounting: retrieval-tests and Research tasks now emit
  `query.requested`, and the Research job state machine emits
  `query.completed` / `query.failed` on terminal stages (wired for both the
  in-process gateway and the durable runtime), so query volume, answer rate
  and outcomes include every caller. Activity details keep `source` and
  `taskKind`.
- Console and service trace routes accept a `source` filter; the retrieval
  test page shows a source badge and an all / retrieval tests / workflow
  filter, with translations for every locale.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015zw5G5SX3HmVfnZof6YWAc
2026-09-04 05:48:17 -04:00
FFXN
0eb5bb700a feat(knowledge-fs): fix CI. 2026-09-04 16:13:13 +08:00
FFXN
ad059f55d4 feat(knowledge-fs): add namespace preview for initial website sources
- create website preview jobs before a knowledge space exists
- persist crawled page content in KnowledgeFS object storage
- import selected pages using preview job and page IDs
- validate preview ownership, expiry, and configuration fingerprint
- clean up preview content after cancellation, expiry, or consumption
- add namespace preview routes, capabilities, migrations, and contracts
- keep online document and drive flows unchanged
2026-09-04 15:52:36 +08:00
Stephen Zhou
6570e907a4
style(knowledge-fs): format migration assertion 2026-09-04 12:33:02 +08:00
Stephen Zhou
60a9bddbf1
test(knowledge-fs): track API migration operations 2026-09-04 12:22:03 +08:00
FFXN
644a9b96a6 fix(knowledge-fs): harden semantic chunking and deletion cleanup
- retry semantic chunking when the LLM returns an invalid schema
- add corrective schema instructions to retry prompts
- remove capability grant foreign keys from durable deletion records
- preserve capability grant IDs as immutable audit provenance
- add migration and regression coverage
2026-09-03 16:59:57 +08:00
FFXN
6d9d388c73 fix(knowledge-fs): enhance website crawl handling with support for exact page fetching 2026-09-03 16:19:47 +08:00
Stephen Zhou
523844a774
test(knowledge-fs): align migration entrypoint baseline 2026-09-02 21:48:58 +08:00
Stephen Zhou
2f8dd177d3
fix(knowledge-fs): stabilize research result streaming 2026-09-02 20:10:24 +08:00
Jyong
222d09f474 feat(knowledge-fs): add profile-driven multimodal retrieval 2026-09-02 01:01:57 -04:00
Jyong
2ad192fce7 fix(knowledge-fs): harden research retrieval execution 2026-09-01 13:26:43 -04:00
Jyong
7876f6e670 fix(knowledge-fs): scope child deletion conflicts 2026-09-01 05:18:38 -04:00
Jyong
4f3a2952d6 perf(knowledge-fs): harden cross-format document ingestion 2026-08-31 07:48:35 -04:00
Stephen Zhou
d0b33b2c06
fix(knowledge-fs): extend unstructured document timeout 2026-08-31 12:49:34 +08:00
Stephen Zhou
e578e55e7b
fix(knowledge-fs): harden long document ingestion 2026-08-30 23:45:22 +08:00
Stephen Zhou
138e810f9c
fix(knowledge-fs): improve Chinese PDF ingestion and retrieval 2026-08-30 22:00:34 +08:00
FFXN
c81cf7e17b fix(knowledge-fs): add rebase functionality for publication head revision and enhance error handling 2026-08-28 15:52:43 +08:00
FFXN
1212b92bf1 fix(knowledge-fs): remove provider mode from sync policies and update related constraints 2026-08-28 15:08:11 +08:00
Jyong
42b1be58f3 fix(knowledge-fs): repair document deletion task progress 2026-08-27 04:35:05 -04:00
Jyong
77a5de2fc9 fix(knowledge-fs): persist document images across formats 2026-08-26 03:58:04 -04:00
Stephen Zhou
d5fd45bb41
feat(knowledge_fs): expand supported document upload formats 2026-08-25 19:58:15 +08:00
Jyong
573637b89e fix(knowledge): bound research judge to one 8k call 2026-08-19 13:46:11 -04:00
Stephen Zhou
a8ff128ca4
test(knowledge-fs): account for quality replay migration 2026-08-19 18:09:21 +08:00
Jyong
40cfea870b fix(knowledge-fs): correct research timing and judge budget 2026-08-19 02:08:52 -04:00
Jyong
0d39b59875 fix(knowledge-fs): recover truncated research reasoning 2026-08-19 00:11:16 -04:00
Jyong
719579e330 fix(knowledge-fs): speed up semantic import and research 2026-08-18 15:15:42 -04:00
Jyong
aa87073bb5 refactor(knowledge-fs): redesign research evidence retrieval 2026-08-18 14:20:03 -04:00
Jyong
f8a2d530d6 feat(knowledge-fs): harden PDF image materialization 2026-08-18 03:03:18 -04:00
Jyong
627c80b09a feat(knowledge-fs): optimize document ingestion pipeline 2026-08-17 02:40:21 -04:00
Jyong
f0743d993a fix(knowledge-fs): package sharp native runtime 2026-08-17 00:55:58 -04:00
Jyong
ffd2a7094d restore semantic document compilation pipeline 2026-08-13 13:10:39 -04:00
Jyong
e25bf1776c test(knowledge-fs): sync migration runner expectations 2026-08-12 13:41:30 -04:00
Jyong
d064bf036c feat: capture workflow retrieval misses 2026-08-12 13:31:02 -04:00
Jyong
2de9456047 test(knowledge-fs): complete mandatory rerank coverage 2026-08-12 07:13:12 -04:00
Stephen Zhou
9bea201d81
fix(knowledge-fs): align API tests with rerank gate 2026-08-12 19:09:09 +08:00
Jyong
79e66cb7f1 fix(knowledge-fs): avoid self-fencing direct uploads 2026-08-12 03:16:56 -04:00
Stephen Zhou
a201e133de
feat(knowledge-fs): support datasource-driven source previews 2026-08-12 08:33:52 +08:00
Stephen Zhou
668b122632
style(knowledge-fs): format availability changes 2026-08-11 11:26:36 +08:00
Stephen Zhou
d9e25e40f6
fix(knowledge-fs): sync api migration expectations 2026-08-11 11:12:31 +08:00
FFXN
26544610ff feat(knowledge_fs): add document availability management with bulk update support 2026-08-11 10:01:33 +08:00
Stephen Zhou
64cc650e78
fix(knowledge-fs): sync metadata test contracts 2026-08-10 15:17:35 +08:00
Jyong
1ac8c9e434 feat(knowledge-fs): add durable metadata management 2026-08-10 02:55:09 -04:00
Jyong
1d990de7e7 Refactor application components and update related functionality 2026-08-09 12:19:56 -04:00
Jyong
78e9d41c83 feat(knowledge-fs): support image query retrieval 2026-08-09 09:45:43 -04:00
FFXN
b70136f46e fix(knowledge_fs): enhance online-document connector to aggregate Dify content variable messages and support streaming 2026-08-08 20:38:29 +08:00
FFXN
42aecd649c fix(knowledge_fs): add diagnostics for empty content and frame metadata logging 2026-08-08 20:15:21 +08:00
FFXN
3b6f011c6c fix(knowledge_fs): update online-document connector to concatenate Dify text messages and support structured content envelopes 2026-08-08 19:38:12 +08:00
Stephen Zhou
b88a8933ed
fix(knowledge-fs): allow zero-revision logical document deletion 2026-08-06 18:49:11 +08:00
Jyong
13ddabf832 Update application functionality and related components 2026-08-06 06:10:09 -04:00
FFXN
f1e79a7ad6 feat: implement logging for durable deletion failures with job details 2026-08-05 18:57:12 +08:00