Commit Graph

52 Commits

Author SHA1 Message Date
Jyong
8150a8fca7 feat(knowledge-fs): rate limit console writes and every service API route
The legacy dataset console rate limits every mutating, download, and
retrieval route and the dataset service API limits every request, while
KnowledgeFS only covered uploads and query admission. Apply the knowledge
rate limit to all space-scoped POST/PUT/PATCH/DELETE console routes, the
document downloads, and research/query entrypoints (workspace-level source
previews, staged-upload discards, the deprecated buffered query route, and
the internal stream transport stay exempt). Extract the service API check
into `check_knowledge_rate_limit` and call it from the KnowledgeFS profile
helper so all service routes share the legacy per-workspace limit.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015zw5G5SX3HmVfnZof6YWAc
2026-09-03 11:10:04 -04:00
Stephen Zhou
3611a93a3a
Merge remote-tracking branch 'origin/deploy/konwledge' into deploy/konwledge
# Conflicts:
#	api/tests/unit_tests/services/test_knowledge_fs_initial_source_reliability.py
2026-09-03 16:57:14 +08:00
FFXN
b55ec59d37 fix(knowledge-fs): handle source selection mismatch and improve error handling, make source selection replacement durable. 2026-09-02 12:56:37 +08:00
Jyong
4f3a2952d6 perf(knowledge-fs): harden cross-format document ingestion 2026-08-31 07:48:35 -04:00
FFXN
949549b9b1 feat(knowledge-fs): enhance source update payload with selection and sync policy validation 2026-08-30 23:58:27 +08:00
FFXN
52df787444 feat(knowledge-fs): support source config updates and deferred sync
- allow updating mutable source configuration fields
- enqueue sync after active business configuration changes
- pause scheduled sync while a source is disabled
- preserve and rebind sync policies across source version updates
- support website, online document, and online drive sources
2026-08-30 22:10:12 +08:00
Jyong
12adc39383 fix(knowledge-fs): preserve spreadsheet image placement 2026-08-27 03:01:57 -04:00
FFXN
18155535cf refactor(knowledge_fs): replace credential service with dataset API key authorization. Remove the API token feature at the space level for knowledgeFs. 2026-08-26 15:40:18 +08:00
Jyong
79b034d115 fix(knowledge-fs): reconcile completed source retries 2026-08-21 04:02:43 -04:00
FFXN
845ab7b000 Merge remote-tracking branch 'origin/deploy/konwledge' into deploy/konwledge 2026-08-20 10:35:35 +08:00
FFXN
96346219b3 feat(knowledge-fs): implement asynchronous source import and related payloads 2026-08-20 10:34:53 +08:00
Jyong
0391141936 feat(quality): show replay evidence details 2026-08-19 09:45:41 -04:00
Jyong
66e3ae951f feat(knowledge): add golden question evaluations 2026-08-19 05:54:05 -04:00
Jyong
5323b6e4fc Improve application workflows and user experience 2026-08-14 02:27:03 -04:00
FFXN
f746f180aa feat(knowledge-fs): implement KnowledgeFS space tag management API 2026-08-13 10:55:33 +08:00
Jyong
b3a7c7a3e0 feat(knowledge-fs): unify public error handling 2026-08-12 07:00:59 -04:00
Stephen Zhou
c1780e08ec
fix(knowledge-fs): align frontend list queries 2026-08-12 13:59:53 +08:00
Stephen Zhou
ba4f178e4b
fix(knowledge-fs): align document download contracts 2026-08-12 11:43:32 +08:00
Stephen Zhou
a201e133de
feat(knowledge-fs): support datasource-driven source previews 2026-08-12 08:33:52 +08:00
FFXN
4769070af0 Merge remote-tracking branch 'origin/deploy/konwledge' into deploy/konwledge
# Conflicts:
#	api/knowledge-fs-contract.lock.json
#	packages/contracts/generated/api/console/knowledge-fs/orpc.gen.ts
#	packages/contracts/generated/api/console/knowledge-fs/types.gen.ts
#	packages/contracts/generated/api/console/knowledge-fs/zod.gen.ts
2026-08-11 19:54:25 +08:00
FFXN
7f0efa20fa feat(knowledge-fs): add bulk logical document deletion support 2026-08-11 19:47:12 +08:00
Jyong
4ce6a36b12 Merge remote-tracking branch 'origin/deploy/konwledge' into deploy/konwledge
# Conflicts:
#	web/features/new-rag/__tests__/create-knowledge-page.spec.tsx
#	web/i18n/de-DE/dataset.json
#	web/i18n/nl-NL/dataset.json
2026-08-11 06:12:00 -04:00
Stephen Zhou
7ee9296bea
fix(knowledge-fs): wire document download actions 2026-08-11 17:28:20 +08:00
FFXN
0d4441e2cf feat(knowledge): support KnowledgeFS document downloads
- add single logical document download endpoint
- add batch ZIP download endpoint
- stream files from KnowledgeFS object storage
- validate batch size and deduplicate ZIP filenames
- add download service and facade unit tests
2026-08-11 16:29:23 +08:00
FFXN
703c4b5f83 Merge remote-tracking branch 'origin/deploy/konwledge' into deploy/konwledge 2026-08-11 10:50:55 +08:00
FFXN
26544610ff feat(knowledge_fs): add document availability management with bulk update support 2026-08-11 10:01:33 +08:00
Jyong
28fd666fa6 feat(knowledge): stage document uploads before admission 2026-08-10 10:58:17 -04:00
Stephen Zhou
e4e9271fbe
feat(knowledge-fs): create spaces with initial sources 2026-08-10 22:08:01 +08:00
Jyong
1ac8c9e434 feat(knowledge-fs): add durable metadata management 2026-08-10 02:55:09 -04:00
Jyong
78e9d41c83 feat(knowledge-fs): support image query retrieval 2026-08-09 09:45:43 -04:00
FFXN
cb49d83e9c feat(knowledge_fs): import selected Firecrawl pages during space creation
- include Firecrawl configuration and selected page URLs in space creation
- start a server-side crawl import after KnowledgeFS space provisioning
- require the second crawl to match the complete user selection
- keep the knowledge space valid when website content import fails
- reuse existing background task status and failure UI
- add KnowledgeFS crawl-import API and regression tests
2026-08-07 16:29:25 +08:00
Stephen Zhou
a4756e953d
feat(dataset): filter New RAG spaces by creator 2026-08-05 13:46:06 +08:00
Jyong
1648d8ac6b fix(knowledge-fs): handle initial revisions and published evidence 2026-08-02 14:47:09 -04:00
Jyong
4d5f845b8c Merge codex/golden-question-bulk-import into deploy/konwledge
# Conflicts:
#	api/knowledge-fs-contract.lock.json
#	api/services/knowledge_fs/data_facade.py
#	api/tests/unit_tests/services/test_knowledge_fs_data_facade.py
#	knowledge-fs/scripts/export-capability-v2-operations.test.mjs
#	packages/contracts/generated/api/console/knowledge-fs/orpc.gen.ts
2026-08-02 11:35:09 -04:00
Jyong
c9cdc34abc feat(dataset): add golden question bulk import 2026-08-02 11:29:11 -04:00
Stephen Zhou
abee50b90e
fix(dataset): align New RAG activity filters 2026-07-31 17:00:59 +08:00
Stephen Zhou
e891790ce0
fix(dataset): connect New RAG overview data 2026-07-31 16:23:50 +08:00
Stephen Zhou
13778d96a0
fix(dataset): wire New RAG document actions 2026-07-30 21:37:05 +08:00
Jyong
a82290fe8f perf(knowledge-fs): reduce capability request overhead 2026-07-30 03:14:51 -04:00
Jyong
e052b2e27f Support emoji icons and map Knowledge FS bad requests 2026-07-30 01:34:56 -04:00
Jyong
34f4e3b145 Update frontend components and application workflows 2026-07-29 06:18:05 -04:00
Jyong
71e9755d6c Scope knowledge rate limiting to entry points 2026-07-29 03:09:42 -04:00
Jyong
6cfd1abb59 Refactor frontend architecture and simplify implementation 2026-07-29 02:30:27 -04:00
Stephen Zhou
20a06fdb94
feat(dataset): add New RAG quality control 2026-07-29 10:49:52 +08:00
Stephen Zhou
3a7a5075de
feat(dataset): add New RAG retrieval test 2026-07-28 23:34:06 +08:00
Stephen Zhou
d2380dd951
feat(dataset): add New RAG knowledge settings 2026-07-28 20:56:00 +08:00
Stephen Zhou
ab0b2282ab
fix(dataset): complete New RAG connected source flows 2026-07-28 12:58:18 +08:00
Stephen Zhou
e5d4f37469
fix(dataset): restore New RAG document uploads 2026-07-27 21:46:16 +08:00
Stephen Zhou
3de75a3315
fix(dataset): stabilize New RAG KnowledgeFS flows 2026-07-27 16:18:51 +08:00
Stephen Zhou
1cde846bcf
fix(dataset): integrate New RAG with KnowledgeFS (#39621) 2026-07-27 12:52:44 +08:00