Commit graph

8202 commits

Author SHA1 Message Date
Rohan Verma
08d431454f
Merge pull request #1617 from CREDO23/feature-okf
Some checks are pending
Build and Push Docker Images / finalize_release (push) Blocked by required conditions
Build and Push Docker Images / compute_version (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, cpu, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, , production, false, cpu) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, cpu, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, , production, false, cpu) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, cu126, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, -cuda126, production, true, cuda126) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, cu126, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, -cuda126, production, true, cuda126) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, cu128, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, -cuda, production, true, cuda) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, cu128, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, -cuda, production, true, cuda) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, cpu, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64, , runner, false, cpu) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, cpu, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64, , runner, false, cpu) (push) Blocked by required conditions
Build and Push Docker Images / verify_digests (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend, , cpu) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend, -cuda, cuda) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend, -cuda126, cuda126) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web, , cpu) (push) Blocked by required conditions
[Feat] Serve the knowledge base in Open Knowledge Format (OKF)
2026-07-21 15:39:59 -07:00
Rohan Verma
66bf06429e
Merge pull request #1614 from CREDO23/feature-walmart-scraper
[Feat] Walmart scraper: product + reviews across API, chat, and MCP
2026-07-21 15:39:33 -07:00
Anish Sarkar
df98144a24 refactor: remove downloading functionality from EditorPanelContent for cleaner code 2026-07-22 01:55:27 +05:30
Anish Sarkar
7ecf01f308 refactor: remove onPaste handler from InlineMentionEditor for cleaner code 2026-07-22 01:38:53 +05:30
Anish Sarkar
19a9a84b45 fix: increase maximum workspaces per user limit from 100 to 400 2026-07-22 00:37:52 +05:30
Anish Sarkar
9fd5d3571c Merge remote-tracking branch 'upstream/dev' into fix/tabs 2026-07-22 00:02:26 +05:30
CREDO23
5f1cc7a634 test: MCP get_document forwards Accept header 2026-07-21 19:59:01 +02:00
CREDO23
9a18392484 test: tidy concept-identity roundtrip docstring 2026-07-21 19:59:01 +02:00
CREDO23
c99a8154c0 test: content-negotiated OKF read over HTTP 2026-07-21 19:59:01 +02:00
CREDO23
826910f50d test: OKF path-identity roundtrip 2026-07-21 19:59:01 +02:00
CREDO23
ea20f0042d test: OKF export bundle is conformant 2026-07-21 19:59:01 +02:00
CREDO23
bdc03670a5 test: OKF bundle conformance audit 2026-07-21 19:59:01 +02:00
CREDO23
5d2f9f1ca8 test: connector document is OKF concept 2026-07-21 19:59:01 +02:00
CREDO23
863d9a2248 test: per-type OKF conformance 2026-07-21 19:59:00 +02:00
CREDO23
7c53909b49 test: OKF serializer self-checks 2026-07-21 19:59:00 +02:00
CREDO23
a01b292886 request OKF concept via content negotiation 2026-07-21 19:58:53 +02:00
CREDO23
edf38edc3f support per-request headers 2026-07-21 19:58:52 +02:00
CREDO23
3cf315880d export full OKF bundle with index and log 2026-07-21 19:58:52 +02:00
CREDO23
6a72051e06 content-negotiate OKF on GET document 2026-07-21 19:58:52 +02:00
CREDO23
3401b0ae0e add OKF package api 2026-07-21 19:58:52 +02:00
CREDO23
f448100888 add OKF conformance validator 2026-07-21 19:58:52 +02:00
CREDO23
d694bcd191 add OKF serializer 2026-07-21 19:58:52 +02:00
CREDO23
444839b0ec add OKF type mapping 2026-07-21 19:58:52 +02:00
CREDO23
ca317c4686 Merge remote-tracking branch 'upstream/dev' into feature-walmart-scraper
# Conflicts:
#	docker/.env.example
#	surfsense_backend/app/capabilities/core/billing.py
#	surfsense_backend/app/capabilities/core/types.py
#	surfsense_backend/app/config/__init__.py
#	surfsense_mcp/mcp_server/features/scrapers/__init__.py
#	surfsense_web/content/docs/connectors/index.mdx
#	surfsense_web/content/docs/connectors/native/index.mdx
#	surfsense_web/content/docs/how-to/mcp-server.mdx
2026-07-21 02:42:41 +02:00
Rohan Verma
2eed9b2ac8
Merge pull request #1613 from Sanjays2402/fix/nonblocking-audio-write
Some checks failed
Build and Push Docker Images / compute_version (push) Has been cancelled
Build and Push Docker Images / finalize_release (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cpu, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, , production, false, cpu) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cpu, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, , production, false, cpu) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu126, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, -cuda126, production, true, cuda126) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu126, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, -cuda126, production, true, cuda126) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu128, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, -cuda, production, true, cuda) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu128, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, -cuda, production, true, cuda) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, cpu, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64, , runner, false, cpu) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, cpu, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64, , runner, false, cpu) (push) Has been cancelled
Build and Push Docker Images / verify_digests (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend, , cpu) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend, -cuda, cuda) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend, -cuda126, cuda126) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web, , cpu) (push) Has been cancelled
fix: avoid blocking audio writes
2026-07-19 16:17:05 -07:00
Rohan Verma
351696bd2c
Merge pull request #1605 from CREDO23/feature-indeed-jobs-scraper
[Feat] Add Indeed jobs scraper
2026-07-19 16:16:50 -07:00
CREDO23
f6970b90e8 fix(walmart): parse category breadcrumb path into breadCrumbs and category 2026-07-19 09:10:03 +02:00
CREDO23
bfde1b8741 feat(walmart): list walmart across marketing surfaces and example prompts 2026-07-19 09:01:18 +02:00
CREDO23
6c98bd33a8 docs(walmart): add connector docs and list in indexes 2026-07-19 09:01:11 +02:00
CREDO23
2a512e0015 feat(walmart): add connector marketing page 2026-07-19 09:01:11 +02:00
CREDO23
1c50a33647 feat(walmart): add playground catalog entry and icon 2026-07-19 09:01:04 +02:00
CREDO23
07721bda40 test(walmart): cover capability registry, schemas, and executors for both verbs 2026-07-19 08:49:10 +02:00
CREDO23
b5cddcfb2b docs(walmart): document billing rates in env examples 2026-07-19 08:49:10 +02:00
CREDO23
d7c30cac2f refactor(walmart): align reviews executor docstring 2026-07-19 08:45:27 +02:00
CREDO23
56e8fa13e6 feat(walmart): route product-review questions to marketplace specialists 2026-07-19 08:45:27 +02:00
CREDO23
cabc5b5c86 feat(walmart): register subagent in roster and connector map 2026-07-19 08:45:27 +02:00
CREDO23
f6a8a2a566 feat(walmart): add chat subagent with scrape and reviews tools 2026-07-19 08:45:27 +02:00
CREDO23
7b5e09c528 test(walmart): add parser and flow tests with e2e harness 2026-07-19 08:19:22 +02:00
CREDO23
a3f8a7e741 feat(walmart): register routes and MCP tools 2026-07-19 08:19:22 +02:00
CREDO23
9b9091ae97 feat(walmart): add scrape and reviews capabilities 2026-07-19 08:19:22 +02:00
CREDO23
d446aa32ec feat(walmart): add scrape and review orchestration 2026-07-19 08:19:22 +02:00
CREDO23
661bb8c187 feat(walmart): add JSON parsers 2026-07-19 08:19:22 +02:00
CREDO23
34b6885ba2 feat(walmart): add fetch with proxy rotation and block detection 2026-07-19 08:19:21 +02:00
CREDO23
dd3dba66af feat(walmart): add __NEXT_DATA__ extraction 2026-07-19 08:19:21 +02:00
CREDO23
be1fd0491f feat(walmart): add url resolver 2026-07-19 08:19:21 +02:00
CREDO23
a72cc3436c feat(walmart): add product and review schemas 2026-07-19 08:19:21 +02:00
CREDO23
0d2c8df5bd feat(walmart): add billing units and rate config 2026-07-19 08:19:21 +02:00
Sanjay Santhanam
5cc05d90f0 fix: avoid blocking audio writes
TTS responses were written synchronously from the async presentation pipeline, blocking concurrent requests. Offload byte writes to a worker thread and add a regression test that keeps the event loop responsive.
2026-07-18 17:46:31 -07:00
CREDO23
91aa265afb Merge remote-tracking branch 'upstream/dev' into feature-indeed-jobs-scraper
# Conflicts:
#	README.es.md
#	README.hi.md
#	README.md
#	README.pt-BR.md
#	README.zh-CN.md
#	surfsense_backend/tests/unit/capabilities/google_maps/test_registry.py
#	surfsense_backend/tests/unit/capabilities/reddit/test_registry.py
#	surfsense_backend/tests/unit/capabilities/youtube/test_registry.py
#	surfsense_mcp/mcp_server/features/scrapers/__init__.py
#	surfsense_web/content/docs/connectors/index.mdx
#	surfsense_web/content/docs/connectors/native/index.mdx
#	surfsense_web/content/docs/connectors/native/meta.json
#	surfsense_web/content/docs/how-to/mcp-server.mdx
#	surfsense_web/lib/connectors-marketing/index.ts
#	surfsense_web/lib/playground/catalog.ts
2026-07-18 22:11:30 +02:00
Rohan Verma
bea603e225
Merge pull request #1612 from MODSetter/dev
Some checks failed
Build and Push Docker Images / compute_version (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cpu, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, , production, false, cpu) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cpu, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, , production, false, cpu) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu126, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, -cuda126, production, true, cuda126) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu126, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, -cuda126, production, true, cuda126) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu128, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64, -cuda, production, true, cuda) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, cu128, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64, -cuda, production, true, cuda) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, cpu, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64, , runner, false, cpu) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, cpu, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64, , runner, false, cpu) (push) Has been cancelled
Build and Push Docker Images / verify_digests (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend, , cpu) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend, -cuda, cuda) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend, -cuda126, cuda126) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web, , cpu) (push) Has been cancelled
Build and Push Docker Images / finalize_release (push) Has been cancelled
feat: updated homepage
2026-07-17 23:17:45 -07:00