SurfSense/plugins/remote/proprietary/scraping/tests/__init__.py
Anish Sarkar d89f251a0a feat(plugins): run SurfSense's Reddit scraper as its own plugin on the plugin host
proprietary/reddit/ is the backend's anonymous Reddit scraper behind one MCP
tool, scrape, at /reddit/mcp, licensed with LicenseAccess(): a summary as
text, the items as structured content, and progress after each item. A run
whose every target Reddit refused is now that refusal, not an empty result.
proprietary/scraping/ holds what the scraper plugins share, the proxy
providers and the browser loop, reading SCRAPING_* settings. The backend's
Reddit and proxy tests came with them; Keygen reads its address when made,
so a test can point a plugin at a stand-in.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 00:48:27 +05:30

0 lines
Python