vrr/SurfSense
2
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2025-09-12 23:29:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat(youtube): integrate YouTube video processing connector

Browse source 
- Added support for processing YouTube videos, including transcript extraction and document creation.
- Implemented a new background task for adding YouTube video documents.
- Enhanced the connector service to search for YouTube videos and return relevant results.
- Updated frontend components to include YouTube video options in the dashboard and connector sources.
- Added necessary dependencies for YouTube transcript API.
This commit is contained in:
DESKTOP-RTLN3BA\$punk 2025-04-11 15:05:17 -07:00
parent 753f40dfea
commit b43272a115
13 changed files with 608 additions and 18 deletions
Download patch file Download diff file Expand all files Collapse all files

5
surfsense_backend/app/routes/documents_routes.py
View file

@ -6,7 +6,7 @@ from app.db import get_async_session, User, SearchSpace, Document, DocumentType
from app.schemas import DocumentsCreate, DocumentUpdate, DocumentRead
from app.users import current_active_user
from app.utils.check_ownership import check_ownership
from app.tasks.background_tasks import add_extension_received_document, add_received_file_document, add_crawled_url_document
from app.tasks.background_tasks import add_extension_received_document, add_received_file_document, add_crawled_url_document, add_youtube_video_document
# Force asyncio to use standard event loop before unstructured imports
import asyncio
try:
@ -368,8 +368,7 @@ async def process_youtube_video_with_new_session(
async with async_session_maker() as session:
try:
# TODO: Implement YouTube video processing
print("Processing YouTube video with new session")
await add_youtube_video_document(session, url, search_space_id)
except Exception as e:
import logging
logging.error(f"Error processing YouTube video: {str(e)}")