google-labs-jules[bot]
ce1014c8c2
Fix: Handle Slack rate limits and add GitHub org repo support
...
This commit includes two main improvements:
1. Slack Connector (`slack_history.py`):
- Addresses API rate limiting for `conversations.list` by introducing a 3-second delay between paginated calls.
- Implements handling for the `Retry-After` header when HTTP 429 errors occur.
- Fixes a `SyntaxError` caused by a non-printable character accidentally introduced in a previous modification.
- Adds comprehensive unit tests for the rate limiting and retry logic in `test_slack_history.py`.
2. GitHub Connector (`github_connector.py`):
- Modifies `get_user_repositories` to fetch all repositories accessible by you (including organization repositories) by changing the API call parameter from `type='owner'` to `type='all'`.
- Adds unit tests in `test_github_connector.py` to verify this change and other connector functionalities.
2025-05-27 13:27:10 +00:00
google-labs-jules[bot]
807c83b2f6
Fix: Handle Slack API rate limiting for conversations.list
...
The `get_all_channels` method in `slack_history.py` was making paginated
requests to `conversations.list` without any delay, leading to HTTP 429
errors when fetching channels from large Slack workspaces.
This commit introduces the following changes:
- Adds a 3-second delay between paginated calls to `conversations.list`
to comply with Slack's Tier 2 rate limits (approx. 20 requests/minute).
- Implements handling for the `Retry-After` header when a 429 error is
received. The system will wait for the specified duration before
retrying. If the header is missing or invalid, a default of 60 seconds
is used.
- Adds comprehensive unit tests to verify the new delay and retry logic,
covering scenarios with and without the `Retry-After` header, as well
as other API errors.
2025-05-27 12:56:26 +00:00
DESKTOP-RTLN3BA\$punk
38516e74f9
Version Bump
2025-05-22 00:11:57 -07:00
DESKTOP-RTLN3BA\$punk
521ee4a1c4
feat: Removed Hard Dependecy on Google Auth
...
- Introduced LOCAL auth mode
2025-05-21 20:56:23 -07:00
DESKTOP-RTLN3BA\$punk
4c8b03ce2b
feat: Code Block Syntax Highlighting & Copy Func
2025-05-19 23:19:20 -07:00
DESKTOP-RTLN3BA\$punk
ad13d815a5
refactor: Improved prompt for personalization.
2025-05-19 20:49:47 -07:00
DESKTOP-RTLN3BA\$punk
c7a173456a
feat: Basic Streaming
2025-05-16 01:51:55 -07:00
DESKTOP-RTLN3BA\$punk
a8080d2dc7
feat: Added Speech to Text support.
...
- Supports audio & video files.
- Will be useful for Youtube vids which dont have transcripts.
2025-05-13 21:13:53 -07:00
Rohan Verma
1d1523a891
Merge pull request #88 from ritikprajapat21/main
...
Fix #33 : Refactored code
2025-05-11 23:59:17 -07:00
DESKTOP-RTLN3BA\$punk
a9db0a8ceb
feat: Introduce the RAPTOR Search.
2025-05-11 23:05:56 -07:00
ritikprajapat21
16867b4bed
Changes updated
2025-05-12 09:37:37 +05:30
Ritik Prajapat
c1acd9cfaf
Merge branch 'MODSetter:main' into main
2025-05-12 09:36:47 +05:30
DESKTOP-RTLN3BA\$punk
d3540d8cc5
chore: more context to reranker
2025-05-10 20:19:08 -07:00
DESKTOP-RTLN3BA\$punk
a58550818b
feat: Added chat_history to researcher agent
2025-05-10 20:06:19 -07:00
ritikprajapat21
ccd12d3ad2
Fix #33 : Refactored code
2025-05-10 17:11:51 +05:30
DESKTOP-RTLN3BA\$punk
2cee5acaa3
feat: Improved sub section writer agent & Chat UI
2025-05-09 22:14:22 -07:00
DESKTOP-RTLN3BA\$punk
b3b9086f6d
oops
2025-05-08 19:42:54 -07:00
DESKTOP-RTLN3BA\$punk
4a2be4b98e
fix: Added API_BASE param for LiteLLM.
2025-05-08 19:31:47 -07:00
DESKTOP-RTLN3BA\$punk
5899a89bf1
recurse fix
2025-05-07 22:18:02 -07:00
DESKTOP-RTLN3BA\$punk
1586a0bd78
chore: Added direct handling for markdown files.
...
- Fixed podcast imports.
2025-05-07 22:04:57 -07:00
DESKTOP-RTLN3BA\$punk
8b8fd4fbad
chore: remove test script for Podcaster agent
2025-05-05 23:24:48 -07:00
DESKTOP-RTLN3BA\$punk
b4bee887bd
feat: Added Podcast Feature and its actually fast.
...
- Fully Async
2025-05-05 23:18:12 -07:00
DESKTOP-RTLN3BA\$punk
10d56acaa8
feat: Stable & Hella Fast Podcast Agent with auto FFMPEG handling.
2025-05-05 01:39:31 -07:00
DESKTOP-RTLN3BA\$punk
dc97072145
chore: updated docs
2025-04-30 23:52:58 -07:00
DESKTOP-RTLN3BA\$punk
42bde28781
fix: Support for All Embeddings
2025-04-30 00:10:50 -07:00
DESKTOP-RTLN3BA\$punk
22da221ad5
feat: Shifted to RecursiveChunker and CodeChunker
...
- Codebase Q/A should be lot better now.
2025-04-29 23:02:07 -07:00
DESKTOP-RTLN3BA\$punk
a971bb1f72
chore: update README and refactor ConnectorService for improved document handling and error management
2025-04-27 20:39:17 -07:00
DESKTOP-RTLN3BA\$punk
f956a39498
chore(fix): linkup citation mapping
2025-04-27 16:17:20 -07:00
DESKTOP-RTLN3BA\$punk
cc4e02183b
oops disables
2025-04-27 15:59:48 -07:00
DESKTOP-RTLN3BA\$punk
3675505eb1
feat: Added LinkUP Search Engine Connector
2025-04-27 15:53:33 -07:00
DESKTOP-RTLN3BA\$punk
cb1ad76a2a
docs stuff
2025-04-23 12:06:29 -07:00
DESKTOP-RTLN3BA\$punk
3155e7b0ac
chore: Added Versions
2025-04-21 23:58:32 -07:00
DESKTOP-RTLN3BA\$punk
5fecca9457
feat: Added envs for LLM Observability
2025-04-21 01:36:19 -07:00
DESKTOP-RTLN3BA\$punk
a1aad295bb
chore: cleanup
2025-04-20 23:34:21 -07:00
DESKTOP-RTLN3BA\$punk
130f43a0fa
feat: Removed GPT-Researcher in favour of own SurfSense LangGraph Agent
2025-04-20 19:19:35 -07:00
DESKTOP-RTLN3BA\$punk
ebc376473e
refactor: remove unused RerankerService import from nodes.py
2025-04-20 00:23:02 -07:00
DESKTOP-RTLN3BA\$punk
796e326cc8
refactor: coderabbit
2025-04-20 00:19:21 -07:00
DESKTOP-RTLN3BA\$punk
7be68ebf41
refactor: remove process_section function and streamline test workflow
2025-04-20 00:10:23 -07:00
DESKTOP-RTLN3BA\$punk
154c5748fd
refactor: coderabbit review
2025-04-19 23:44:42 -07:00
DESKTOP-RTLN3BA\$punk
34300ead02
feat: Initial version of SurfSense own LangGraph Agent.
2025-04-19 23:25:06 -07:00
DESKTOP-RTLN3BA\$punk
2008b07304
fix: Docs & Chats in other search spaces
2025-04-17 23:19:56 -07:00
Adamsmith6300
32c721113c
update edit connectors page to support linear connector
2025-04-16 22:06:50 -07:00
Adamsmith6300
f2f426d5eb
merge conflicts
2025-04-16 21:34:51 -07:00
Adamsmith6300
5176569e30
edit repos for gh connector
2025-04-16 20:29:50 -07:00
Adamsmith6300
ae8c74a5aa
select repos when adding gh connector
2025-04-16 19:59:38 -07:00
DESKTOP-RTLN3BA\$punk
e0eb9d4b8b
feat: Added Linear Connector
2025-04-15 23:10:35 -07:00
Adamsmith6300
3e472c124f
sync with main and address comments
2025-04-14 17:04:43 -07:00
Adamsmith6300
a69bbb32f7
Merge branch 'main' of https://github.com/MODSetter/SurfSense into add-github-connector
2025-04-14 15:25:29 -07:00
Adamsmith6300
396c070b28
addressing coderabbit PR comment
2025-04-13 21:33:10 -07:00
Adamsmith6300
a26fac435b
documents table migration, fix/update github indexing
2025-04-13 21:23:05 -07:00
