vikarti.anatra/Skyvern
1
0
Fork 0
mirror of https://github.com/Skyvern-AI/skyvern.git synced 2026-07-09 16:09:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
Skyvern/tests/unit
History
Suchintan 2dc25e6146
[Self-host] Add CDP streaming defaults and diagnostics (#5875) 
Co-authored-by: Marc Kelechava <marc.kelechava@gmail.com>
Co-authored-by: OmX <omx@oh-my-codex.dev>
Co-authored-by: Marc Kelechava <marc@skyvern.com>
2026-05-07 23:40:27 -07:00
..
db fix: populate workflow_run.script_run with script identity + complete ai_fallback_triggered coverage (#5635) 2026-04-23 18:37:18 -07:00
embedded fix: CJS default export interop for fetch-to-curl under Vite 8 (#5594) 2026-04-23 00:36:56 +08:00
forge fix: harden css-vars.test.ts existsSync filter for OSS sync target (#5852) 2026-05-06 13:58:28 -07:00
google feat(SKY-9463): open source Google Sheets connector auth (#5815) 2026-05-04 23:58:29 -05:00
services fix: pass through script_run / ai_fallback / browser_session_id / max_screenshot_scrolls on /v1/runs/{id} (#5725) 2026-04-29 15:12:33 -07:00
workflow Clarify credential lookup errors (#5872) 2026-05-07 09:20:55 -04:00
__init__.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
_mcp_test_helpers.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
conftest.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
fake_workflow_run_context.py feat(SKY-8771): frontend support for while_loop block (#5809) 2026-05-04 19:05:33 -07:00
force_stub_app.py feat(SKY-9463): open source Google Sheets connector auth (#5815) 2026-05-04 23:58:29 -05:00
helpers.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
skill_test_helpers.py fix: add missing is_pinned param to ScriptsRepository.create_workflow_script() (#5318) 2026-03-31 15:58:27 -07:00
test_action_url.py feat: show all selector options to script reviewer (#5410) 2026-04-07 14:02:36 -07:00
test_actions.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_aes_fallback_decrypt.py feat(SKY-9503/9504): AES multi-key decrypt + per-env ENCRYPTOR_AES_{SALT,IV} secrets (#5822) 2026-05-05 11:37:24 -05:00
test_agent_cleanup_download_suffix.py [Oncall] [SKY-8854] Preserve download suffixes across task finalization (#5499) 2026-04-14 12:35:31 -07:00
test_agent_db_imports.py Repository Design Pattern (#SKY-8139) (#5279) 2026-03-27 21:06:32 -07:00
test_ai_click_empty_actions.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_ai_extract_system_prompt_optout.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_aiohttp_helper.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_analytics.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_api_handler_cached_content_fix.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_api_handler_factory.py fix: honor per-request LLM timeout by disabling litellm aiohttp transport (#5758) 2026-05-01 11:15:13 -04:00
test_artifact_signing.py feat(SKY-8861): per-org artifact URL expiry config (backend) (#5685) 2026-04-27 08:50:59 -07:00
test_artifact_url_expiry_org_config.py feat(SKY-8861): per-org artifact URL expiry config (backend) (#5685) 2026-04-27 08:50:59 -07:00
test_auto_completion_discover_fallback.py fix(SKY-8778): click-first + re-scrape diff for shadow DOM comboboxes (#5471) 2026-04-13 14:40:16 +08:00
test_auto_completion_location.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_auto_fix_missing_else_goal.py feat(SKY-9570): turn classify-UNKNOWN into a productive learning signal (#5882) 2026-05-07 13:13:34 -07:00
test_aws_client_ttl.py [SKY-8743] token termination grace period seconds (#5376) 2026-04-03 14:49:39 -07:00
test_batch_action_queries.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_bitwarden_login.py Add Bitwarden email-auth fallback to global credentials on timeout (#5231) 2026-03-25 11:51:10 -04:00
test_block_description_caching.py fix: skip block description LLM call on subsequent for-loop iterations (#5428) 2026-04-08 14:45:04 -07:00
test_block_downloaded_file_scoping.py fix: scope downloaded files to current task block (#SKY-8914) (#5492) 2026-04-14 11:34:54 -05:00
test_block_llm_cost_kwargs_wiring.py feat: persist real LLM cost to DB + block-level attribution (public API unchanged — placeholder preserved) (#5656) 2026-04-24 17:02:12 -07:00
test_block_output_download_refresh.py fix(sky-8861): block-output download refresh fallback when artifact_ids are missing (#5675) 2026-04-26 16:56:39 -07:00
test_block_workflow_system_prompt_inheritance.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_branch_criteria.py feat(SKY-8771): frontend support for while_loop block (#5809) 2026-05-04 19:05:33 -07:00
test_browser_launcher_profile.py feat: add --use-local-profile to browser serve for Chrome profile reuse (#4958) 2026-03-02 20:10:34 -08:00
test_browser_page_agent_login.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_browser_profile_corruption_detection.py [Self-host] Add CDP streaming defaults and diagnostics (#5875) 2026-05-07 23:40:27 -07:00
test_browser_session_download_artifacts.py fix(SKY-8861): close CodeQL incomplete-url-substring-sanitization in recording tests (#5687) 2026-04-27 16:56:36 -07:00
test_browser_session_recording_artifacts.py fix(SKY-8861): close CodeQL incomplete-url-substring-sanitization in recording tests (#5687) 2026-04-27 16:56:36 -07:00
test_browser_session_update_started_at.py [NO-TICKET] Repository Design Pattern refactor (#9056) follow-up — missing parameter bugs (#5291) 2026-03-30 12:41:28 -07:00
test_build_navigation_goal.py feat: add user context field for credential login testing — backend (#SKY-8074) (#5079) 2026-03-13 02:44:27 +03:00
test_bulk_artifact_creation.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_cached_artifact_bundling.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_cached_download_s3_upload.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_cdp_connection.py [Self-host] Add CDP streaming defaults and diagnostics (#5875) 2026-05-07 23:40:27 -07:00
test_cdp_download_interceptor.py fix: add browser-level download monitor for CDP downloads bypassing Fetch (#5089) 2026-03-13 20:23:08 +08:00
test_classify_metadata_lifecycle.py feat(SKY-9570): turn classify-UNKNOWN into a productive learning signal (#5882) 2026-05-07 13:13:34 -07:00
test_cli_agent_aware.py feat: add CLI telemetry to close PostHog blind spot (#5491) 2026-04-13 23:01:08 -07:00
test_cli_auth.py Add browser-based CLI signup flow (skyvern signup) (#4925) 2026-02-27 19:09:12 -08:00
test_cli_bootstrap.py [SKY-8322] Compact MCP workflow status responses and fix wr lookup (#5084) 2026-03-12 18:47:21 -07:00
test_cli_commands.py feat: add CLI telemetry to close PostHog blind spot (#5491) 2026-04-13 23:01:08 -07:00
test_cli_commands_logging.py [SKY-8322] Compact MCP workflow status responses and fix wr lookup (#5084) 2026-03-12 18:47:21 -07:00
test_cli_doctor.py [Self-host] Add CDP streaming defaults and diagnostics (#5875) 2026-05-07 23:40:27 -07:00
test_cli_shared_core.py feat: MCP observe/execute batch tools + AI speed optimizations (#5386) 2026-04-05 16:38:13 -07:00
test_cli_telemetry.py SKY-7947 Ship lightweight Skyvern wheel contract (#5823) 2026-05-05 10:54:28 -07:00
test_click_prompt_parameterization.py fix(caching-v2): parameterize click prompts using workflow input params (SKY-9295) (#5689) 2026-04-27 17:27:19 -07:00
test_code_block_sandbox.py [Critical] Fix CodeBlock sandbox: remove asyncio, block dangerous attrs (#SKY-7897) (#5165) 2026-03-19 14:29:25 -07:00
test_collect_inherited_workflow_system_prompt.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_complete_verify_span.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_compute_conditional_scopes.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_conditional_script_caching.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_copilot_action_fingerprint.py feat(SKY-8879) copilot-stack/06: MCP tools surface + orphan-task cancellation (#5517) 2026-04-15 21:20:16 -07:00
test_copilot_agent_helpers.py fix(SKY-9658): prevent unbacked copilot workflow delivery replies (#5890) 2026-05-07 18:34:16 -07:00
test_copilot_block_goal_wrapping.py SKY-9458: Preserve copilot correction goal context (#5818) 2026-05-05 00:27:45 -07:00
test_copilot_cancel_helpers.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_copilot_context.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_copilot_enforcement_hardening.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_copilot_enforcement_pruning.py fix(SKY-9650): hydrate Copilot workflow state (#5889) 2026-05-07 18:17:53 -07:00
test_copilot_failure_tracking.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_copilot_feasibility_gate.py fix(SKY-9550): copilot: feasibility-gate inherits prior turn on bare-value continuations (#5853) 2026-05-06 14:08:04 -07:00
test_copilot_frontier.py SKY-9453 fix copilot reword-turn handling: test run, labels, goal wrap (#5791) 2026-05-04 16:29:22 -07:00
test_copilot_hooks.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_copilot_live_session_helper.py feat(SKY-9328): copilot V2 reuses live debug browser session (backend) (#5709) 2026-04-28 17:19:04 -07:00
test_copilot_loop_detection.py fix(SKY-9650): hydrate Copilot workflow state (#5889) 2026-05-07 18:17:53 -07:00
test_copilot_mid_correction_guard.py fix(SKY-9565): relax late block-running guard (#5884) 2026-05-07 14:02:17 -07:00
test_copilot_model_resolver.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_copilot_narration.py feat(SKY-9329): surface workflow-run sub-events as mid-tool copilot narrations (#5741) 2026-04-30 09:07:11 -07:00
test_copilot_non_retriable_nav.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_copilot_output_utils.py SKY-9454 fix copilot timeout WIP rescue (#5789) 2026-05-02 12:43:16 -07:00
test_copilot_parameter_binding.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_copilot_per_tool_budget.py fix(SKY-9532): salvage verified workflow when copilot budget exhausts mid-correction (#5848) 2026-05-06 13:27:58 -07:00
test_copilot_probable_site_block.py fix(SKY-9644): make site-block stop nudge proxy-aware (#5883) 2026-05-07 13:21:20 -07:00
test_copilot_recoverable_failures.py feat(SKY-9353): distinguish self-healed copilot tool failures (#5732) 2026-04-29 21:32:04 -07:00
test_copilot_response_coverage_gate.py fix(SKY-9658): prevent unbacked copilot workflow delivery replies (#5890) 2026-05-07 18:34:16 -07:00
test_copilot_runner_deadline.py SKY-9454 fix copilot timeout WIP rescue (#5789) 2026-05-02 12:43:16 -07:00
test_copilot_runtime.py copilot: wait for chromium boot in ensure_browser_session (SKY-9272) (#5667) 2026-04-25 16:15:12 -07:00
test_copilot_schema_overlay_ban.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_copilot_screenshot_handling.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_copilot_session_factory.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_copilot_session_injection.py SKY-9453 fix copilot reword-turn handling: test run, labels, goal wrap (#5791) 2026-05-04 16:29:22 -07:00
test_copilot_session_span_tag.py feat(SKY-9206): copilot attribution columns on workflows + workflow_runs (#5669) 2026-04-25 20:47:07 -07:00
test_copilot_sse_terminal_frame.py copilot: guarantee a terminal SSE frame on every chat turn (#5645) 2026-04-24 09:38:58 -07:00
test_copilot_streaming_adapter.py feat(SKY-9372): goal_reached self-assessment flips validated proposal to unvalidated (#5768) 2026-05-01 13:26:29 -07:00
test_copilot_task_block_rejection.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_copilot_timeout_wip.py fix(SKY-9532): salvage verified workflow when copilot budget exhausts mid-correction (#5848) 2026-05-06 13:27:58 -07:00
test_copilot_token_estimation.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_copilot_token_usage.py copilot: fix missing token telemetry from litellm streaming path (SKY-9245) (#5671) 2026-04-26 09:47:38 -07:00
test_copilot_tool_loop_error_block_running.py fix(SKY-9565): relax late block-running guard (#5884) 2026-05-07 14:02:17 -07:00
test_copilot_tracing_setup.py fix:(SKY-9633) Fix copilot otel cost attribution for non-openai providers (#5859) 2026-05-06 15:48:30 -07:00
test_copilot_watchdog.py fix(SKY-9532): salvage verified workflow when copilot budget exhausts mid-correction (#5848) 2026-05-06 13:27:58 -07:00
test_credential_api_response.py fix: remove skyvern/cli from pyupgrade exclude list and fix violations (#5236) 2026-03-25 19:05:41 +03:00
test_credential_update_params.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_credential_vault_type_override.py feat: add Custom Credential Service to cloud settings UI (#5240) 2026-03-25 14:34:51 -07:00
test_css_selector.py feat: show all selector options to script reviewer (#5410) 2026-04-07 14:02:36 -07:00
test_custom_credential_client.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_data_extraction_summary_crossrun_cache.py feat(extraction-cache): wire data-extraction-summary into cross-run cache (SKY-8992) (#5742) 2026-04-30 11:56:29 -07:00
test_data_extraction_summary_schema_cap.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_db_operation_decorator.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_default_task_version.py feat: default /v1/run/tasks engine to v1 (SKY-8566) (#5403) 2026-04-07 11:45:39 -04:00
test_deterministic_field_naming.py feat(SKY-8965): Phase 2 — kill LLM synthesis, wire deterministic picker, flip guard to raise (#5596) 2026-04-22 10:38:48 -07:00
test_dialog_handler_records_to_context.py fix(SKY-9471): surface browser dialog rejections to agent prompt (#5810) 2026-05-04 21:07:02 -05:00
test_download_dedup.py fix(SKY-8537): deduplicate downloaded files by checksum (#5595) 2026-04-23 00:40:13 +08:00
test_download_file_action_handler.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_downloaded_files_artifact_urls.py feat(SKY-8861): per-org artifact URL expiry config (backend) (#5685) 2026-04-27 08:50:59 -07:00
test_empty_script_blocks.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_enable_css_svg_parsing.py feat: add ENABLE_CSS_SVG_PARSING env var to gate SVG/CSS parsing (#5258) 2026-03-26 14:06:21 -07:00
test_error_detection_integration.py fix(SKY-9425): drop hallucinated failure_category codes from user-defined errors (#5775) 2026-05-01 18:22:45 -04:00
test_error_detection_service.py Add user-defined error detection on task failure (#4974) 2026-03-04 15:38:27 +08:00
test_event_source_stream_disconnect.py fix(SKY-8986): stop SSE disconnect from killing the copilot agent (#5560) 2026-04-20 11:54:32 -07:00
test_exception_messages.py [Self-host] Add CDP streaming defaults and diagnostics (#5875) 2026-05-07 23:40:27 -07:00
test_extract_action_dialog_messages_render.py fix(SKY-9471): surface browser dialog rejections to agent prompt (#5810) 2026-05-04 21:07:02 -05:00
test_extract_actions_ceiling.py fix(SKY-8920): cap extract-* prompt sizes to reduce Gemini TPM 429s (#5502) 2026-04-14 17:42:05 -05:00
test_extract_information_cross_run_shadow.py feat(SKY-9536): wire shadow-mode FP gate to cross-run extraction cache hit path (#5879) 2026-05-07 12:22:39 -07:00
test_extract_information_previous_info_cap.py feat(extraction-cache): cross-run Redis tier (SKY-8873) (#5562) 2026-04-20 16:16:45 -07:00
test_extract_information_retry_bypass.py feat(extraction-cache): cross-run Redis tier (SKY-8873) (#5562) 2026-04-20 16:16:45 -07:00
test_extract_information_text_optout.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_extract_information_wpid_fallback.py fix(extraction-cache): resolve wpid via context at cross-run cache sites (SKY-8992) (#5604) 2026-04-22 15:45:43 -07:00
test_extract_template_rendering_in_cached_fn.py fix: resolve workflow parameter templates in cached extraction prompts (#5432) 2026-04-08 17:11:02 -07:00
test_extraction_cache.py fix(SKY-9532): salvage verified workflow when copilot budget exhausts mid-correction (#5848) 2026-05-06 13:27:58 -07:00
test_extraction_shadow.py fix(extraction-shadow): follow-up to SKY-8871 — cycle, dead code, comment nits (#5486) 2026-04-13 23:32:20 -05:00
test_fail_task_error_detection.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_failure_classifier.py fix(SKY-9650): hydrate Copilot workflow state (#5889) 2026-05-07 18:17:53 -07:00
test_feature_flag_resolution_logging.py feat: extend feature flag resolution logging to standalone tasks (#5541) 2026-04-17 07:52:02 -07:00
test_file_download_access_control.py fix: allow artifact bucket URIs in managed file access check (SKY-8520) (#5210) 2026-03-24 01:33:37 +03:00
test_file_download_block_warning.py SKY-8818: progressive wait_until for file_download navigation + low max_steps observability (#5431) 2026-04-08 17:01:01 -07:00
test_filter_user_defined_codes.py fix(SKY-9425): drop hallucinated failure_category codes from user-defined errors (#5775) 2026-05-01 18:22:45 -04:00
test_finally_block_dag.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_fix_static_actions_in_for_loops.py fix: replace CodeQL-flagged prompt regex in workflow script service [SKY-8311] (#5063) 2026-03-11 20:28:26 -07:00
test_forge_app_initializer.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_forge_log_compaction.py log: compact Action / ActionResult kwargs in structlog pipeline (#5739) 2026-04-30 09:00:10 -07:00
test_forge_log_redaction.py log: silence uvicorn ws spam + redact bearer tokens (#5786) 2026-05-01 18:21:50 -07:00
test_forloop_child_caching_tracking.py Fix: cache file_download blocks inside for-loops (#5323) 2026-03-31 20:33:45 -07:00
test_forloop_incremental_persist.py [SKY-8767] fix: persist ForLoopBlock output incrementally to survive activity timeouts (#5393) 2026-04-06 13:44:33 -07:00
test_forloop_script_generation.py fix(SKY-9180): prevent SyntaxError from cached for_loop code at module level (#5606) 2026-04-22 18:42:14 -05:00
test_handle_script_termination.py fix(SKY-9568): persist block status on script termination, distinguish complete-reject from intentional terminate (#5862) 2026-05-06 18:51:37 -07:00
test_handle_terminate_action.py fix: harden css-vars.test.ts existsSync filter for OSS sync target (#5852) 2026-05-06 13:58:28 -07:00
test_http_block_raw_filter.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_hydrate_action_resilience.py fix(SKY-9512): harden hydrate_action against malformed rows (#5856) 2026-05-07 01:22:18 +03:00
test_id_generation.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_iframe_e2e.py feat: iframe support for SDK, CLI, and MCP tools (#5319) 2026-03-31 16:10:53 -07:00
test_iframe_mcp_e2e.py feat: iframe support for SDK, CLI, and MCP tools (#5319) 2026-03-31 16:10:53 -07:00
test_iframe_support.py feat: iframe support for SDK, CLI, and MCP tools (#5319) 2026-03-31 16:10:53 -07:00
test_init_mcp.py fix: move opentelemetry-sdk to dev group so OSS CI can run tracing test (#5539) 2026-04-16 21:01:38 -07:00
test_library_skyvern.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_llm_handler_tracing.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_llm_prompt_config.py fix(SKY-9622): suppress false-positive warning when prompt type absent from PostHog config (#5849) 2026-05-06 15:38:16 -05:00
test_llm_response_parsing.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_llm_types_public_shim.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_load_prompt_with_elements_ceiling.py feat(extraction-cache): prompt normalization pipeline (SKY-8872) (#5504) 2026-04-14 19:39:10 -05:00
test_local_file_path_validation.py fix: restrict SendEmailBlock and UploadToS3Block to workflow download directory (SKY-7900) (#5221) 2026-03-24 14:39:01 -07:00
test_log_artifacts.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_login_block_credential_emit.py fix(SKY-9340): emit nested credential subscripts at code-emission time (#5750) 2026-04-30 17:05:45 -07:00
test_login_block_default_navigation_goal.py Fix: apply default login prompt for MCP-created workflow login blocks (#SKY-8637) (#5342) 2026-04-01 17:25:59 -07:00
test_loop_block_output_scoping.py fix: prevent block output from leaking across loop iterations (#SKY-8835) (#5475) 2026-04-14 02:10:16 +08:00
test_loop_download_baseline_timeout.py Fix OSS frontend build: add useFeatureFlag stub (#5042) 2026-03-10 23:36:42 -07:00
test_loop_next_loop_on_failure_swallow.py feat(SKY-9421): frontend - Wait for browser before Copilot (#5771) 2026-05-01 14:11:30 -07:00
test_magic_link_auto_close.py fix(SKY-8065): improve magic link tab close behavior with prompt fix and code fallback (#5715) 2026-04-29 14:20:15 +08:00
test_mcp_block_tools.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_mcp_block_type_parity.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
test_mcp_browser_extensions.py feat: MCP drag, file upload, evaluate async, tool annotations (#5229) 2026-03-24 18:37:54 -07:00
test_mcp_browser_tools.py Extract shared core from MCP tools, add CLI browser commands (#4768) 2026-02-17 11:24:56 -08:00
test_mcp_clipboard.py feat: add clipboard read/write MCP tools (PR 7/7) (#5365) 2026-04-02 15:49:01 -07:00
test_mcp_commands.py fix: move opentelemetry-sdk to dev group so OSS CI can run tracing test (#5539) 2026-04-16 21:01:38 -07:00
test_mcp_common.py feat: MCP script/caching tools for code v2 visibility (#5243) 2026-03-25 15:42:53 -07:00
test_mcp_concise_responses.py [SKY-8322] Compact MCP workflow status responses and fix wr lookup (#5084) 2026-03-12 18:47:21 -07:00
test_mcp_dom_inspection.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_folder_tools.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
test_mcp_har_tools.py feat: network request detail, route interception, and body capture for MCP/CLI (#5370) 2026-04-02 18:10:45 -07:00
test_mcp_http_auth.py MCP OAuth org selection for multi-org users (#5699) 2026-04-28 01:30:43 -07:00
test_mcp_inspection.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_localhost_guard.py Add QA discoverability to MCP instructions and localhost guard for cloud browsers (#4984) 2026-03-04 16:56:11 -08:00
test_mcp_network_tracking.py feat: network request detail, route interception, and body capture for MCP/CLI (#5370) 2026-04-02 18:10:45 -07:00
test_mcp_observe_execute.py feat: MCP observe/execute batch tools + AI speed optimizations (#5386) 2026-04-05 16:38:13 -07:00
test_mcp_origin_middleware.py feat(mcp): [Required for Anthropic Claude Connectors Listing] add tool titles, Origin validation, and response size cap (#5608) 2026-04-22 17:23:59 -07:00
test_mcp_page_errors.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_response_size_cap.py feat(mcp): [Required for Anthropic Claude Connectors Listing] add tool titles, Origin validation, and response size cap (#5608) 2026-04-22 17:23:59 -07:00
test_mcp_script_caching_live.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
test_mcp_semantic_locators.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_session_lifecycle.py Support GeoTarget proxies for MCP browser sessions (#5764) 2026-05-01 10:13:29 -07:00
test_mcp_state_tools.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_storage_tools.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_tab_tools.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_telemetry.py feat: Add MCP tool call performance telemetry (#5688) 2026-04-27 17:24:50 -07:00
test_mcp_tool_titles.py Add explicit MCP tool safety hints [chat gpt connector - more unblocking] (#5712) 2026-04-28 19:14:56 -07:00
test_mcp_workflow_create_defaults.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_mcp_workflow_guidance.py feat(mcp): [Required for Anthropic Claude Connectors Listing] add tool titles, Origin validation, and response size cap (#5608) 2026-04-22 17:23:59 -07:00
test_mcp_workflow_list_drift.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
test_mcp_workflow_route_prefixes.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
test_mcp_workflow_tools.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
test_missing_starter_url.py fix: CJS default export interop for fetch-to-curl under Vite 8 (#5594) 2026-04-23 00:36:56 +08:00
test_multi_field_totp.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_navigation_in_forloop_codegen.py fix: use dynamic selectors for navigation blocks inside for-loops (#5434) 2026-04-08 17:47:29 -07:00
test_navigation_in_while_loop_codegen.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_nested_forloop_caching_tracking.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_nested_forloop_script_generation.py fix: nested for-loop script block persistence (SKY-8757) (#5404) 2026-04-07 10:38:48 -07:00
test_nested_loop_output_parameters.py feat(SKY-8771): backend WhileLoopBlock (PR 1 of 7) (#5703) 2026-04-28 11:37:52 -07:00
test_nested_while_loop_script_generation.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_ngrok_helpers.py Add interactive ngrok guided setup for browser serve --tunnel (#4986) 2026-03-04 17:38:27 -08:00
test_no_direct_db_delegates.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_no_fill_form_in_adaptive_codegen.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_org_auth_service.py fix(SKY-9507): invalidate org auth cache on update (#5826) 2026-05-05 13:09:19 -07:00
test_organization_update_schema.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_otp_service.py fix(SKY-9553): retry OTP polling for full wall-clock timeout (#5878) 2026-05-07 13:52:06 -05:00
test_parallel_verification.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_parameter_reference_guard.py Revert #10280 — accidental mass deletion of copilot code (#5525) 2026-04-15 23:20:37 -07:00
test_parse_totp_secret.py fix: discard invalid TOTP secrets at registration time with error log (#5874) 2026-05-08 00:32:17 +08:00
test_pdf_download_fixes.py fix: handle Edge PDF interstitial pages on about:blank (#SKY-8279) (#5065) 2026-03-12 15:15:29 +08:00
test_phantom_script_block_entries.py fix: skip script_block entries for blocks with no actions (#SKY-8443) (#5141) 2026-03-18 23:24:57 -07:00
test_print_page_block_downloaded_files.py feat(SKY-9416): surface print-to-PDF in block downloaded_files (#5784) 2026-05-01 18:13:19 -07:00
test_prompt_caching_settings.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_prompt_truncation.py fix(SKY-8920): cap extract-* prompt sizes to reduce Gemini TPM 429s (#5502) 2026-04-14 17:42:05 -05:00
test_qa_skill_content.py feat(mcp): [Required for Anthropic Claude Connectors Listing] add tool titles, Origin validation, and response size cap (#5608) 2026-04-22 17:23:59 -07:00
test_real_browser_manager.py fix(SKY-9113): skip ffmpeg remux on per-step video sync (#5559) 2026-04-20 11:44:19 -07:00
test_real_browser_state_navigate.py SKY-8818: progressive wait_until for file_download navigation + low max_steps observability (#5431) 2026-04-08 17:01:01 -07:00
test_recording_window_filter.py feat: return all workflow run recordings (backend) (SKY-9233) (#5660) 2026-04-24 21:17:44 -04:00
test_render_list.py feat: add fallback episode API endpoints (#4997) 2026-03-05 14:32:24 -08:00
test_request_logging.py feat(SKY-8879) copilot-stack/03: copilot utilities + openai-agents dep (#5512) 2026-04-15 16:17:06 -07:00
test_run_commands_cleanup.py fix: move opentelemetry-sdk to dev group so OSS CI can run tracing test (#5539) 2026-04-16 21:01:38 -07:00
test_run_response_types.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_run_task_prompt_parameterization.py Fix PII leakage in cached run_task() prompts (#SKY-7989) (#4744) 2026-02-13 12:16:45 -08:00
test_runs_v2_route.py fix(SKY-9434): filter self-output key from reviewer parameter list (#5793) 2026-05-04 17:24:03 -07:00
test_sanitization.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_schedule_cli.py feat: workflow schedule management via MCP tools and skyvern schedule CLI (#5713) 2026-04-28 19:39:17 -07:00
test_schedule_mcp_tools.py feat: workflow schedule management via MCP tools and skyvern schedule CLI (#5713) 2026-04-28 19:39:17 -07:00
test_script_block_creation.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_script_block_dedup.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_script_generation_race_condition.py feat(SKY-8965): Phase 2 — kill LLM synthesis, wire deterministic picker, flip guard to raise (#5596) 2026-04-22 10:38:48 -07:00
test_script_review_cap.py feat: make script review daily cap configurable via PostHog (#5389) 2026-04-06 12:41:46 -07:00
test_script_reviewer_consolidation.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_script_reviewer_extract.py fix(SKY-9430): bypass parse_api_response for reviewer LLM calls (#5781) 2026-05-01 16:41:30 -07:00
test_script_reviewer_quality.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_script_reviewer_terminate.py feat: teach script reviewer about page.terminate() with conditional-only rule (SKY-8334) (#5097) 2026-03-13 14:11:16 -07:00
test_script_reviewer_validators.py fix(SKY-9434): filter self-output key from reviewer parameter list (#5793) 2026-05-04 17:24:03 -07:00
test_script_service_loop_download_filter.py fix: deduplicate extracted_information in code v2 loop output (#5051) 2026-03-11 13:04:35 -07:00
test_script_skyvern_page.py fix(SKY-9568): persist block status on script termination, distinguish complete-reject from intentional terminate (#5862) 2026-05-06 18:51:37 -07:00
test_script_validators.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_scroll_guard.py Fix: guard scroll_to_top/scroll_to_next_page against non-numeric JS returns (#5170) 2026-03-20 13:19:44 +08:00
test_secret_credentials.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_security.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_selector_retry.py fix: retry selector lookup before falling back to AI in cached scripts (#5385) 2026-04-05 13:55:47 -07:00
test_setup_ai_env.py SKY-7947 Ship lightweight Skyvern wheel contract (#5823) 2026-05-05 10:54:28 -07:00
test_setup_commands.py Add MCP API key switcher for local clients [SKY-8218] (#5060) 2026-03-11 16:23:31 -07:00
test_setup_hermes.py feat(SKY-8879) copilot-stack/07: enforcement + overflow recovery (#5519) 2026-04-15 22:21:36 -07:00
test_setup_openclaw.py fix: move opentelemetry-sdk to dev group so OSS CI can run tracing test (#5539) 2026-04-16 21:01:38 -07:00
test_setup_quickstart.py Fix OSS frontend build: add useFeatureFlag stub (#5042) 2026-03-10 23:36:42 -07:00
test_should_run_script.py Make run_with non-nullable, default to agent (#5275) 2026-03-27 18:53:28 -07:00
test_skyvern_context_dialog_messages.py fix(SKY-9471): surface browser dialog rejections to agent prompt (#5810) 2026-05-04 21:07:02 -05:00
test_smoke_test_skill_content.py fix: add missing is_pinned param to ScriptsRepository.create_workflow_script() (#5318) 2026-03-31 15:58:27 -07:00
test_soft_delete.py Create @db_operation error handling decorator (#SKY-8135) (#5272) 2026-03-27 14:14:45 -07:00
test_static_script_infrastructure.py Add mode='direct' to SkyvernPage click/fill for static script action recording (#5264) 2026-03-26 20:05:20 -07:00
test_step_archive_accumulator.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_strip_query_params.py feat(SKY-8879) copilot-stack/12: wire-up (flag + dispatch + frontend) (#5531) 2026-04-16 17:25:07 -07:00
test_summarize_output.py feat: add summarize-output LLM endpoint for workflow runs (SKY-8857) (#5493) 2026-04-14 11:41:39 -05:00
test_sync_video_artifact_after_step.py fix(SKY-9113): skip ffmpeg remux on per-step video sync (#5559) 2026-04-20 11:44:19 -07:00
test_task_run_status_sync.py fix: teach script reviewer to detect hardcoded per-run values in selectors (#5325) 2026-03-31 21:27:50 -07:00
test_task_runs_sync_activity.py fix: teach script reviewer to detect hardcoded per-run values in selectors (#5325) 2026-03-31 21:27:50 -07:00
test_task_v2_task_run_creation.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_taskv2_block_context_preservation.py feat: extend feature flag resolution logging to standalone tasks (#5541) 2026-04-17 07:52:02 -07:00
test_taskv2_block_downloaded_files.py Fix loop-scoped Task V2 download filtering (#5477) 2026-04-13 14:12:12 -07:00
test_text_prompt_block.py Fix: Diagnostics button always visible for completed task blocks (SKY-8398) (#5120) 2026-03-18 02:52:33 -07:00
test_text_prompt_block_yaml.py fix: self-hosted model keys resolve to unregistered fallback configs (#5099) 2026-03-13 15:06:27 -07:00
test_totp_identifier_fallback.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_upload_file_url_recovery.py fix(SKY-9151): recover LLM-corrupted upload URLs in handle_upload_file_action (#5610) 2026-04-22 19:42:42 -05:00
test_url_validators.py fix(SKY-9322): normalize bracketed IPv6 hosts in is_blocked_host (#5759) 2026-05-01 11:20:45 -04:00
test_utils_templating.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_validation_error_formatting.py Re-apply SKY-7366: Improve 422 error messages for workflow save (#4852) 2026-02-24 00:55:29 +03:00
test_validation_span_attrs.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_verification_span_attrs.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_vertex_cache_model_extraction.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_video_utils.py fix(SKY-8938): finalize webm recordings so they have end timestamp (#5551) 2026-04-19 09:34:27 -07:00
test_webhook_timestamps.py Fix webhook payload timestamps always null (#SKY-7211) (#4959) 2026-03-03 00:26:17 -05:00
test_while_loop_block.py feat(SKY-8771): frontend support for while_loop block (#5809) 2026-05-04 19:05:33 -07:00
test_while_loop_child_caching_tracking.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_while_loop_incremental_persist.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_while_loop_script_generation.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_workflow_copilot_cancel.py SKY-9454 fix copilot timeout WIP rescue (#5789) 2026-05-02 12:43:16 -07:00
test_workflow_copilot_chain_repair.py fix: use started_at for run history duration calculation (#5094) 2026-03-13 13:04:43 -07:00
test_workflow_copilot_credential_refusal.py fix(SKY-9189): restore raw-credential refusal in Workflow Copilot v2 (#5598) 2026-04-22 14:54:15 -07:00
test_workflow_copilot_llm_config.py feat(SKY-9372): goal_reached self-assessment flips validated proposal to unvalidated (#5768) 2026-05-01 13:26:29 -07:00
test_workflow_copilot_prompt_injection.py fix(SKY-9650): hydrate Copilot workflow state (#5889) 2026-05-07 18:17:53 -07:00
test_workflow_copilot_route.py chore: Add GPT-5.4 mini model support (#5782) 2026-05-01 17:56:47 -07:00
test_workflow_copilot_route_helpers.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_workflow_copilot_session_context.py feat(SKY-9206): copilot attribution columns on workflows + workflow_runs (#5669) 2026-04-25 20:47:07 -07:00
test_workflow_copilot_workflow_state.py fix(SKY-9650): hydrate Copilot workflow state (#5889) 2026-05-07 18:17:53 -07:00
test_workflow_error_code_mapping_inheritance.py feat: add workflow-level inherited error_code_mapping (SKY-8855) (#5506) 2026-04-14 20:28:19 -05:00
test_workflow_onepassword_errors.py Clarify credential lookup errors (#5872) 2026-05-07 09:20:55 -04:00
test_workflow_parameter_validation.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_workflow_run_detail_after_workflow_delete.py fix(SKY-9185): keep run detail page accessible after workflow delete (BE) (#5776) 2026-05-01 18:36:56 -04:00
test_workflow_run_parameter_batching.py fix(SKY-9553): retry OTP polling for full wall-clock timeout (#5878) 2026-05-07 13:52:06 -05:00
test_workflow_run_step_budget.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_workflow_schema_field_preservation.py feat(SKY-8965): Phase 2 — kill LLM synthesis, wire deterministic picker, flip guard to raise (#5596) 2026-04-22 10:38:48 -07:00
test_workflow_service_cancel.py MCP OAuth org selection for multi-org users (#5699) 2026-04-28 01:30:43 -07:00
test_workflow_system_prompt_llm_forwarding.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_workflow_trigger_script_generation.py Fix: support WorkflowTriggerBlock in cached scripts (#SKY-8575) (#5320) 2026-03-31 17:01:50 -07:00
test_yaml_loader_no_dates.py feat(SKY-8879) copilot-stack/06: MCP tools surface + orphan-task cancellation (#5517) 2026-04-15 21:20:16 -07:00