vikarti.anatra/Skyvern
1
0
Fork 0
mirror of https://github.com/Skyvern-AI/skyvern.git synced 2026-07-09 16:09:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
Skyvern/tests/unit
History
Shuchang Zheng bf3624d788
fix(SKY-11996): restore copilot actuation-obligation feature reverted by #13210 (#7230)
2026-07-08 23:00:59 -07:00
..
copilot feat(SKY-11345): default new copilot data-write blocks to continue_on_failure=false (#6779) 2026-06-23 18:37:46 -05:00
db SKY-10346: Normalize repository datetimes (PR 6/12) (#6242) 2026-05-28 20:56:49 -07:00
embedded test(SKY-11845): delete verified-redundant unit tests (zero coverage loss) (#7113) 2026-07-06 11:04:47 -04:00
forge fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
golden_prompts feat(SKY-10075): tiered slim LLM output prompts (slim_safe / slim_terse) (#6392) 2026-06-04 17:41:25 -07:00
google feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
services perf(record): emit interpretation deltas instead of full snapshots (#6995) 2026-07-01 22:17:35 -04:00
webeye fix(SKY-11997,SKY-12004): name session-scoped downloads by configured download_suffix (#7172) 2026-07-07 18:25:29 -05:00
workflow fix(SKY-12044): resolve in-process page.extract() via SkyvernPage recorder wrapper (#7226) 2026-07-08 20:52:08 -07:00
__init__.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
_mcp_browser_fakes.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
_mcp_test_helpers.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
conftest.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
copilot_route_test_support.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
copilot_test_helpers.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
fake_workflow_run_context.py feat(SKY-8771): frontend support for while_loop block (#5809) 2026-05-04 19:05:33 -07:00
force_stub_app.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
helpers.py fix(llm): fall back to non-Gemini model on Gemini content_filter (SKY-11766) (#7155) 2026-07-07 07:52:03 -07:00
skill_test_helpers.py fix: add missing is_pinned param to ScriptsRepository.create_workflow_script() (#5318) 2026-03-31 15:58:27 -07:00
test_action_error_extraction.py [oncall] Capture transient download error popups (#6080) 2026-05-20 12:55:16 -07:00
test_action_to_stmt_credential_totp_inheritance.py fix(SKY-9822): script generator emits credential TOTP lookup when block has no explicit totp_identifier (#5992) 2026-05-14 09:31:32 -07:00
test_action_to_stmt_totp.py feat(SKY-9780): typed transcript anchors for request-policy classifier (#5976) 2026-05-13 12:28:52 -07:00
test_action_url.py feat: show all selector options to script reviewer (#5410) 2026-04-07 14:02:36 -07:00
test_actions.py fix(SKY-11235): honor "keep exactly N tabs" in task_v2 (curate over-opened tabs + planner tab visibility) (#6838) 2026-06-26 01:01:16 -04:00
test_adopted_session_download_save.py SKY-11246 fix(persistent-browsers): active CDP probe + evict-on-Connection-closed for cached PBS reuse (#6921) 2026-06-30 16:52:23 +08:00
test_aes_fallback_decrypt.py feat(SKY-9503/9504): AES multi-key decrypt + per-env ENCRYPTOR_AES_{SALT,IV} secrets (#5822) 2026-05-05 11:37:24 -05:00
test_agent_alias.py SKY-10580: expose the workflows API as /agents + accept agent_id (backwards-compatible) (#6383) 2026-06-04 12:10:29 -04:00
test_agent_cleanup_download_suffix.py fix(SKY-11997,SKY-12004): name session-scoped downloads by configured download_suffix (#7172) 2026-07-07 18:25:29 -05:00
test_agent_context.py SKY-9841 extract shared agent context helpers (#5988) 2026-05-14 00:18:31 -07:00
test_agent_db_imports.py Repository Design Pattern (#SKY-8139) (#5279) 2026-03-27 21:06:32 -07:00
test_agent_otp_routing.py SKY-10620: Route data-only validation without page evidence (#6960) 2026-07-01 17:39:00 +08:00
test_agent_route_aliases.py SKY-10580: expose the workflows API as /agents + accept agent_id (backwards-compatible) (#6383) 2026-06-04 12:10:29 -04:00
test_agent_step_cancellation.py SKY-10620: Route data-only validation without page evidence (#6960) 2026-07-01 17:39:00 +08:00
test_ai_click_empty_actions.py fix: map ai_click operational failures to 422 on /v1/sdk/run_action (#6065) 2026-05-19 21:08:22 -04:00
test_ai_extract_system_prompt_optout.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_aiohttp_helper.py fix(SKY-11948): consume output-contract grants at dispatch (#7188) 2026-07-07 20:37:34 -07:00
test_analytics.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_animation_wait_attrs.py perf(SKY-10319): add caller/timeout span attrs to animation wait (#6369) 2026-06-04 11:53:18 +08:00
test_anthropic_cua_extraction_seeding.py fix(agent): seed CUA extraction prompt (SKY-10694) (#6610) 2026-06-16 15:09:41 +08:00
test_api_docs_taxonomy.py [codex] Add custom LLM configuration (#6936) 2026-06-30 17:45:45 -04:00
test_api_handler_cached_content_fix.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_api_handler_factory.py fix(llm): re-point Vertex gemini-3.1-flash-lite at the GA id (preview sunsets 2026-07-09) (#7162) 2026-07-07 12:14:46 -07:00
test_artifact_archive_detection.py feat(SKY-9672): detect archived artifacts and surface archive status to frontend (#6075) 2026-05-20 16:22:46 +08:00
test_artifact_signing.py feat(SKY-8861): per-org artifact URL expiry config (backend) (#5685) 2026-04-27 08:50:59 -07:00
test_artifact_url_expiry_org_config.py feat: show credits consumed per run on workflow run pages (#SKY-8320) (#6133) 2026-05-22 23:53:06 -04:00
test_auto_completion_detection.py revert: narrow autocomplete input triggers from #9417 (#6330) 2026-06-02 23:24:20 +08:00
test_auto_completion_discover_fallback.py fix(SKY-8778): click-first + re-scrape diff for shadow DOM comboboxes (#5471) 2026-04-13 14:40:16 +08:00
test_auto_completion_location.py SKY-11526 Collapse autocomplete fanout (#7037) 2026-07-02 18:54:36 -07:00
test_auto_fix_missing_else_goal.py feat(SKY-9570): turn classify-UNKNOWN into a productive learning signal (#5882) 2026-05-07 13:13:34 -07:00
test_aws_client_ttl.py SKY-11165 Defer AWS session creation for missing profiles (#6680) 2026-06-17 16:56:37 -07:00
test_batch_action_queries.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_bitwarden_login.py Add Bitwarden email-auth fallback to global credentials on timeout (#5231) 2026-03-25 11:51:10 -04:00
test_bitwarden_null_credentials.py Add authenticator QR upload support (#6882) 2026-06-28 22:01:23 -04:00
test_block_description_caching.py fix: skip block description LLM call on subsequent for-loop iterations (#5428) 2026-04-08 14:45:04 -07:00
test_block_downloaded_file_scoping.py test(SKY-11845): delete verified-redundant unit tests (zero coverage loss) (#7113) 2026-07-06 11:04:47 -04:00
test_block_llm_cost_kwargs_wiring.py fix(SKY-10960): OCR scanned PDFs page-by-page in file_url_parser (#6722) 2026-06-20 01:31:58 -04:00
test_block_output_download_refresh.py feat: show credits consumed per run on workflow run pages (#SKY-8320) (#6133) 2026-05-22 23:53:06 -04:00
test_block_validate_code_only.py feat(mcp): code-only mode for block validation (Copilot connector, M4) (#6997) 2026-07-01 20:00:44 -07:00
test_block_workflow_system_prompt_inheritance.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_branch_criteria.py feat(SKY-8771): frontend support for while_loop block (#5809) 2026-05-04 19:05:33 -07:00
test_browser_artifacts_remote_browser_session_id.py Fix remote browser session recording target reuse (#6919) 2026-06-30 16:46:02 +08:00
test_browser_context_factory_marker.py SKY-10723: Add worker-side CDP livestream publishing (#6895) 2026-06-30 02:19:41 +08:00
test_browser_header_sanitization.py fix(SKY-8929): gate worker startup on X display readiness; sanitize browser headers (#6645) 2026-06-16 19:47:48 -07:00
test_browser_launcher_profile.py feat: add --use-local-profile to browser serve for Chrome profile reuse (#4958) 2026-03-02 20:10:34 -08:00
test_browser_page_agent_login.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_browser_profile_corruption_detection.py [Self-host] Add CDP streaming defaults and diagnostics (#5875) 2026-05-07 23:40:27 -07:00
test_browser_profile_key.py feat(SKY-11051): back Save & Reuse Session with auto-managed browser profiles (#7032) 2026-07-02 19:35:07 -04:00
test_browser_recording_interpretation.py fix(record): start a fresh interpretation session per recording (#7002) 2026-07-02 00:39:40 -04:00
test_browser_session_download_artifacts.py feat: show credits consumed per run on workflow run pages (#SKY-8320) (#6133) 2026-05-22 23:53:06 -04:00
test_browser_session_profile_export_gate.py feat(SKY-10701): write back reused browser profiles + graceful fallback on a missing profile (#6614) 2026-06-16 16:06:56 +03:00
test_browser_session_recording_artifacts.py [codex] Add session replay artifact groundwork (#6429) 2026-06-07 21:48:13 -04:00
test_browser_session_update_started_at.py SKY-10346: Normalize repository datetimes (PR 6/12) (#6242) 2026-05-28 20:56:49 -07:00
test_budget_preflight.py perf(SKY-10319): check budget/max-steps before awaiting speculative task (#6313) 2026-06-02 02:18:02 +08:00
test_build_lean_elements_tree.py feat(SKY-10076): drop non-navigable hrefs from the lean element tree (#6461) 2026-06-09 12:52:40 -07:00
test_build_navigation_goal.py feat: add user context field for credential login testing — backend (#SKY-8074) (#5079) 2026-03-13 02:44:27 +03:00
test_bulk_artifact_creation.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_cached_artifact_bundling.py chore(SKY-11691): relocate artifact-storage tests out of the shipped skyvern package (#7016) 2026-07-02 13:55:57 -04:00
test_cached_download_s3_upload.py fix(SKY-11997,SKY-12004): name session-scoped downloads by configured download_suffix (#7172) 2026-07-07 18:25:29 -05:00
test_cached_script_deploy_service.py fix(SKY-11917): validate script deploy file paths (#7145) 2026-07-06 20:13:38 -05:00
test_caller_context.py feat(tagging): TagsRepository + AgentDB wiring + caller-context auth dep (SKY-10101) (#6205) 2026-05-27 13:22:32 -04:00
test_captcha_solve_timing_prompt.py feat(SKY-10628): improve captcha solve timing before protected submit (#6347) 2026-06-03 15:22:49 +08:00
test_cdp_connection.py feat: support BROWSER_REMOTE_DEBUGGING_CONNECT_HEADERS for default CDP auth headers (#6134) 2026-05-22 23:48:34 -07:00
test_cdp_connection_retry.py feat(SKY-11336): backend support for label rename, recolor, soft-delete (#6819) 2026-06-25 16:52:20 -05:00
test_cdp_download_interceptor.py fix(SKY-11992): capture blob: URL downloads in the CDP download monitor (#7192) 2026-07-08 13:39:27 +08:00
test_cdp_error_detection.py SKY-10576: gate copilot recognition and persistence on runtime outcome evidence, not run status (#6323) 2026-06-01 21:06:04 -07:00
test_chain_click_blocked_anchor_navigation.py SKY-11640: avoid unsafe fallback for blocked anchor clicks (#7042) 2026-07-03 16:53:12 +08:00
test_check_user_goal_llm_override.py feat(experiment): add CHECK_USER_GOAL_LLM_NAME to A/B check-user-goal independently (#6130) 2026-05-22 20:05:48 -07:00
test_classify_metadata_lifecycle.py fix(bitwarden): coerce null username/password/totp to empty string (SKY-8847) (#5936) 2026-05-11 01:34:09 -05:00
test_cleanup_browser_video_path_fallback.py Fix remote browser session recording target reuse (#6919) 2026-06-30 16:46:02 +08:00
test_cli_agent_aware.py feat(SKY-9785): Gemini 3 reasoning_effort experiment (#5968) 2026-05-12 19:34:51 -07:00
test_cli_auth.py Add command-aware env scope resolver (#5928) 2026-05-09 20:15:32 -07:00
test_cli_bootstrap.py [CLI] Handle quickstart Docker cleanup and server extras (#5923) 2026-05-15 14:20:03 +00:00
test_cli_commands.py Fix workflow list query alias (SKY-12016) (#7206) 2026-07-08 13:37:57 -05:00
test_cli_commands_logging.py [SKY-8322] Compact MCP workflow status responses and fix wr lookup (#5084) 2026-03-12 18:47:21 -07:00
test_cli_database.py [CLI] Handle quickstart Docker cleanup and server extras (#5923) 2026-05-15 14:20:03 +00:00
test_cli_doctor.py [Self-host] Add CDP streaming defaults and diagnostics (#5875) 2026-05-07 23:40:27 -07:00
test_cli_no_args_help.py fix(SKY-11119): make skyvern CLI robust to click 8.2+ and lift the click<8.2 pin (#6652) 2026-06-17 01:38:20 -04:00
test_cli_shared_core.py Allow MCP browser sessions to use browser profiles (#6798) 2026-06-24 17:55:12 -04:00
test_cli_telemetry.py SKY-7947 Ship lightweight Skyvern wheel contract (#5823) 2026-05-05 10:54:28 -07:00
test_click_prompt_parameterization.py fix(caching-v2): parameterize click prompts using workflow input params (SKY-9295) (#5689) 2026-04-27 17:27:19 -07:00
test_client_proxy_pin_types.py feat: add residential ISP proxy pinning (#6848) 2026-06-26 15:41:23 -04:00
test_client_pydantic_utilities.py SKY-11182: verify structured run outputs before terminal success (#6751) 2026-06-22 16:09:47 -07:00
test_code_block_downloads.py feat: secure CodeBlock runner package + worker integration (3/3) (#6811) 2026-06-25 08:56:17 -07:00
test_code_block_lint_mcp_tool.py feat(mcp): code-block lint + synthesize tools (Copilot connector, M4) (#7017) 2026-07-02 11:08:39 -07:00
test_code_block_recording_artifact.py Fix remote browser session recording target reuse (#6919) 2026-06-30 16:46:02 +08:00
test_code_block_sandbox.py SKY-8927 Block format-string sandbox escape in code blocks (#7039) 2026-07-02 21:35:24 -05:00
test_code_block_steps.py feat(SKY-11729): migrate self-healing enablement from PostHog to a workflow setting (#7041) 2026-07-02 21:26:20 -07:00
test_code_block_synthesize_mcp_tool.py feat(mcp): code-block lint + synthesize tools (Copilot connector, M4) (#7017) 2026-07-02 11:08:39 -07:00
test_code_block_yaml_parameters.py SKY-11022: reject 'parameters' field on code block YAML (#6587) 2026-06-15 13:03:10 -07:00
test_collect_inherited_workflow_system_prompt.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_complete_verify_goal_unwrap.py fix(SKY-11675): heal to end-of-block and verify heals with action history (#7015) 2026-07-02 10:47:06 -07:00
test_complete_verify_span.py feat(observability): attribute complete_verify span with caller trigger (SKY-10319) (#6431) 2026-06-08 15:17:13 +08:00
test_compute_conditional_scopes.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_conditional_script_caching.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_convert_to_task_extracted_information.py fix(SKY-11825): tolerate non-JSON extracted_information in task read path (#7085) 2026-07-04 21:39:59 -07:00
test_copilot_agent_blocker_renderer.py fix(SKY-11996): restore copilot actuation-obligation feature reverted by #13210 (#7230) 2026-07-08 23:00:59 -07:00
test_copilot_agent_helpers.py fix(SKY-11996): restore copilot actuation-obligation feature reverted by #13210 (#7230) 2026-07-08 23:00:59 -07:00
test_copilot_agent_prompt_chat_history_resolution.py SKY-10346: Preserve continuation blocker signals (PR 8/12) (#6259) 2026-05-29 16:26:34 -07:00
test_copilot_banned_block_policy.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_block_goal_wrapping.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_blocker_lifecycle.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_blocker_signal.py feat(SKY-11879): family-uniform output-contract actuation — no bail returns unchanged (#7141) 2026-07-06 15:48:38 -07:00
test_copilot_build_phase.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_build_test_outcome.py fix(SKY-11899): Copilot fresh-session replay frontier (#7149) 2026-07-07 00:30:42 -07:00
test_copilot_cancel_helpers.py feat(SKY-11879): family-uniform output-contract actuation — no bail returns unchanged (#7141) 2026-07-06 15:48:38 -07:00
test_copilot_chat_history_title.py SKY-11294: forgive a superseded bare-selector imposition drop in code-block authoring (#6743) 2026-06-22 09:54:44 -07:00
test_copilot_code_artifact_metadata_violations.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_code_block_persist_seam.py feat(SKY-11897): typed judgment-evidence grounding — confirm/refute/abstain from independent packet (#7224) 2026-07-08 19:53:47 -07:00
test_copilot_code_block_synthesis.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_code_mode_opt_out.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_completion_criteria_lifecycle.py SKY-11498: Route request-policy classifier through lite Copilot model setting (#7191) 2026-07-07 21:20:33 -07:00
test_copilot_completion_verification.py feat(SKY-11897): typed judgment-evidence grounding — confirm/refute/abstain from independent packet (#7224) 2026-07-08 19:53:47 -07:00
test_copilot_completion_zero_run_plane.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_composition_evidence.py feat(SKY-11842): positive independent-evidence binding for requested-output completion (#7090) 2026-07-05 08:40:19 -07:00
test_copilot_composition_scrape.py refactor: split copilot tools.py (9.5k lines) into a tools/ package (#6493) 2026-06-10 11:19:38 -07:00
test_copilot_context.py SKY-11911 scout fill carry rebind (#7215) 2026-07-08 14:40:40 -07:00
test_copilot_diagnosis_repair_contract.py SKY-11950 typed degraded completion terminal (#7214) 2026-07-08 14:32:07 -07:00
test_copilot_discovery.py SKY-11353: Fix Copilot canonical entrypoint aliases (#6839) 2026-06-25 23:49:23 -07:00
test_copilot_enforcement_hardening.py fix(SKY-11722): carry hollow act-observe on-screen values into the typed build-test outcome (#7088) 2026-07-04 23:18:42 -07:00
test_copilot_enforcement_pruning.py fix(SKY-11996): restore copilot actuation-obligation feature reverted by #13210 (#7230) 2026-07-08 23:00:59 -07:00
test_copilot_evaluate_page_evidence.py fix(SKY-11534): re-perceive grounded click targets after a non-advancing click (#6877) 2026-06-28 14:05:47 -07:00
test_copilot_failure_tracking.py SKY-11181 hard halt on terminal challenge evidence (#6714) 2026-06-19 12:03:59 -07:00
test_copilot_fill_credential_field.py SKY-11911 scout fill carry rebind (#7215) 2026-07-08 14:40:40 -07:00
test_copilot_frontier.py fix(SKY-11899): Copilot fresh-session replay frontier (#7149) 2026-07-07 00:30:42 -07:00
test_copilot_hooks.py SKY-11911 scout fill carry rebind (#7215) 2026-07-08 14:40:40 -07:00
test_copilot_live_session_helper.py SKY-10320: Keep local CDP debugger on live browser (#6297) 2026-05-31 13:54:36 -07:00
test_copilot_loop_detection.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_loop_detection_blocker.py fix(SKY-11495): credit validation review fallback floor (#6897) 2026-06-29 11:51:09 -07:00
test_copilot_make_agent_result_backfill.py feat(SKY-11988): add credentialPrompt signal to copilot narrative payload (#7200) 2026-07-08 18:24:49 +03:00
test_copilot_make_agent_result_sole_use.py SKY-10335: copilot BuildPhase machine + AgentResult writeback factory (#6177) 2026-05-26 12:22:48 -07:00
test_copilot_mcp_adapter_no_progress.py SKY-11818: unify build-scout goal-completeness with the typed requested-output contract (#7081) 2026-07-04 10:21:43 -07:00
test_copilot_mid_correction_guard.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_model_resolver.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_narration.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_narrative_activity.py SKY-11247 render copilot code-seam repair as quiet progress, not repeated chat (#6746) 2026-06-22 14:20:34 -07:00
test_copilot_non_retriable_nav.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
test_copilot_outcome_verification_trace.py SKY-11363: make declared completion-criteria count match the graded set (#6794) 2026-06-24 14:03:49 -07:00
test_copilot_output_contract_actuation.py fix(SKY-11958): fail closed on ambiguous output-contract owner resolution (#7223) 2026-07-08 19:09:29 -07:00
test_copilot_output_policy.py fix(SKY-11996): restore copilot actuation-obligation feature reverted by #13210 (#7230) 2026-07-08 23:00:59 -07:00
test_copilot_output_utils.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_page_evidence_policy.py SKY-11182: verify structured run outputs before terminal success (#6751) 2026-06-22 16:09:47 -07:00
test_copilot_parameter_binding.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_per_tool_budget.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_positive_evidence_carriers.py feat(SKY-11897): typed judgment-evidence grounding — confirm/refute/abstain from independent packet (#7224) 2026-07-08 19:53:47 -07:00
test_copilot_pre_discovery_url_nudge.py fix(SKY-11854): recycle a scouting-only avoidable output-field-confirmation ASK instead of refusing (#7098) 2026-07-05 20:16:19 -07:00
test_copilot_probable_site_block.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_recorded_outcome_grounding.py fix(SKY-11948): consume output-contract grants at dispatch (#7188) 2026-07-07 20:37:34 -07:00
test_copilot_repeated_reply.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_request_policy_completion_criteria.py SKY-12070 mint requested-output criteria for quoted fields (#7227) 2026-07-08 20:54:49 -07:00
test_copilot_request_policy_prompt.py feat(SKY-11897): typed judgment-evidence grounding — confirm/refute/abstain from independent packet (#7224) 2026-07-08 19:53:47 -07:00
test_copilot_request_policy_workflow_credentials.py feat(SKY-11988): add credentialPrompt signal to copilot narrative payload (#7200) 2026-07-08 18:24:49 +03:00
test_copilot_response_coverage_gate.py SKY-11582: Stop repair loops on ungradeable requested-output checks (#6981) 2026-07-01 15:40:21 -07:00
test_copilot_result_evidence.py fix(SKY-11531): Copilot loaded-result evaluate grounding (#6879) 2026-06-28 17:30:17 -07:00
test_copilot_run_outcome_event.py fix(SKY-11854): recycle a scouting-only avoidable output-field-confirmation ASK instead of refusing (#7098) 2026-07-05 20:16:19 -07:00
test_copilot_run_output_content_gate.py fix(SKY-11638): persist Copilot review proof outputs (#7000) 2026-07-01 21:00:11 -07:00
test_copilot_runner_deadline.py SKY-9454 fix copilot timeout WIP rescue (#5789) 2026-05-02 12:43:16 -07:00
test_copilot_runtime.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_scout_act_observe.py SKY-11911 scout fill carry rebind (#7215) 2026-07-08 14:40:40 -07:00
test_copilot_scout_test_value_binding.py SKY-11855: bind scout-proven held-out inputs into copilot build-test runs + producer-recorded required_input_unbound (#7101) 2026-07-05 23:23:07 -07:00
test_copilot_screenshot_handling.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_secret_scrub.py SKY-10863: credential-aware scouting + credential-typed synthesis in code-block mode (#6521) 2026-06-11 12:44:17 -07:00
test_copilot_session_factory.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_copilot_session_injection.py feat(SKY-11729): migrate self-healing enablement from PostHog to a workflow setting (#7041) 2026-07-02 21:26:20 -07:00
test_copilot_signature.py SKY-10130 (2/3): populate TurnOutcome on every AgentResult + typed user-non-progress signal (#6149) 2026-05-24 23:23:58 -07:00
test_copilot_sky11865_mint_satisfiability.py SKY-11865: mint-time satisfiability + typed fail-safe degrade on the classifier-fallback completion producer (#7135) 2026-07-06 14:07:28 -07:00
test_copilot_streaming_adapter.py fix(SKY-11854): recycle a scouting-only avoidable output-field-confirmation ASK instead of refusing (#7098) 2026-07-05 20:16:19 -07:00
test_copilot_terminal_halt_narrative.py SKY-10825: impose code-artifact metadata at the persist seam + adjudicate terminal challenge halts (#6496) 2026-06-10 11:39:23 -07:00
test_copilot_timeout_wip.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_token_accounting.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_tool_loop_error_block_running.py feat(SKY-11879): family-uniform output-contract actuation — no bail returns unchanged (#7141) 2026-07-06 15:48:38 -07:00
test_copilot_tools_credential_id_misbinding.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_tracing_setup.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_turn_context.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_turn_halt.py feat(SKY-11879): family-uniform output-contract actuation — no bail returns unchanged (#7141) 2026-07-06 15:48:38 -07:00
test_copilot_turn_intent.py SKY-11498: Route request-policy classifier through lite Copilot model setting (#7191) 2026-07-07 21:20:33 -07:00
test_copilot_turn_intent_tool_gate.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_copilot_turn_outcome.py revert: light mode v2 token system + hardcode sweep (#10910) (#6163) 2026-05-25 20:43:05 -05:00
test_copilot_turn_span.py feat(tagging): TagsRepository + AgentDB wiring + caller-context auth dep (SKY-10101) (#6205) 2026-05-27 13:22:32 -04:00
test_copilot_typed_value_policy.py SKY-10912 Promote scouted typed values into workflow inputs (#6586) 2026-06-15 12:41:14 -07:00
test_copilot_watchdog.py feat(SKY-11879): family-uniform output-contract actuation — no bail returns unchanged (#7141) 2026-07-06 15:48:38 -07:00
test_copilot_workflow_change_summary.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_cors.py Fix staging preview CORS allowlist (SKY-12074) (#7212) 2026-07-08 16:19:00 -05:00
test_credential_api_response.py fix: remove skyvern/cli from pyupgrade exclude list and fix violations (#5236) 2026-03-25 19:05:41 +03:00
test_credential_rotation.py feat(SKY-8207): consistent egress IP for Save & Reuse Session runs (#7169) 2026-07-07 17:45:11 -04:00
test_credential_test_blocks.py Copilot: carry code artifact metadata (verifier-neutral) (#6439) 2026-06-08 12:57:51 -07:00
test_credential_test_trigger_type.py feat(SKY-11051): back Save & Reuse Session with auto-managed browser profiles (#7032) 2026-07-02 19:35:07 -04:00
test_credential_totp_code.py Improve authenticator setup feedback (#6953) 2026-07-01 00:35:50 -04:00
test_credential_update_params.py feat(SKY-11051): back Save & Reuse Session with auto-managed browser profiles (#7032) 2026-07-02 19:35:07 -04:00
test_credential_vault_type_override.py SKY-11678 Add local credential vault persistence to OSS Docker (#7003) 2026-07-02 21:24:17 +00:00
test_credentials_totp_route_logging.py fix(SKY-11173): support email OTP credentials in Copilot (#6716) 2026-06-19 13:55:02 -07:00
test_css_pseudo_control_visibility.js fix(SKY-11177): harden element-tree scrape against undefined className and isElementVisible recursion (#6697) 2026-06-18 15:14:13 -04:00
test_css_pseudo_control_visibility.py fix(SKY-9402): make zero-rect CSS pseudo-content icon buttons visible (#6385) 2026-06-05 02:40:00 +08:00
test_css_selector.py feat: show all selector options to script reviewer (#5410) 2026-04-07 14:02:36 -07:00
test_custom_credential_client.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_custom_llms.py [codex] Add custom LLM configuration (#6936) 2026-06-30 17:45:45 -04:00
test_data_extraction_summary_cross_run_shadow.py feat(SKY-9639): wire shadow gate to data-extraction-summary cross-run hits (#5947) 2026-05-11 15:42:06 -07:00
test_data_extraction_summary_crossrun_cache.py feat(extraction-cache): wire data-extraction-summary into cross-run cache (SKY-8992) (#5742) 2026-04-30 11:56:29 -07:00
test_data_extraction_summary_schema_cap.py skyvern-cli: clarify skill guidance on workflow-level session toggles (#6111) 2026-05-21 22:56:06 -07:00
test_datepicker_navigation_domutils.js Expose datepicker header navigation controls (#6925) 2026-06-30 17:44:29 +08:00
test_db_engine_connect_args.py perf(SKY-8227): re-add DB pool timeout/recycle knobs and API-only pool sizing (#7159) 2026-07-07 13:16:38 -05:00
test_db_operation_decorator.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_default_persistent_sessions_manager_close.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
test_default_persistent_sessions_manager_evict.py SKY-11246 fix(persistent-browsers): active CDP probe + evict-on-Connection-closed for cached PBS reuse (#6921) 2026-06-30 16:52:23 +08:00
test_default_task_version.py revert: light mode v2 token system + hardcode sweep (#10910) (#6163) 2026-05-25 20:43:05 -05:00
test_deterministic_field_naming.py feat(SKY-8965): Phase 2 — kill LLM synthesis, wire deterministic picker, flip guard to raise (#5596) 2026-04-22 10:38:48 -07:00
test_dialog_handler_records_to_context.py fix(SKY-9471): surface browser dialog rejections to agent prompt (#5810) 2026-05-04 21:07:02 -05:00
test_disabled_descendant_click.py fix(SKY-9178): retarget disabled-wrapper clicks using single-chain rule (#6540) 2026-06-12 15:11:43 +08:00
test_dom_scrape_crash_guards.js fix(SKY-11177): harden element-tree scrape against undefined className and isElementVisible recursion (#6697) 2026-06-18 15:14:13 -04:00
test_dom_scrape_crash_guards.py Expose datepicker header navigation controls (#6925) 2026-06-30 17:44:29 +08:00
test_domutils_deprecated_marker.py perf(SKY-11099): default scrape to skip visual bounding box overlay (#6654) 2026-06-17 15:46:23 +08:00
test_domutils_scroll_helpers_gating.py perf(SKY-11099): default scrape to skip visual bounding box overlay (#6654) 2026-06-17 15:46:23 +08:00
test_download_action_dedup.py fix(SKY-9802): capture XHR inline file downloads during download actions (#6054) 2026-05-19 14:08:09 +08:00
test_download_dedup.py fix(SKY-9871): drop blank late download artifacts (#6017) 2026-05-15 14:11:05 -05:00
test_download_dir_rebind.py Add Google Drive cloud storage uploads (#6884) 2026-06-28 22:39:50 -04:00
test_download_file_action_handler.py fix(SKY-11997,SKY-12004): name session-scoped downloads by configured download_suffix (#7172) 2026-07-07 18:25:29 -05:00
test_download_upload_readiness.py fix(downloads): upload downloads under their final name — wait out the in-flight extension rename (SKY-11849) (#7111) 2026-07-06 07:27:09 -07:00
test_downloaded_file_count.py feat(SKY-11213): mirror file_download block download count to the warehouse (#6717) 2026-06-19 21:12:17 -07:00
test_downloaded_files_artifact_urls.py SKY-10827: persist copilot artifact-metadata violation batches as durable telemetry (#6520) 2026-06-11 12:12:14 -07:00
test_economy_tree_portal_priority.py [oncall] Capture transient download error popups (#6080) 2026-05-20 12:55:16 -07:00
test_element_click_navigation_timeout_skips_fallback.py fix(skyvern): skip click fallbacks after post-dispatch timeout (SKY-10921) (#6569) 2026-06-15 12:23:56 +08:00
test_emerging_elements_prompt_scope.py fix: scope custom-select prompt to new-element subtrees (SKY-9948) (#6055) 2026-05-19 14:45:52 +08:00
test_empty_script_blocks.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_enable_css_svg_parsing.py fix(SKY-9965): verify raw-secret claims with cited evidence (#6087) 2026-05-20 23:55:43 -04:00
test_enrich_tree_flag.py Replace non-vision blob with enrich_tree experiment (#6266) 2026-05-29 22:49:41 -04:00
test_enrich_tree_resolver.py Replace non-vision blob with enrich_tree experiment (#6266) 2026-05-29 22:49:41 -04:00
test_enriched_element_trim.py Replace non-vision blob with enrich_tree experiment (#6266) 2026-05-29 22:49:41 -04:00
test_error_detection_integration.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
test_error_detection_service.py Add user-defined error detection on task failure (#4974) 2026-03-04 15:38:27 +08:00
test_error_type_field.py fix(SKY-10295): scope Copilot credential authority (#6140) 2026-05-23 16:46:00 -07:00
test_evaluate_actionable_target.py SKY-11545: Add recorded outcome spine (#6939) 2026-06-30 16:41:46 -07:00
test_event_metrics.py feat(observability): convert event duration metrics to OTEL histogram (#6606) 2026-06-15 21:53:31 -07:00
test_event_source_stream_disconnect.py fix(SKY-8986): stop SSE disconnect from killing the copilot agent (#5560) 2026-04-20 11:54:32 -07:00
test_exception_messages.py SKY-9651: Clarify diagnostic Copilot routing (#5910) 2026-05-08 17:12:08 -07:00
test_execute_step_exception_handling.py feat(SKY-11767): rotate login credentials across a pool per workflow run (#7053) 2026-07-03 20:08:26 -04:00
test_execute_workflow_resolution.py feat: execute workflow runs against the version stamped at creation (#6942) 2026-06-30 19:35:18 -07:00
test_extract_action_dialog_messages_render.py fix(SKY-9803): inject tab context into extract-action prompt for safe CLOSE_PAGE (#6074) 2026-05-20 16:11:54 +08:00
test_extract_action_open_tabs_context.py fix(SKY-11235): honor "keep exactly N tabs" in task_v2 (curate over-opened tabs + planner tab visibility) (#6838) 2026-06-26 01:01:16 -04:00
test_extract_action_prompt.py feat(SKY-9276): let the v1 planner emit EXTRACT_INFORMATION and GOTO_URL (#6800) 2026-06-24 19:12:08 -04:00
test_extract_actions_ceiling.py fix(SKY-9857): prompt token bloat — hard ceiling enforcement + data_extraction_goal cap (#6098) 2026-05-21 09:55:39 -04:00
test_extract_information_cross_run_shadow.py feat(SKY-9536): wire shadow-mode FP gate to cross-run extraction cache hit path (#5879) 2026-05-07 12:22:39 -07:00
test_extract_information_previous_info_cap.py feat(extraction-cache): cross-run Redis tier (SKY-8873) (#5562) 2026-04-20 16:16:45 -07:00
test_extract_information_retry_bypass.py feat(extraction-cache): cross-run Redis tier (SKY-8873) (#5562) 2026-04-20 16:16:45 -07:00
test_extract_information_text_optout.py fix(sky-8861): close CodeQL py/incomplete-url-substring-sanitization (#5665) 2026-04-25 14:48:39 -07:00
test_extract_information_wpid_fallback.py fix(extraction-cache): resolve wpid via context at cross-run cache sites (SKY-8992) (#5604) 2026-04-22 15:45:43 -07:00
test_extract_template_rendering_in_cached_fn.py fix: resolve workflow parameter templates in cached extraction prompts (#5432) 2026-04-08 17:11:02 -07:00
test_extraction_cache.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_extraction_shadow.py fix(extraction-shadow): follow-up to SKY-8871 — cycle, dead code, comment nits (#5486) 2026-04-13 23:32:20 -05:00
test_fail_fast_shadow.py Fail-fast shadow observability (Phase 0) (#6685) 2026-06-17 22:04:58 -07:00
test_fail_task_error_detection.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_failure_classifier.py feat(SKY-11609): attribute Temporal activity-timeout workflow finalization (#7148) 2026-07-07 15:07:41 +08:00
test_feature_flag_data_hash_cache.py chore: demote noisy high-volume logs to debug (#6024) 2026-05-17 12:01:05 -07:00
test_feature_flag_resolution_logging.py feat: extend feature flag resolution logging to standalone tasks (#5541) 2026-04-17 07:52:02 -07:00
test_fetch_recording_urls.py fix(SKY-11086): don't serve unfinalized per-run recording for session runs (#6641) 2026-06-16 21:39:55 -04:00
test_file_download_access_control.py fix(SKY-11948): consume output-contract grants at dispatch (#7188) 2026-07-07 20:37:34 -07:00
test_file_download_block_warning.py SKY-8818: progressive wait_until for file_download navigation + low max_steps observability (#5431) 2026-04-08 17:01:01 -07:00
test_files_resolve_local_or_download.py fix(SKY-12018): classify external download HTTP errors (#7210) 2026-07-08 14:32:38 -05:00
test_filter_user_defined_codes.py fix(SKY-9425): drop hallucinated failure_category codes from user-defined errors (#5775) 2026-05-01 18:22:45 -04:00
test_finally_block_dag.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_fix_static_actions_in_for_loops.py fix: replace CodeQL-flagged prompt regex in workflow script service [SKY-8311] (#5063) 2026-03-11 20:28:26 -07:00
test_forge_app_initializer.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_forge_log_compaction.py log: compact Action / ActionResult kwargs in structlog pipeline (#5739) 2026-04-30 09:00:10 -07:00
test_forge_log_driver_pipe_noise.py fix(SKY-10886): suppress benign asyncio driver-pipe teardown noise (#6730) 2026-06-20 19:58:40 -05:00
test_forge_log_redaction.py log: silence uvicorn ws spam + redact bearer tokens (#5786) 2026-05-01 18:21:50 -07:00
test_forge_log_sampling.py SKY-11081: require a scout-act before authoring a copilot download block (#6620) 2026-06-16 09:25:23 -07:00
test_forge_log_uvicorn_levels.py log: drop log_level= from uvicorn.run() so ws spam stays silenced (#6046) 2026-05-18 20:37:02 -07:00
test_forloop_child_caching_tracking.py Fix: cache file_download blocks inside for-loops (#5323) 2026-03-31 20:33:45 -07:00
test_forloop_incremental_persist.py [SKY-8767] fix: persist ForLoopBlock output incrementally to survive activity timeouts (#5393) 2026-04-06 13:44:33 -07:00
test_forloop_script_generation.py fix(SKY-9180): prevent SyntaxError from cached for_loop code at module level (#5606) 2026-04-22 18:42:14 -05:00
test_fuzzy_matcher_exact_or_stem.py SKY-11208 collapse normal select fanout (#6878) 2026-06-28 17:08:59 -07:00
test_gcp_credential_vault_service.py fix(SKY-11177): harden element-tree scrape against undefined className and isElementVisible recursion (#6697) 2026-06-18 15:14:13 -04:00
test_get_credentials_query_defaults.py SKY-10578: Add credential folders (backend) (#6375) 2026-06-04 05:43:09 -04:00
test_get_frame_text_scrape_exclude.py feat(captcha): element-tree placeholder for visible Cloudflare Turnstile frames (SKY-11616) (#7102) 2026-07-06 14:24:59 +08:00
test_get_scripts_query.py fix(SKY-10591): use explicit column filter in get_scripts aggregate subquery (#6327) 2026-06-02 14:30:42 +08:00
test_handle_script_termination.py fix(SKY-9568): persist block status on script termination, distinguish complete-reject from intentional terminate (#5862) 2026-05-06 18:51:37 -07:00
test_handle_terminate_action.py fix: harden css-vars.test.ts existsSync filter for OSS sync target (#5852) 2026-05-06 13:58:28 -07:00
test_handler_utils_download_file.py Add ZIP support to FileParserBlock [SKY-11711] (#7049) 2026-07-03 19:44:13 -04:00
test_http_block_raw_filter.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_http_request_script_generation.py SKY-11721: enforce Copilot completion evidence provenance (#7055) 2026-07-03 17:31:46 -07:00
test_hydrate_action_resilience.py fix(SKY-9512): harden hydrate_action against malformed rows (#5856) 2026-05-07 01:22:18 +03:00
test_icon_only_element_serialization.py fix(SKY-9402): preserve class and readable pseudo-text for icon-only navigation elements (#6092) 2026-05-21 17:29:49 +08:00
test_id_generation.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_iframe_e2e.py feat: iframe support for SDK, CLI, and MCP tools (#5319) 2026-03-31 16:10:53 -07:00
test_iframe_mcp_e2e.py feat: iframe support for SDK, CLI, and MCP tools (#5319) 2026-03-31 16:10:53 -07:00
test_iframe_support.py test(SKY-11845): delete verified-redundant unit tests (zero coverage loss) (#7113) 2026-07-06 11:04:47 -04:00
test_image_token_estimator.py feat(SKY-10083): instrument per-call LLM image token + cost metrics (#6382) 2026-06-04 11:44:26 -04:00
test_increment_elements_global_guard.js fix(SKY-11435): guard getIncrementElements against wiped global counter (#6822) 2026-06-25 17:18:46 -05:00
test_increment_elements_global_guard.py fix(SKY-11435): guard getIncrementElements against wiped global counter (#6822) 2026-06-25 17:18:46 -05:00
test_init_command.py revert: light mode v2 token system + hardcode sweep (#10910) (#6163) 2026-05-25 20:43:05 -05:00
test_init_mcp.py fix(SKY-10327): detect PDF embeds in multi-frame pages (#6164) 2026-05-26 13:59:51 +08:00
test_input_text_phone_readback.py SKY-11549: tolerate NANP country-code phone readback (#6901) 2026-06-29 13:34:38 -07:00
test_input_text_search_bar_skip.py fix(SKY-11343): stop action batch after in-INPUT_TEXT combobox selection (#6787) 2026-06-24 10:05:22 -07:00
test_invalid_element_for_text_input_hint.py feat(actions): hint at calendar/picker fallback when input_text rejects a date span (#6923) 2026-06-30 17:07:07 +08:00
test_lean_html.py feat(SKY-10076): drop non-navigable hrefs from the lean element tree (#6461) 2026-06-09 12:52:40 -07:00
test_library_skyvern.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_llm_attribution.py test(SKY-11845): delete verified-redundant unit tests (zero coverage loss) (#7113) 2026-07-06 11:04:47 -04:00
test_llm_handler_tracing.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_llm_output_truncation.py fix(llm): fall back to non-Gemini model on Gemini content_filter (SKY-11766) (#7155) 2026-07-07 07:52:03 -07:00
test_llm_prompt_config.py SKY-11498: Route request-policy classifier through lite Copilot model setting (#7191) 2026-07-07 21:20:33 -07:00
test_llm_response_parsing.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_llm_types_public_shim.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_load_prompt_with_elements_ceiling.py Replace non-vision blob with enrich_tree experiment (#6266) 2026-05-29 22:49:41 -04:00
test_local_file_path_validation.py GCP Self-Host: App-wiring for storage and vault (#6632) 2026-06-16 13:48:17 -07:00
test_local_storage_browser_copy.py fix(SKY-10627): restore session cookies on saved browser profile reuse (#6362) 2026-06-04 00:30:16 +03:00
test_log_artifacts.py feat(SKY-8879) copilot-stack/11: agent orchestrator + prompt (#5529) 2026-04-16 12:13:16 -07:00
test_login_block_credential_emit.py fix(SKY-9340): emit nested credential subscripts at code-emission time (#5750) 2026-04-30 17:05:45 -07:00
test_login_block_credential_proxy_pin.py feat(SKY-8207): consistent egress IP for Save & Reuse Session runs (#7169) 2026-07-07 17:45:11 -04:00
test_login_block_debug_session_profile.py SKY-10819: asymmetric debug-session profile handling for LoginBlock (#6572) 2026-06-15 17:11:31 +08:00
test_login_block_default_navigation_goal.py Fix: apply default login prompt for MCP-created workflow login blocks (#SKY-8637) (#5342) 2026-04-01 17:25:59 -07:00
test_loop_block_output_scoping.py fix: prevent block output from leaking across loop iterations (#SKY-8835) (#5475) 2026-04-14 02:10:16 +08:00
test_loop_next_loop_on_failure_swallow.py feat(SKY-9421): frontend - Wait for browser before Copilot (#5771) 2026-05-01 14:11:30 -07:00
test_magic_link_auto_close.py fix(SKY-8065): improve magic link tab close behavior with prompt fix and code fallback (#5715) 2026-04-29 14:20:15 +08:00
test_masked_prompt.py [CLI] Improve quickstart secret prompt feedback (#5908) 2026-05-08 16:33:10 -04:00
test_mcp_block_tools.py SKY-10944: Add PDF Fill workflow block (local AcroForm + flat-PDF OCR fill) (#6622) 2026-06-16 12:55:52 -04:00
test_mcp_block_type_parity.py SKY-10944: Add PDF Fill workflow block (local AcroForm + flat-PDF OCR fill) (#6622) 2026-06-16 12:55:52 -04:00
test_mcp_browser_extensions.py feat: MCP drag, file upload, evaluate async, tool annotations (#5229) 2026-03-24 18:37:54 -07:00
test_mcp_browser_profiles.py Allow MCP browser sessions to use browser profiles (#6798) 2026-06-24 17:55:12 -04:00
test_mcp_browser_tools.py SKY-11940 MCP browser tool schemas: selector/ref leads, intent is the explicit AI fallback (#7220) 2026-07-08 17:11:30 -07:00
test_mcp_clipboard.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_mcp_commands.py fix(cli): add OpenCode MCP setup with API key auth (#6100) 2026-06-03 17:15:09 +00:00
test_mcp_common.py feat: MCP script/caching tools for code v2 visibility (#5243) 2026-03-25 15:42:53 -07:00
test_mcp_concise_responses.py [SKY-8322] Compact MCP workflow status responses and fix wr lookup (#5084) 2026-03-12 18:47:21 -07:00
test_mcp_dom_inspection.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_mcp_folder_tools.py chore(SKY-9227): prevent Fern SDK drift from breaking workflow block types (#5769) 2026-05-01 13:56:22 -07:00
test_mcp_har_tools.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_mcp_http_auth.py fix(mcp): route empty-API-key 401s to the Configure dialog instead of OAuth (#7203) 2026-07-08 10:41:16 -07:00
test_mcp_inspection.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_mcp_localhost_guard.py feat(copilot): emit the recorded per-run outcome verdict as a typed narrative event (SKY-10873) (#6528) 2026-06-11 17:04:29 -07:00
test_mcp_network_tracking.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_mcp_observe_execute.py fix(SKY-11910): surface custom dropdown options in MCP observe + non-leaking action errors (#7165) 2026-07-07 13:06:12 -07:00
test_mcp_origin_middleware.py fix(SKY-12003): restore hosted /mcp/ connectivity and freeze Docker deps to uv.lock (#7166) 2026-07-07 14:04:05 -07:00
test_mcp_page_errors.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_mcp_response_size_cap.py feat(mcp): [Required for Anthropic Claude Connectors Listing] add tool titles, Origin validation, and response size cap (#5608) 2026-04-22 17:23:59 -07:00
test_mcp_script_caching_live.py fix(SKY-11917): validate script deploy file paths (#7145) 2026-07-06 20:13:38 -05:00
test_mcp_semantic_locators.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_session_lifecycle.py Allow MCP browser sessions to use browser profiles (#6798) 2026-06-24 17:55:12 -04:00
test_mcp_state_tools.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_storage_tools.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_mcp_tab_tools.py Fix ReDoS in script_reviewer string literal regex (#5364) 2026-04-02 15:39:47 -07:00
test_mcp_telemetry.py feat: Add MCP tool call performance telemetry (#5688) 2026-04-27 17:24:50 -07:00
test_mcp_tool_titles.py Add explicit MCP tool safety hints [chat gpt connector - more unblocking] (#5712) 2026-04-28 19:14:56 -07:00
test_mcp_workflow_create_defaults.py feat: default new workflows to run_with="agent" (#6060) 2026-05-19 13:44:37 -07:00
test_mcp_workflow_guidance.py feat(SKY-9785): Gemini 3 reasoning_effort experiment (#5968) 2026-05-12 19:34:51 -07:00
test_mcp_workflow_list_drift.py Fix workflow list query alias (SKY-12016) (#7206) 2026-07-08 13:37:57 -05:00
test_mcp_workflow_route_prefixes.py Add workflow run retry APIs (#6195) 2026-05-27 00:40:39 -04:00
test_mcp_workflow_tools.py fix(mcp): preserve non-credential parameter↔block links on workflow edits (SKY-11467) (#6813) 2026-06-25 09:59:05 -07:00
test_missing_starter_url.py Avoid inherited blank page workflow URLs (#7001) 2026-07-02 00:36:11 -04:00
test_missing_totp_source.py fix(SKY-9178): prefer credential TOTP before webhook polling for OTP (#6451) 2026-06-09 23:26:03 +08:00
test_multi_field_totp.py Add authenticator QR upload support (#6882) 2026-06-28 22:01:23 -04:00
test_multi_placeholder_secret_resolution.py SKY-11721: enforce Copilot completion evidence provenance (#7055) 2026-07-03 17:31:46 -07:00
test_navigation_action_handlers.py feat(SKY-9276): let the v1 planner emit EXTRACT_INFORMATION and GOTO_URL (#6800) 2026-06-24 19:12:08 -04:00
test_navigation_in_forloop_codegen.py fix: use dynamic selectors for navigation blocks inside for-loops (#5434) 2026-04-08 17:47:29 -07:00
test_navigation_in_while_loop_codegen.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_navigation_recovery.py fix(scraper): use networkidle settle for Auth0 form_post redirect recovery (SKY-9470) (#6035) 2026-05-19 01:06:58 +08:00
test_nested_forloop_caching_tracking.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_nested_forloop_script_generation.py fix: nested for-loop script block persistence (SKY-8757) (#5404) 2026-04-07 10:38:48 -07:00
test_nested_loop_output_parameters.py feat(SKY-8771): backend WhileLoopBlock (PR 1 of 7) (#5703) 2026-04-28 11:37:52 -07:00
test_nested_while_loop_script_generation.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_ngrok_helpers.py Add interactive ngrok guided setup for browser serve --tunnel (#4986) 2026-03-04 17:38:27 -08:00
test_no_available_option.py fix(SKY-12013): return missing dropdown target failures (#7195) 2026-07-08 03:32:57 -05:00
test_no_direct_db_delegates.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_no_fill_form_in_adaptive_codegen.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_normal_select_deterministic.py SKY-11208 collapse normal select fanout (#6878) 2026-06-28 17:08:59 -07:00
test_onboarding_milestone_hooks.py refactor: split copilot tools.py (9.5k lines) into a tools/ package (#6493) 2026-06-10 11:19:38 -07:00
test_org_auth_credential_clear_routes.py refactor: split copilot tools.py (9.5k lines) into a tools/ package (#6493) 2026-06-10 11:19:38 -07:00
test_org_auth_service.py fix(SKY-11948): consume output-contract grants at dispatch (#7188) 2026-07-07 20:37:34 -07:00
test_organization_update_schema.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_otp_service.py Improve authenticator 2FA credential setup (SKY-6598) (#6783) 2026-06-24 00:01:02 -04:00
test_otp_service_redaction.py fix(SKY-11173): support email OTP credentials in Copilot (#6716) 2026-06-19 13:55:02 -07:00
test_output_parameter_size_guards.py fix: strip NUL bytes from JSON columns before persisting (#6091) 2026-05-20 22:24:28 -07:00
test_page_ready_networkidle_tolerance.py fix: tolerate networkidle readiness failures (SKY-11613) (#7006) 2026-07-02 17:53:33 +08:00
test_parallel_verification.py SKY-10620: Route data-only validation without page evidence (#6960) 2026-07-01 17:39:00 +08:00
test_parameter_reference_guard.py Revert #10280 — accidental mass deletion of copilot code (#5525) 2026-04-15 23:20:37 -07:00
test_parse_totp_secret.py Add authenticator QR upload support (#6882) 2026-06-28 22:01:23 -04:00
test_partition_cached_blocks_batching.py fix: speed up workflow save cache invalidation (#6881) 2026-06-28 21:58:24 -04:00
test_pdf_download_fixes.py fix(SKY-10327): skip duplicate PDF viewer auto-download to unblock LLM actions (#6314) 2026-06-02 02:17:05 +08:00
test_pdf_fill_block.py Add ZIP support to FileParserBlock [SKY-11711] (#7049) 2026-07-03 19:44:13 -04:00
test_pending_file_chooser.py fix(SKY-9334): defer file chooser listener across steps for two-step uploads (#5937) 2026-05-11 15:07:13 +08:00
test_persistent_session_reaper.py fix(SKY-11242): reap idle persistent browser sessions to free leaked Chromium + ffmpeg (#6843) 2026-06-26 12:01:18 -05:00
test_phantom_script_block_entries.py fix: skip script_block entries for blocks with no actions (#SKY-8443) (#5141) 2026-03-18 23:24:57 -07:00
test_print_page_block_downloaded_files.py refactor: split copilot tools.py (9.5k lines) into a tools/ package (#6493) 2026-06-10 11:19:38 -07:00
test_prompt_caching_settings.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_prompt_token_breakdown.py [SKY-9718] log html_token_count + html_pct on LLM duration metrics (#5918) 2026-05-08 19:15:09 -07:00
test_prompt_truncation.py ci(SKY-12002): unbind pytest-shard critical path from two outlier tests (#7208) 2026-07-08 15:08:02 -04:00
test_proxy_location_defaults.py SKY-11087 Default unset runtime proxy to none (#6634) 2026-06-16 15:18:29 -07:00
test_proxy_url_custom.py feat(SKY-11348): gate 720p browser recording behind PostHog flag (#6968) 2026-07-01 12:24:49 -07:00
test_qa_skill_content.py chore: update qa evidence signed Linear flow (#7071) 2026-07-04 02:07:14 -04:00
test_quickstart.py fix(SKY-10327): detect PDF embeds in multi-frame pages (#6164) 2026-05-26 13:59:51 +08:00
test_quickstart_browser_install.py fix(SKY-10327): detect PDF embeds in multi-frame pages (#6164) 2026-05-26 13:59:51 +08:00
test_quickstart_command.py fix(SKY-10327): detect PDF embeds in multi-frame pages (#6164) 2026-05-26 13:59:51 +08:00
test_quickstart_server_extra.py fix(SKY-10327): detect PDF embeds in multi-frame pages (#6164) 2026-05-26 13:59:51 +08:00
test_read_blob_url_bytes.py fix(SKY-11992): capture blob: URL downloads in the CDP download monitor (#7192) 2026-07-08 13:39:27 +08:00
test_real_browser_manager.py fix(SKY-11500): drop the throwaway default-tab recording (#7123) 2026-07-06 19:37:21 +03:00
test_real_browser_manager_frame_publisher.py SKY-10723: Add worker-side CDP livestream publishing (#6895) 2026-06-30 02:19:41 +08:00
test_real_browser_manager_publisher_self_stops_on_close.py SKY-10723: Add worker-side CDP livestream publishing (#6895) 2026-06-30 02:19:41 +08:00
test_real_browser_manager_publisher_start_race.py SKY-10723: Add worker-side CDP livestream publishing (#6895) 2026-06-30 02:19:41 +08:00
test_real_browser_state_active_page.py Avoid inherited blank page workflow URLs (#7001) 2026-07-02 00:36:11 -04:00
test_real_browser_state_discards_orphaned_tab_video.py fix(SKY-11500): drop the throwaway default-tab recording (#7123) 2026-07-06 19:37:21 +03:00
test_real_browser_state_existing_page_reuse.py Fix remote browser session recording target reuse (#6919) 2026-06-30 16:46:02 +08:00
test_real_browser_state_navigate.py SKY-10562 Ground Copilot block authoring in observations (#6363) 2026-06-03 17:13:04 -07:00
test_real_browser_state_on_close_hook.py SKY-10723: Add worker-side CDP livestream publishing (#6895) 2026-06-30 02:19:41 +08:00
test_real_browser_state_reload.py fix(SKY-10476): add waitUntil degradation to extraction scrape reload (#6304) 2026-06-01 17:01:08 +08:00
test_recording_window_filter.py feat(tagging): Phase 6.1 backend — key-optional labels + flexible tag filter (SKY-10683) (#6458) 2026-06-09 14:51:18 -04:00
test_remote_cdp_driver_release.py fix(SKY-7996): release local Playwright driver for remote-CDP browser states (#7084) 2026-07-04 21:21:37 -07:00
test_remove_bounding_boxes_polyfill.js SKY-10691: harden removeBoundingBoxes against Prototype.js-style remove() polyfill (#6609) 2026-06-16 14:43:55 +08:00
test_remove_bounding_boxes_polyfill.py SKY-10691: harden removeBoundingBoxes against Prototype.js-style remove() polyfill (#6609) 2026-06-16 14:43:55 +08:00
test_render_list.py feat: add fallback episode API endpoints (#4997) 2026-03-05 14:32:24 -08:00
test_request_logging.py fix(SKY-11132): handle ClientDisconnect in raw-request logging middleware (#6659) 2026-06-17 08:51:22 -04:00
test_resolve_otp_value.py feat(tagging): Phase 6.1 backend — key-optional labels + flexible tag filter (SKY-10683) (#6458) 2026-06-09 14:51:18 -04:00
test_run_commands_cleanup.py fix: move opentelemetry-sdk to dev group so OSS CI can run tracing test (#5539) 2026-04-16 21:01:38 -07:00
test_run_recording_clips.py refactor: split copilot tools.py (9.5k lines) into a tools/ package (#6493) 2026-06-10 11:19:38 -07:00
test_run_response_types.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_run_sdk_action_failures.py fix: map ai_click operational failures to 422 on /v1/sdk/run_action (#6065) 2026-05-19 21:08:22 -04:00
test_run_task_prompt_parameterization.py Fix PII leakage in cached run_task() prompts (#SKY-7989) (#4744) 2026-02-13 12:16:45 -08:00
test_runs_v2_route.py feat(SKY-11767): rotate login credentials across a pool per workflow run (#7053) 2026-07-03 20:08:26 -04:00
test_sanitization.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_saved_session_proxy_pin.py feat(SKY-8207): consistent egress IP for Save & Reuse Session runs (#7169) 2026-07-07 17:45:11 -04:00
test_schedule_cli.py feat: workflow schedule management via MCP tools and skyvern schedule CLI (#5713) 2026-04-28 19:39:17 -07:00
test_schedule_mcp_tools.py feat: workflow schedule management via MCP tools and skyvern schedule CLI (#5713) 2026-04-28 19:39:17 -07:00
test_scoped_xhr_download_capture.py fix: broaden CDP download interceptor to capture XHR file responses with generic binary MIME types (#7153) 2026-07-07 20:00:07 +08:00
test_scrape_default_no_overlay.py perf(SKY-11099): default scrape to skip visual bounding box overlay (#6654) 2026-06-17 15:46:23 +08:00
test_scrape_frame_decision.py feat(captcha): element-tree placeholder for visible Cloudflare Turnstile frames (SKY-11616) (#7102) 2026-07-06 14:24:59 +08:00
test_scrape_span_attrs.py feat(observability): coarse scrape attribution on skyvern.agent.scrape span (SKY-10319) (#6482) 2026-06-10 16:11:06 +08:00
test_scraper_shadow_text.js fix(SKY-11360): extract shadow root direct text nodes in getElementText (#6791) 2026-06-25 01:42:49 +08:00
test_scraper_shadow_text.py fix(SKY-11360): extract shadow root direct text nodes in getElementText (#6791) 2026-06-25 01:42:49 +08:00
test_scraper_wait_for_scrape_ready.py fix(SKY-10191): allow selecting credential when editing a parameter (#6155) 2026-05-25 11:14:55 -04:00
test_screenshot_attribution.py perf(SKY-10319): add action_type/step_order attrs to post-action screenshot spans (#6399) 2026-06-05 16:20:06 +08:00
test_script_block_creation.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_script_block_dedup.py Optimize caching: content dedup, recursive for-loop tracking, observability (SKY-8684) (#5371) 2026-04-03 12:38:39 -07:00
test_script_block_extractor.py Add cached script deploy dry-run primitives (#6012) 2026-05-15 09:27:20 -07:00
test_script_file_paths.py fix(SKY-11917): validate script deploy file paths (#7145) 2026-07-06 20:13:38 -05:00
test_script_generation_race_condition.py feat(SKY-8965): Phase 2 — kill LLM synthesis, wire deterministic picker, flip guard to raise (#5596) 2026-04-22 10:38:48 -07:00
test_script_mode_browser_url.py fix(SKY-10452): select proxy from first block URL before script SDK creates browser (#6306) 2026-06-01 07:14:06 -07:00
test_script_review_cap.py Document v3 reviewer architecture and boundary (#6188) 2026-05-26 17:27:59 -07:00
test_script_reviewer_consolidation.py copilot enforcement: drain post-run screenshot only when a nudge fires (SKY-9480) (#5807) 2026-05-04 18:58:07 -07:00
test_script_reviewer_extract.py fix(SKY-9430): bypass parse_api_response for reviewer LLM calls (#5781) 2026-05-01 16:41:30 -07:00
test_script_reviewer_quality.py test(SKY-11847): case-table the script-reviewer validator tests (118→46, coverage-identical) (#7119) 2026-07-06 11:42:47 -04:00
test_script_reviewer_terminate.py feat: teach script reviewer about page.terminate() with conditional-only rule (SKY-8334) (#5097) 2026-03-13 14:11:16 -07:00
test_script_reviewer_validators.py test(SKY-11847): case-table the script-reviewer validator tests (118→46, coverage-identical) (#7119) 2026-07-06 11:42:47 -04:00
test_script_service_loop_download_filter.py fix(SKY-9704): restore legacy loop block output shape on cached path (#5938) 2026-05-11 16:31:33 +03:00
test_script_skyvern_page.py SKY-11111: dispatch input/change events on credential-fill so JS-gated multi-step logins advance (#6650) 2026-06-16 21:53:30 -07:00
test_script_validators.py test(SKY-11845): delete verified-redundant unit tests (zero coverage loss) (#7113) 2026-07-06 11:04:47 -04:00
test_scroll_guard.py Fix: guard scroll_to_top/scroll_to_next_page against non-numeric JS returns (#5170) 2026-03-20 13:19:44 +08:00
test_scrolling_screenshots_skip_overlay.py perf(SKY-11099): default scrape to skip visual bounding box overlay (#6654) 2026-06-17 15:46:23 +08:00
test_sdf_select_filter_visibility.js fix(SKY-11177): harden element-tree scrape against undefined className and isElementVisible recursion (#6697) 2026-06-18 15:14:13 -04:00
test_sdf_select_filter_visibility.py fix(SKY-9402): skip force-visible for shadow DOM inputs in closed dropdowns (#6433) 2026-06-08 17:15:54 +08:00
test_sdk_run_metadata.py Bump version to 1.0.45 (#7167) 2026-07-07 22:18:31 +00:00
test_search_dropdown_post_input.py fix(SKY-8316): select filtered search dropdown options (#6348) 2026-06-03 15:30:08 +08:00
test_secret_credentials.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_security.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_security_headers.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
test_select_shadow_match.py SKY-11570 log shadow-match disagreement details (#7027) 2026-07-02 14:02:29 -07:00
test_selector_retry.py fix: retry selector lookup before falling back to AI in cached scripts (#5385) 2026-04-05 13:55:47 -07:00
test_self_host_artifact_url_fallback.py chore(SKY-11691): relocate artifact-storage tests out of the shipped skyvern package (#7016) 2026-07-02 13:55:57 -04:00
test_session_cookies.py fix(SKY-10627): restore session cookies on saved browser profile reuse (#6362) 2026-06-04 00:30:16 +03:00
test_setup_ai_env.py SKY-7947 Ship lightweight Skyvern wheel contract (#5823) 2026-05-05 10:54:28 -07:00
test_setup_commands.py Add MCP API key switcher for local clients [SKY-8218] (#5060) 2026-03-11 16:23:31 -07:00
test_setup_hermes.py Add command-aware env scope resolver (#5928) 2026-05-09 20:15:32 -07:00
test_setup_openclaw.py chore: remove references (#6210) 2026-05-27 13:07:25 -07:00
test_setup_opencode.py fix(cli): add OpenCode MCP setup with API key auth (#6100) 2026-06-03 17:15:09 +00:00
test_setup_quickstart.py Fix OSS frontend build: add useFeatureFlag stub (#5042) 2026-03-10 23:36:42 -07:00
test_shadow_form_input_visibility.py fix(SKY-9402): always include native form inputs inside shadow DOM in visibility check (#6165) 2026-05-26 14:26:36 +08:00
test_should_run_script.py feat(SKY-10211): gate code-mode dispatch on CACHING_ROLLOUT flag (#6181) 2026-05-26 13:56:15 -07:00
test_skyvern_context_dialog_messages.py fix(SKY-9471): surface browser dialog rejections to agent prompt (#5810) 2026-05-04 21:07:02 -05:00
test_skyvern_credential_vault_service.py SKY-11678 Add local credential vault persistence to OSS Docker (#7003) 2026-07-02 21:24:17 +00:00
test_slim_llm_output.py feat(SKY-10075): exempt check-user-goal from output slimming (extract-actions-only relaunch) (#6468) 2026-06-09 14:59:27 -07:00
test_smoke_test_skill_content.py docs: update smoke-test skill with Chrome DevTools MCP and screenshot evidence (#6193) 2026-05-26 23:14:35 -05:00
test_soft_delete.py Create @db_operation error handling decorator (#SKY-8135) (#5272) 2026-03-27 14:14:45 -07:00
test_static_script_infrastructure.py Add mode='direct' to SkyvernPage click/fill for static script action recording (#5264) 2026-03-26 20:05:20 -07:00
test_step_archive_accumulator.py chore(SKY-11691): relocate artifact-storage tests out of the shipped skyvern package (#7016) 2026-07-02 13:55:57 -04:00
test_step_goal_achieved.py feat(SKY-9276): let the v1 planner emit EXTRACT_INFORMATION and GOTO_URL (#6800) 2026-06-24 19:12:08 -04:00
test_stream_ref_dec_no_publisher_access.py SKY-10723: Add worker-side CDP livestream publishing (#6895) 2026-06-30 02:19:41 +08:00
test_strip_query_params.py feat(SKY-8879) copilot-stack/12: wire-up (flag + dispatch + frontend) (#5531) 2026-04-16 17:25:07 -07:00
test_summarize_output.py fix(prompts): bound output_json nesting depth version-independently (#6467) 2026-06-09 17:55:54 -04:00
test_sync_video_artifact_after_step.py fix(SKY-9113): skip ffmpeg remux on per-step video sync (#5559) 2026-04-20 11:44:19 -07:00
test_tab_action_handlers.py fix(SKY-11235): honor "keep exactly N tabs" in task_v2 (curate over-opened tabs + planner tab visibility) (#6838) 2026-06-26 01:01:16 -04:00
test_tag_endpoints.py fix(SKY-11536): gate WORKFLOW_TAGGING on shared workflow-tag filter endpoints (#6896) 2026-06-29 13:35:17 -05:00
test_tag_filters.py feat(SKY-11334): accept all 3 tag-filter shapes on analytics summary (BE) (#6786) 2026-06-24 11:44:57 -05:00
test_tag_schemas.py feat(tagging): Phase 6.1 backend — key-optional labels + flexible tag filter (SKY-10683) (#6458) 2026-06-09 14:51:18 -04:00
test_tag_validators.py feat(tagging): Phase 6.1 backend — key-optional labels + flexible tag filter (SKY-10683) (#6458) 2026-06-09 14:51:18 -04:00
test_tags_repository.py Add workflow run tag event data layer (#7204) 2026-07-08 13:12:20 -05:00
test_task_request_validation.py fix(SKY-9857): prompt token bloat — hard ceiling enforcement + data_extraction_goal cap (#6098) 2026-05-21 09:55:39 -04:00
test_task_run_status_sync.py SKY-11702 Migrate workflow params AgentDB callers (#7026) 2026-07-02 16:12:03 -04:00
test_task_runs_sync_activity.py fix: teach script reviewer to detect hardcoded per-run values in selectors (#5325) 2026-03-31 21:27:50 -07:00
test_task_v2_failure_deliverable.py fix(SKY-11238): emit best-effort task_v2 deliverable on budget exhaustion (#6778) 2026-06-23 19:01:02 -04:00
test_task_v2_loop_parameter_keys.py fix(SKY-10979): dedupe generated workflow parameter keys to prevent duplicate-key hard-fail (#6543) 2026-06-12 10:29:07 -04:00
test_task_v2_max_iterations.py fix(SKY-10934): honor the task_v2 max_iterations override (#6544) 2026-06-12 11:15:25 -04:00
test_task_v2_navigate_extracted_data.py fix(SKY-11112): credit data captured inside a navigate block in task_v2 (#6698) 2026-06-18 15:14:27 -04:00
test_task_v2_open_tabs_context.py fix(SKY-11235): honor "keep exactly N tabs" in task_v2 (curate over-opened tabs + planner tab visibility) (#6838) 2026-06-26 01:01:16 -04:00
test_task_v2_per_tab_screenshots.py feat(SKY-11227): capture end-state per-tab screenshots at task_v2 completion (#6777) 2026-06-23 18:33:23 -04:00
test_task_v2_task_run_creation.py AgentDB Phase 7: Migrate remaining 8 domains to typed repos (#5366) 2026-04-02 17:36:50 -07:00
test_taskv2_block_browser_address_propagation.py fix(SKY-9282): forward browser connection fields from TaskV2Block to child run (#6750) 2026-06-22 19:03:52 -04:00
test_taskv2_block_context_preservation.py feat: extend feature flag resolution logging to standalone tasks (#5541) 2026-04-17 07:52:02 -07:00
test_taskv2_block_downloaded_files.py test(SKY-11845): delete verified-redundant unit tests (zero coverage loss) (#7113) 2026-07-06 11:04:47 -04:00
test_tel_input_bare_digits.py SKY-11315 fix tel digit-drop by typing bare NANP digits (#6826) 2026-06-25 18:10:29 -07:00
test_template_input_sanitization.py feat(SKY-10076): drop non-navigable hrefs from the lean element tree (#6461) 2026-06-09 12:52:40 -07:00
test_text_prompt_block.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
test_text_prompt_block_yaml.py fix: self-hosted model keys resolve to unregistered fallback configs (#5099) 2026-03-13 15:06:27 -07:00
test_totp_identifier_fallback.py Add authenticator QR upload support (#6882) 2026-06-28 22:01:23 -04:00
test_transient_page_observer.py [oncall] Capture transient download error popups (#6080) 2026-05-20 12:55:16 -07:00
test_upload_file_url_recovery.py fix(SKY-9151): recover LLM-corrupted upload URLs in handle_upload_file_action (#5610) 2026-04-22 19:42:42 -05:00
test_upload_file_wait.py perf(SKY-10319): replace fixed upload-file sleeps with page readiness wait (#6305) 2026-06-01 17:04:05 +08:00
test_upload_pending_action_history.py fix(SKY-9402): add needs_followup + followup_message for deferred upload action history (#6198) 2026-05-27 14:13:39 +08:00
test_url_validators.py fix(SKY-11948): consume output-contract grants at dispatch (#7188) 2026-07-07 20:37:34 -07:00
test_utils_templating.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_validation_error_formatting.py Re-apply SKY-7366: Improve 422 error messages for workflow save (#4852) 2026-02-24 00:55:29 +03:00
test_validation_evidence_router.py SKY-10620: Route data-only validation without page evidence (#6960) 2026-07-01 17:39:00 +08:00
test_validation_evidence_router_prompts.py SKY-10620: Route data-only validation without page evidence (#6960) 2026-07-01 17:39:00 +08:00
test_validation_evidence_router_resolver.py SKY-10620: Route data-only validation without page evidence (#6960) 2026-07-01 17:39:00 +08:00
test_validation_evidence_router_wiring.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
test_validation_span_attrs.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_validation_without_page_information.py fix(SKY-10708): thread loop value into cached-block agent fallback payload (#7221) 2026-07-08 20:02:20 -05:00
test_verification_span_attrs.py chore(ci): consolidate pytest config into pytest.ini + sync to OSS (#5628) 2026-04-23 15:10:41 -07:00
test_verification_trigger.py feat(observability): attribute complete_verify span with caller trigger (SKY-10319) (#6431) 2026-06-08 15:17:13 +08:00
test_verifier_goal_unwrap.py fix(SKY-11675): heal to end-of-block and verify heals with action history (#7015) 2026-07-02 10:47:06 -07:00
test_vertex_cache_model_extraction.py Remove setup.sh in favor of skyvern CLI (#4737) 2026-02-12 20:43:27 -08:00
test_video_utils.py refactor: split copilot tools.py (9.5k lines) into a tools/ package (#6493) 2026-06-10 11:19:38 -07:00
test_wait_config_inter_action.py perf(SKY-10319): make inter-action delay experiment-controllable (#6199) 2026-05-27 14:22:15 +08:00
test_webhook_delivery_retry.py feat(SKY-11846): shared test-fixture library slice + first consolidation exemplars (#7114) 2026-07-06 11:06:40 -04:00
test_webhook_timestamps.py revert(SKY-11055): remove workflow webhook-delivery hardening (#11731) (#6758) 2026-06-22 20:17:36 -07:00
test_while_loop_block.py feat(SKY-8771): frontend support for while_loop block (#5809) 2026-05-04 19:05:33 -07:00
test_while_loop_incremental_persist.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_while_loop_script_generation.py feat(SKY-8771): while_loop script generation and caching (#5869) 2026-05-07 00:05:44 -07:00
test_worker_cdp_frame_publisher.py SKY-10723: Add worker-side CDP livestream publishing (#6895) 2026-06-30 02:19:41 +08:00
test_workflow_browser_profile_id.py feat(SKY-8207): consistent egress IP for Save & Reuse Session runs (#7169) 2026-07-07 17:45:11 -04:00
test_workflow_copilot_cancel.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_workflow_copilot_chain_repair.py fix: use started_at for run history duration calculation (#5094) 2026-03-13 13:04:43 -07:00
test_workflow_copilot_credential_refusal.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_workflow_copilot_diagnostic_intent.py fix(SKY-9821): consolidate copilot ask edit routing (#5986) 2026-05-13 17:52:29 -07:00
test_workflow_copilot_llm_config.py Add workflow-copilot lite LLM env key (#7194) 2026-07-07 23:46:19 -07:00
test_workflow_copilot_prompt_injection.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_workflow_copilot_route.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_workflow_copilot_route_helpers.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_workflow_copilot_session_context.py test: consolidate copilot unit tests (−1,346 lines, coverage-preserving) (#7073) 2026-07-04 01:35:09 -07:00
test_workflow_copilot_workflow_state.py fix(SKY-9650): hydrate Copilot workflow state (#5889) 2026-05-07 18:17:53 -07:00
test_workflow_definition_version_inference.py fix(SKY-10988): preserve conditional routing in v1-stored workflows (#6760) 2026-06-22 22:32:15 -05:00
test_workflow_elapsed_timeout.py feat(SKY-8207): consistent egress IP for Save & Reuse Session runs (#7169) 2026-07-07 17:45:11 -04:00
test_workflow_error_code_mapping_inheritance.py feat: add workflow-level inherited error_code_mapping (SKY-8855) (#5506) 2026-04-14 20:28:19 -05:00
test_workflow_onepassword_errors.py fix(SKY-11948): consume output-contract grants at dispatch (#7188) 2026-07-07 20:37:34 -07:00
test_workflow_parameter_validation.py test(SKY-11847): matrix workflow-parameter-validation tests (65→28, coverage-identical) (#7133) 2026-07-06 14:44:03 -04:00
test_workflow_persist_code_only.py feat(mcp): enforce code-only mode on workflow persist path (connector, M4) (#6998) 2026-07-01 20:08:10 -07:00
test_workflow_run_context_eviction.py fix(SKY-7996): release local Playwright driver for remote-CDP browser states (#7084) 2026-07-04 21:21:37 -07:00
test_workflow_run_detail_after_workflow_delete.py fix(SKY-9185): keep run detail page accessible after workflow delete (BE) (#5776) 2026-05-01 18:36:56 -04:00
test_workflow_run_detail_template_cross_org.py fix(SKY-11882): resolve run-detail workflow via run join so template runs don't 404 (#7105) 2026-07-06 03:58:19 -04:00
test_workflow_run_parameter_batching.py feat(SKY-11051): back Save & Reuse Session with auto-managed browser profiles (#7032) 2026-07-02 19:35:07 -04:00
test_workflow_run_step_budget.py SKY-9488: extract SDK run schema types (#5837) 2026-05-06 13:15:01 -07:00
test_workflow_runs_repository_refresh.py fix: refresh expired model in update_workflow_run_if_not_final (#6655) 2026-06-17 16:09:03 +08:00
test_workflow_schedule_service.py Enable OSS workflow schedules (#6344) 2026-06-02 22:48:28 -04:00
test_workflow_schema_field_preservation.py feat(SKY-8965): Phase 2 — kill LLM synthesis, wire deterministic picker, flip guard to raise (#5596) 2026-04-22 10:38:48 -07:00
test_workflow_script_cache_key_resolution.py Add cached script deploy dry-run primitives (#6012) 2026-05-15 09:27:20 -07:00
test_workflow_service_cancel.py fix(SKY-11882): resolve run-detail workflow via run join so template runs don't 404 (#7105) 2026-07-06 03:58:19 -04:00
test_workflow_service_managed_browser_profile.py feat(SKY-8207): consistent egress IP for Save & Reuse Session runs (#7169) 2026-07-07 17:45:11 -04:00
test_workflow_service_profile_writeback.py feat(SKY-11051): back Save & Reuse Session with auto-managed browser profiles (#7032) 2026-07-02 19:35:07 -04:00
test_workflow_system_prompt_llm_forwarding.py fix(SKY-11793): remove non-sandboxed second render in TextPromptBlock (SSTI) (#7137) 2026-07-06 16:44:03 -05:00
test_workflow_trigger_script_generation.py Fix: support WorkflowTriggerBlock in cached scripts (#SKY-8575) (#5320) 2026-03-31 17:01:50 -07:00
test_workflow_webhook_delivery.py revert(SKY-11055): remove workflow webhook-delivery hardening (#11731) (#6758) 2026-06-22 20:17:36 -07:00
test_workflows_list_tag_filter.py fix(SKY-11536): gate WORKFLOW_TAGGING on shared workflow-tag filter endpoints (#6896) 2026-06-29 13:35:17 -05:00
test_yaml_loader_no_dates.py feat(SKY-11729): migrate self-healing enablement from PostHog to a workflow setting (#7041) 2026-07-02 21:26:20 -07:00