mirror of
https://github.com/unslothai/unsloth.git
synced 2026-08-23 15:53:46 +00:00
2043c734c4
Over 400 completed main push runs, 25 of 96 job types execute in under 120s: 1116s of work spread across 25 runners, each queuing for about three hours. Two of them are dealt with here. Security audit :: pytest tests/security 72s exec, 11096s queue Unsloth export capability :: capability (ubuntu-latest) 67s exec, 10642s queue Different problems, so different treatments. The security suite MOVED, onto the Workflow trigger lint runner ------------------------------------------------------------------------ Same argument that put the lockfile and load-orchestrator lanes into Lint CI in #9176: work with a narrow trigger, moved into a job that was going to occupy a runner on this commit anyway, can only reduce the slots a commit takes. Here the trigger widens too, since this host has no paths filter and security-audit.yml's pull_request does, so the suite now runs on every pull request rather than on the ones that touch its paths. This host and NOT Lint CI, where the other lanes went, and that is the whole decision. Lint CI installs shellcheck from apt, so its harden-runner has to permit escalation and an apt mirror; a security gate moved there would run under a policy weaker than the one it has today. Workflow trigger lint's harden-runner block is byte-for-byte identical to the one the job carried in security-audit.yml (block, disable-sudo, the same six endpoints), so nothing about its isolation changes. harden-runner binds per runner, not per step, which is what makes that the deciding constraint rather than a detail. Folded into the existing pytest invocation rather than added as a step of its own. I wrote it as a separate step first, so a security regression would not be reported as a workflow-guard failure, and test_the_guards_run_in_one_pytest_invocation rejected it: one step per module costs about 15s of interpreter and conftest startup, measured in this repo at 53.9s as one invocation against 300.8s as one each. The guard is right and the attribution preference is not worth 15s. pytest and PyYAML are now pinned here to the versions security-audit.yml pinned them to. That suite runs scripts/lint_workflow_triggers.py as a SUBPROCESS and asserts on its exit semantics, so a pytest or PyYAML that resolves differently changes what it is asserting against. The capability ubuntu leg was DELETED, because it was already duplicated ------------------------------------------------------------------------ That workflow's own comment already explains why it has no macOS leg: every test in tests/test_export_capability.py goes through _patch(), which monkeypatches _has_torch, get_device and is_apple_silicon, so a real Mac proves nothing a Linux runner does not -- and studio-backend-ci.yml runs the same file on ubuntu-latest as part of `pytest tests/`. That argument reaches one step further than it was taken. If Backend CI covers the file on Linux, the ubuntu leg HERE is the duplicate too. Checked: the file is not in that job's --ignore list. The import-safety test does not need a torch-free image either; it installs its own builtins.__import__ blocker and drops preloaded torch/unsloth from sys.modules, so it proves the same thing inside Backend CI's fully installed environment. Windows stays. Nothing else in CI runs that file there, and _has_torch's import probe is the per-OS behaviour the job exists for. The guard ------------------------------------------------------------------------ tests/studio/test_short_job_absorption.py, wired into the unfiltered job. Both changes fail silently rather than loudly if they regress, which is what it is for: - the suite still runs somewhere, and no longer runs twice - the absorbing job's harden-runner has not widened past the six endpoints the suite came with, since "the policy is identical" is the entire justification for this host - the absorbing job has not gained a paths filter - capability still has its Windows leg - studio-backend-ci.yml still runs the whole tests/ tree and does not name test_export_capability.py, because one line added to that --ignore list would remove the coverage the ubuntu leg was deleted for, and nothing would turn red Mutation-tested, each failing exactly one test: drop tests/security from the invocation; add one endpoint to the allowlist; add --ignore=tests/test_export_capability.py to Backend CI; remove the Windows leg. Also corrected a docstring in tests/security/test_scan_packages.py that named tests-security and what it installs. It was about to become false. Verification ------------------------------------------------------------------------ tests/security under the host's own -n 4: 409 passed, 6 skipped. scripts/lint_workflow_triggers.py: OK across 41 workflow files. All three workflows still parse; security-audit.yml keeps its other 4 jobs. Net: 7 short ubuntu slots per commit, down to 5. A note for whoever extends this. The census that found these 15 candidates was partly stale and I nearly acted on it: the lockfile and load-orchestrator rows were already absorbed by #9176 and their samples were pre-merge tails, and the two Local Agent Guides rows show ~0s because they are if-gated to schedule and dispatch, which is a skip and not a fast job. Read the trigger before ranking by duration. Of the remaining candidates, Scorecard is blocked by its job-level id-token: write, the Kaggle gate by a downstream needs:, npm-provenance by an audit egress policy plus registry.npmjs.org, and the notransport clean-install lane by a container that asserts several common tools are absent. |
||
|---|---|---|
| .. | ||
| fixtures | ||
| install | ||
| load_freeze | ||
| _node_harness.py | ||
| _playwright_robust.py | ||
| appimage_media_pipeline_probe.py | ||
| appimage_model_download_webdriver.py | ||
| appimage_portability_smoke.py | ||
| appimage_test_support.py | ||
| mac_capability_verdict_smoke.py | ||
| playwright_chat_autoscroll.py | ||
| playwright_chat_ime_i18n.py | ||
| playwright_chat_ui.py | ||
| playwright_extra_ui.py | ||
| playwright_heavy_thread.py | ||
| playwright_image_download_cancel_retry.py | ||
| playwright_image_model_footprint.py | ||
| playwright_loaded_models_indicator.py | ||
| playwright_mac_tab_capabilities.py | ||
| playwright_model_config.py | ||
| playwright_research_freeze.py | ||
| playwright_settings_tabs.py | ||
| playwright_stream_pacing.py | ||
| playwright_strip_ansi_smoke.py | ||
| playwright_tauri_python_tool_images.py | ||
| playwright_thread_scoped_settings.py | ||
| playwright_thread_weight.py | ||
| playwright_train_pickers.py | ||
| playwright_ui_font_scale.py | ||
| playwright_update_banner_layout.py | ||
| run_real_mlx_smoke.py | ||
| sim_thread_settings_portability.py | ||
| studio_api_smoke.py | ||
| test_about_tab_xpu_runtime_contract.py | ||
| test_absorbed_lanes_still_run.py | ||
| test_agent_guides_verdicts.py | ||
| test_amd_name_arch_r9700.ps1 | ||
| test_amd_venv_repair_loop.ps1 | ||
| test_application_control_cli_fallback.ps1 | ||
| test_apt_steps_are_bounded.py | ||
| test_audio_snapshot_download_targets.py | ||
| test_auth_form_input_count.py | ||
| test_autoload_hf_token_preflight.py | ||
| test_autoscroll_harness_contract.py | ||
| test_backend_ci_matrix.py | ||
| test_backend_ci_parallel_isolation.py | ||
| test_banner_update_delay_override.py | ||
| test_cache_budget_discipline.py | ||
| test_cached_model_path_selection.py | ||
| test_cancel_atomicity.py | ||
| test_cancel_id_wiring.py | ||
| test_chat_autoload_failure_gate.py | ||
| test_chat_preset_builtin_invariants.py | ||
| test_chat_preset_load_config.py | ||
| test_chat_prompt_variables.py | ||
| test_chat_response_details_ui_contract.py | ||
| test_chat_thinking_compact_layout.py | ||
| test_chat_thread_read_consolidation.py | ||
| test_chat_thread_title_cas.py | ||
| test_chat_title_generation.py | ||
| test_chat_ui_shards_cover_everything.py | ||
| test_ci_shell_suite_coverage.py | ||
| test_cli_hsa_spoof_launch_7331.py | ||
| test_cli_repo_variant.py | ||
| test_cli_run_alias.py | ||
| test_cli_studio_defaults.py | ||
| test_cli_studio_stop_windows.py | ||
| test_click_forced.py | ||
| test_compact_dropdown_submenus.py | ||
| test_compile_caches_are_per_worker.py | ||
| test_composer_rtl_bidi_attribute.py | ||
| test_deep_research_frontend_contract.py | ||
| test_desktop_reliability_frontend_contract.py | ||
| test_diffusion_gpu_layers_contract.py | ||
| test_diffusion_train_settings_layout_contract.py | ||
| test_export_output_path_contract.py | ||
| test_first_turn_thread_identity.py | ||
| test_frontend_dep_removal.py | ||
| test_generation_length_ui_contract.py | ||
| test_gguf_smoke_phases_stay_independent.py | ||
| test_gpu_inference_smoke.py | ||
| test_hardware_dispatch_matrix.py | ||
| test_heavy_thread_gap_contract.py | ||
| test_heavy_thread_harness_contract.py | ||
| test_heavy_thread_measurement_integrity.py | ||
| test_hf_token_validation_tick_contract.py | ||
| test_indicator_browsers_run_in_parallel.py | ||
| test_inference_smoke_http_diagnostics.py | ||
| test_inference_status_runtime_fields_contract.py | ||
| test_install_phase_timing.py | ||
| test_install_rollback_lifecycle.ps1 | ||
| test_installer_av_shapes.py | ||
| test_intel_registry_fallback.ps1 | ||
| test_is_mlx_dispatch_gate.py | ||
| test_legacy_chat_title_repair.py | ||
| test_llama_cpp_wall_clock_cap.py | ||
| test_locale_root_direction_contract.py | ||
| test_mac_bundled_job_phases.py | ||
| test_mac_host_offload_optin.py | ||
| test_mac_tab_capability_warm_window.py | ||
| test_macos_slots_per_commit.py | ||
| test_main_runs_survive_merge_bursts.py | ||
| test_mlx_training_worker_behaviors.py | ||
| test_model_picker_catalog_first_paint.py | ||
| test_model_picker_contracts.py | ||
| test_multi_chat_prompt_queue_contract.py | ||
| test_new_chat_context_recount.py | ||
| test_no_test_shadows_another.py | ||
| test_node_decision.ps1 | ||
| test_node_probe_guard.ps1 | ||
| test_nsis_signed_plugins_contract.py | ||
| test_overlay_layering.py | ||
| test_path_probe_access_denied.ps1 | ||
| test_pdf_qa_recipe_contract.py | ||
| test_pester_bootstrap_hardening.py | ||
| test_playwright_install_avoids_with_deps.py | ||
| test_playwright_server_lifecycle.py | ||
| test_playwright_suites_run_in_ci.py | ||
| test_pre_turing_cap.ps1 | ||
| test_provider_backfill_awaits_batch.py | ||
| test_psmodulepath_normalization.ps1 | ||
| test_rdna1_unsupported_message_8529.ps1 | ||
| test_remote_connection_models_contract.py | ||
| test_resolve_cuda_toolkit.ps1 | ||
| test_reveal_file_manager.py | ||
| test_reveal_file_manager_matrix.py | ||
| test_run_windows_entry_point.py | ||
| test_settings_compact_overflow_contract.py | ||
| test_settings_smoke_covers_every_tab.py | ||
| test_setup_pin_stale.ps1 | ||
| test_setup_xpu_runtime_prereport.ps1 | ||
| test_short_job_absorption.py | ||
| test_smoke_workflows_share_one_script.py | ||
| test_spark_tts_tokenizer_subfolder.py | ||
| test_stop_running_chats_prompt_contract.py | ||
| test_stream_cancel_registration_timing.py | ||
| test_stt_model_search_locator_contract.py | ||
| test_studio_gguf_export_script_pin.py | ||
| test_studio_pid_file_contract.py | ||
| test_studio_text_descender_clipping.py | ||
| test_sync_allow_scripts_pins.py | ||
| test_tauri_branding_contract.py | ||
| test_tauri_deep_link_contract.py | ||
| test_tauri_installer_resource_contract.py | ||
| test_tauri_python_tool_images.py | ||
| test_tee_stream_none_guard.py | ||
| test_token_count_prompt_parity.py | ||
| test_torch_flavor.ps1 | ||
| test_torch_index_pin_hardening.ps1 | ||
| test_training_config_filename_contract.py | ||
| test_training_worker_contracts.py | ||
| test_ui_font_scale_contract.py | ||
| test_ui_shard_engines.py | ||
| test_uninstall_arg_guard.ps1 | ||
| test_uninstall_dual_install_icon.ps1 | ||
| test_uninstall_prebuilt_parity.ps1 | ||
| test_uninstall_reparse_stop_roots.ps1 | ||
| test_update_release_notes.py | ||
| test_usage_examples_agent_detection_contract.py | ||
| test_usage_examples_model_source_contract.py | ||
| test_uv_cache_discipline.py | ||
| test_voice_settings_select_width.py | ||
| test_wait_for_first.py | ||
| test_whisper_binary_probe_denied.py | ||
| test_windows_small_checks_stay_on_their_image.py | ||
| test_workflow_guards_run_unfiltered.py | ||
| test_xpu_arm64_torchaudio.ps1 | ||
| test_xpu_spoof_pipeline.py | ||
| test_xpu_triton_swap.py | ||
| test_zoo_suite_parallel_isolation.py | ||