348 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Filip Christiansen	03b015059c	ci: integrate Codecov and pytest-cov (#405)	2025-07-13 16:44:01 +02:00
Nicolas Iragne	fa2e192c05	fix: enable metrics if env var is defined instead of being "True" (#407)	2025-07-13 16:24:44 +02:00
Nicolas Iragne	1016f6ecb3	feat: implement prometheus exporter (#406) ... Co-authored-by: mickael <contact@mickael-caudrelier.fr>	2025-07-13 16:09:20 +02:00
Filip Christiansen	9b1fc58900	docs: add GitHub Issue Form for feature requests (#404)	2025-07-12 17:53:22 +02:00
Filip Christiansen	4546449bbc	docs: add GitHub Issue Form for bug reports (#403)	2025-07-12 17:38:54 +02:00
Mickael	340edb6c32	ci: add missing simple main tag (#399)	2025-07-09 11:40:34 +00:00
Mickael	37eb4be3b1	ci: add docker build & push to GHCR (#397)	2025-07-09 13:30:03 +02:00
Romain Courtois	f5b20dec44	chore: replace org name in repo urls (#396)	2025-07-09 11:30:37 +02:00
Mickael	15078ba9fe	ci: add PR title validation (#395)	2025-07-08 18:41:03 +02:00
Zarial	6fbc296e7b	New swagger UI integration, improve frontend, remove repo_url from api error response, add api endpoints for ingestion and api config json, better docstring for endpoints, fix include/exclude frontend behavior, new download endpoint (#366)	2025-07-08 15:13:18 +02:00
Zarial	84450506c9	rename llm.txt to llms.txt (#390)	2025-07-06 23:19:19 +02:00
Nicolas Iragne	943d5faaec	Merge pull request #338 from BareninVitalya/fix/windows-support ... Fix/windows support	2025-07-06 15:26:13 +02:00
Vitalii Barenin	9dfb279ae3	Merge main into fix/windows-support	2025-07-06 15:55:23 +03:00
Vitalii Barenin	56ce0ed19e	Use 'git config core.longpaths' without level	2025-07-06 14:51:17 +03:00
Vitalii Barenin	e10bfc02f7	Check core.longpaths using --global instead of --system on Windows	2025-07-06 14:10:58 +03:00
Vitalii Barenin	d284d758c9	Check core.longpaths using --global instead of --system on Windows	2025-07-06 14:10:57 +03:00
Filip Christiansen	b683e59b5b	feat: add Tailwind CSS pipeline, tag-aware cloning & overhaul CI/CD (#352) ... Frontend * introduce Tailwind CSS (package.json, tailwind.config.js, input CSS) * build site.css on-the-fly (removed tracked artefact; added .gitignore) * new favicon/icon assets & template cleanup * split JS into modular files Docker * replace single-stage image with 3-stage build • css-builder (Node 20 alpine) → compiles Tailwind • python-builder installs project with PEP 621 metadata • runtime image copies site-packages + compiled CSS, runs as uid 1000 CI/CD * ci.yml: cache by pyproject.toml, install with `pip -e .[dev]` * new frontend job builds/archives CSS after tests * publish.yml: build CSS first, then wheel/sdist; trusted OIDC upload * tidy scorecard workflow Core library * clone.py, parser & utils now resolve tags in addition to branches/commits * fallback branch/tag discovery when `git ls-remote` fails * compat\_func.py back-ports Path.readlink / str.removesuffix for Py 3.8 Tooling & docs * add `[dev]` extra, drop requirements-dev.txt & its pre-commit fixer * refreshed CONTRIBUTING.md with Node/Tailwind instructions * updated tests for new tag logic	2025-07-06 14:10:42 +03:00
Vitalii Barenin	b8e375f71c	fix(windows): warn if Git long path support is disabled, do not fail	2025-07-06 14:00:35 +03:00
Filip Christiansen	cea0eddce8	refactor: centralize PAT validation, streamline repo checks & misc cleanup (#349) ... * refactor: centralize PAT validation, streamline repo checks & housekeeping * `.venv*` to `.gitignore` * `# type: ignore[attr-defined]` hints in `compat_typing.py` for IDE-agnostic imports * Helpful PAT string in `InvalidGitHubTokenError` for easier debugging * Bump **ruff-pre-commit** hook → `v0.12.1` * CONTRIBUTING: * Require **Python 3.9+** * Recommend signed (`-S`) commits * PAT validation now happens **only** in entry points (`utils.auth.resolve_token` for CLI/lib, `server.process_query` for Web UI) * Unified `_check_github_repo_exists` into `check_repo_exists`, replacing `curl -I` with `curl --silent --location --write-out %{http_code} -o /dev/null` * Broaden `_GITHUB_PAT_PATTERN` * `create_git_auth_header` raises `ValueError` when hostname is missing * Tests updated to expect raw HTTP-code output * Superfluous “token can be set via `GITHUB_TOKEN`” notes in docstrings * `.gitingestignore` & `.terraform` from `DEFAULT_IGNORE_PATTERNS` * Token validation inside `create_git_command` * Obsolete `test_create_git_command_invalid_token` * Adjust `test_clone.py` and `test_git_utils.py` for new status-code handling * Consolidate mocks after token-validation relocation BREAKING CHANGE: `create_git_command` no longer validates GitHub tokens; callers must ensure tokens are valid (via `validate_github_token`) before invoking lower-level git helpers. --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-07-06 14:00:20 +03:00
BareninVitalya	6fe62cc2da	Update src/gitingest/utils/git_utils.py ... Co-authored-by: Nicolas Iragne <nicoragne@hotmail.fr>	2025-07-06 13:43:29 +03:00
Vitalii Barenin	390a591dc5	Update git_utils.py: warn on long paths issue on Windows	2025-07-06 13:43:29 +03:00
Vitalii Barenin	5a7f9fafa3	Remove IDE-specific files and update .gitignore	2025-07-06 13:42:32 +03:00
Vitalii Barenin	99aaef0c0a	Fix Windows compatibility: subprocess support and long path handling	2025-07-06 13:31:19 +03:00
Zarial	e023af309e	replace curl by httpx (#374) ... * replace curl by httpx --------- Co-authored-by: Filip Christiansen <22807962+filipchristiansen@users.noreply.github.com>	2025-07-06 11:39:54 +02:00
Nicolas Iragne	bc8cdb4594	feat(ci): build Docker Image on PRs (#382) ... * feat(ci): add GitHub Actions workflows for Docker image build and rename PyPI publish * chore: rename cli module to __main__ so it can be executed without having to build * Update .github/workflows/docker_image.yml Co-authored-by: Filip Christiansen <22807962+filipchristiansen@users.noreply.github.com>	2025-07-05 21:04:20 +02:00
Filip Christiansen	b1eebaec88	Remove helper function _normalize_pattern (and its use inside _parse_patterns) (#386)	2025-07-05 13:25:28 +02:00
Filip Christiansen	dead917060	chore(pre-commit) / refactor(templates): add ESLint pre-commit hook + refactor result.jinja (#379) ... * chore(pre-commit) / refactor(templates): add ESLint hook + refactor `result.jinja` * Add `eslint` to `pre-commit` hooks * `getFileName` + `toggleFile` moved to `utils.js` * Run linter	2025-07-04 18:32:34 +02:00
Nicolas Iragne	1c80d7a69c	Merge pull request #381 from cyclotruc/fix-docker ... fix docker	2025-07-04 18:28:56 +02:00
Filip Christiansen	2f3cf1455c	fix docker	2025-07-04 18:21:30 +02:00
Filip Christiansen	bfdc63853a	cleanup gitignore (#378)	2025-07-04 17:39:40 +02:00
Filip Christiansen	3e83ba3936	refactor(tailwind,build,ci,docker): drop local Tailwind build & Node toolchain (#373) ... * refactor(build,ci,docker): drop local Tailwind build & Node toolchain * Remove npm ecosystem from Dependabot, workflows and Dockerfile. * Delete package.json, tailwind.config.js and generated CSS sources. * Replace compiled CSS with Tailwind CDN plus inline component layer. * Simplify CI: eliminate frontend build job; Python-only release pipeline. * Shrink Docker image to single Python stage. * Trim .gitignore and CONTRIBUTING docs accordingly. * fix max_file_size limit * fix #375	2025-07-04 01:16:06 +02:00
jpotw	38c23171a1	feat: include_submodules option (#313) ... * feat: add optional --include-submodules flag to CLI and ingestion - Adds --include-submodules CLI flag to control submodule analysis - Propagates include_submodules through ingestion, schemas, and clone logic - Updates tests to cover submodule inclusion - Adds a helper function (_checkout_partial_clone) to avoid repetition - Adds include_submodules example in README.md - Web UI for this option is not implemented for now (https://github.com/cyclotruc/gitingest/pull/313#issuecomment-3019912523) --------- Co-authored-by: Filip Christiansen <22807962+filipchristiansen@users.noreply.github.com>	2025-07-03 19:19:11 +02:00
Filip Christiansen	149c8e95e1	extract navbar svgs (#367)	2025-07-03 15:34:07 +02:00
Zarial	0fcf8a956f	fix: frontend directory tree (#363) ... Co-authored-by: ix-56h <n.guintini@protonmail.com>	2025-07-03 03:51:59 +02:00
Filip Christiansen	789d44e986	fix the bg color of the input text field (#364)	2025-07-02 23:13:51 +02:00
Filip Christiansen	d8d0e2ee29	fix lock file (#362)	2025-07-02 22:53:41 +02:00
dependabot[bot]	c77d51f6f5	chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.4.2 (#360) ... Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action) from 2.3.1 to 2.4.2. - [Release notes](https://github.com/ossf/scorecard-action/releases) - [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md) - [Commits](0864cf1902...05b42c6244) --- updated-dependencies: - dependency-name: ossf/scorecard-action dependency-version: 2.4.2 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-07-02 22:00:17 +02:00
Filip Christiansen	016817d559	feat: add Tailwind CSS pipeline, tag-aware cloning & overhaul CI/CD (#352) ... Frontend * introduce Tailwind CSS (package.json, tailwind.config.js, input CSS) * build site.css on-the-fly (removed tracked artefact; added .gitignore) * new favicon/icon assets & template cleanup * split JS into modular files Docker * replace single-stage image with 3-stage build • css-builder (Node 20 alpine) → compiles Tailwind • python-builder installs project with PEP 621 metadata • runtime image copies site-packages + compiled CSS, runs as uid 1000 CI/CD * ci.yml: cache by pyproject.toml, install with `pip -e .[dev]` * new frontend job builds/archives CSS after tests * publish.yml: build CSS first, then wheel/sdist; trusted OIDC upload * tidy scorecard workflow Core library * clone.py, parser & utils now resolve tags in addition to branches/commits * fallback branch/tag discovery when `git ls-remote` fails * compat\_func.py back-ports Path.readlink / str.removesuffix for Py 3.8 Tooling & docs * add `[dev]` extra, drop requirements-dev.txt & its pre-commit fixer * refreshed CONTRIBUTING.md with Node/Tailwind instructions * updated tests for new tag logic	2025-07-02 21:31:14 +02:00
Zarial	2b1f228ae1	feat: Refactor backend to a rest api (#346) ... * refactor: Refactor backend to a rest api and make weak changes to the front to make it works * fix: remove result bool in Success response object since it's useless, remove sensitive data from the Success Response object, make the integration unit test compatible * fix: clean query processor return types, remove deprecated fields, better handling for few errors * fix: unit tests, remove deprecated is_index from jinja templates --------- Co-authored-by: ix <n.guintini@protonmail.com>	2025-07-02 16:36:39 +02:00
Filip Christiansen	f8d397e66e	refactor: centralize PAT validation, streamline repo checks & misc cleanup (#349) ... * refactor: centralize PAT validation, streamline repo checks & housekeeping * `.venv*` to `.gitignore` * `# type: ignore[attr-defined]` hints in `compat_typing.py` for IDE-agnostic imports * Helpful PAT string in `InvalidGitHubTokenError` for easier debugging * Bump **ruff-pre-commit** hook → `v0.12.1` * CONTRIBUTING: * Require **Python 3.9+** * Recommend signed (`-S`) commits * PAT validation now happens **only** in entry points (`utils.auth.resolve_token` for CLI/lib, `server.process_query` for Web UI) * Unified `_check_github_repo_exists` into `check_repo_exists`, replacing `curl -I` with `curl --silent --location --write-out %{http_code} -o /dev/null` * Broaden `_GITHUB_PAT_PATTERN` * `create_git_auth_header` raises `ValueError` when hostname is missing * Tests updated to expect raw HTTP-code output * Superfluous “token can be set via `GITHUB_TOKEN`” notes in docstrings * `.gitingestignore` & `.terraform` from `DEFAULT_IGNORE_PATTERNS` * Token validation inside `create_git_command` * Obsolete `test_create_git_command_invalid_token` * Adjust `test_clone.py` and `test_git_utils.py` for new status-code handling * Consolidate mocks after token-validation relocation BREAKING CHANGE: `create_git_command` no longer validates GitHub tokens; callers must ensure tokens are valid (via `validate_github_token`) before invoking lower-level git helpers. --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-07-01 14:21:13 +02:00
Filip Christiansen	25923037ea	feat(ui): add inline PAT info tooltip inside token field (#348)	2025-07-01 10:30:51 +02:00
Sendi John	fdcbc53cad	docs: Fix CLI help text accuracy (#332) ... * docs: Fix CLI help text accuracy - Add stdout documentation to --output option help text - Update default filename to 'digest.txt' consistently - Enhance docstrings with comprehensive usage examples - Improve GitHub token documentation with environment variable support - Fix inconsistencies between help text and actual CLI behavior Co-authored-by: Filip Christiansen	2025-07-01 09:18:37 +02:00
dmnunez1993	e669e444fa	fix: temp files cleanup after ingest(#309) ... Co-authored-by: Romain Courtois <romain@coderamp.io>	2025-07-01 02:44:02 +02:00
Filip Christiansen	d099de5d3b	fix GitHub PAT regex (#341)	2025-06-30 22:00:51 +02:00
Filip Christiansen	ba1b6add67	add node_modules to .gitignore (#340)	2025-06-30 20:55:57 +02:00
Filip Christiansen	8b6d9f2c02	fix issue #335 (#339)	2025-06-30 20:45:55 +02:00
Filip Christiansen	2f447ae632	chore: switch to ruff + pydoclint, deprecate .gitingest, and perform a repo-wide quality sweep (#329) ... * **Pre-commit**: replace `black` & `darglint` with `ruff-check` / `ruff-format`; add `pydoclint` for docstring quality * **Deps**: drop `tomli`; tighten `typing_extensions`; add `eval-type-backport`; remove `black`, `djlint`, `pylint` from `requirements-dev` * **Ignore files**: deprecate TOML-based `.gitingest`; introduce `.gitingestignore` (git-wildmatch, parsed via `_parse_ignore_file`) * **Config**: new unified `[tool.ruff]` (lint + format + isort); delete `[tool.black]`, keep minimal `[tool.isort]` for now * **Refactor/style**: adopt `from __future__ import annotations`, kw-only args, richer types; reorder params & `__all__`; move type-only imports under `if TYPE_CHECKING`; extract `_CLIArgs` `TypedDict`, migrate form data to `pydantic.QueryForm`; deduplicate `cli.main` / `_async_main`; use `pathlib`, avoid file-IO in async; replace magic numbers with constants; delete `is_text_file` (logic now lives in `FileSystemNode.content`) * **Bug fix**: remove silent error in `notebook_utils._process_cell` * **Docs**: refresh README badges * **Tests**: update fixtures & assertions **BREAKING**: new `.gitingestignore` file replaces (now-deprecated) `.gitingest`. No functional API or CLI changes.	2025-06-28 18:49:37 +02:00
Carlos Uriel	b39ef5416c	fix(ui): update layout in PAT section to avoid overlaps & overflows (#331) ... * fix(ui): prevent overlaps and overflow by updating layout in PAT section of ingest form * feat(ui): replace native checkbox styles with custom design * fix(ui): add missing cursor-pointer styles to inputs in ingest form * fix(ui): apply top margin to example repositories section if token is present	2025-06-28 04:11:39 +02:00
Juan Cruz-Benito	af95bae087	Improve checks for github.com links & adding compatibility with GHE companies that use github.<company>.xxx type of links (#334) ... * Improve checks for github.com links & adding compatibility with GHE companies that use github.<company>.xxx type of links	2025-06-28 03:40:33 +02:00
Romain Courtois	c2ad390ce1	bump version to 0.1.5 (#320)	2025-06-25 19:54:58 +02:00