blt/fixtures
Pedro Rodriguez 82ab5930ec
Make it possible to specify multiple config files (#54)
Summary:

Make it possible to specify multiple config files.
Parsing CLI is not a special case anymore, just uses the same config inheritance method.

Test Plan:

Test that this iterpolates in the right order via unit tests

Sample usage, loads the internal config, which references bytelatent/configs/entropy_model.yaml. The precendence order is:

- Default pydantic args
- Included configs, eg `config`
- CLI args

```
python -m bytelatent.print_config config=internal/configs/entropy_model.yaml eval=null

```


Summary:

Test Plan:
2025-02-18 10:42:44 -08:00
..
test-cfgs Make it possible to specify multiple config files (#54) 2025-02-18 10:42:44 -08:00
tokenizer_data.json Initial commit 2024-12-12 15:32:30 -08:00
tokenizer_data_bpe_delim.json Initial commit 2024-12-12 15:32:30 -08:00
tokens_with_entropies.json Initial commit 2024-12-12 15:32:30 -08:00