vikarti.anatra/blt
1
0
Fork 0
mirror of https://github.com/facebookresearch/blt.git synced 2025-02-22 21:12:15 +00:00
Code Issues Actions 8 Packages Projects Releases Wiki Activity
blt/fixtures
History
Pedro Rodriguez 3117ac1f1f
Some checks failed
Lint with Black / lint (push) Has been cancelled
Details
Lint with isort / lint (push) Has been cancelled
Details
Make it possible to specify multiple config files 
Summary:

Make it possible to specify multiple config files.
Parsing CLI is not a special case anymore, just uses the same config inheritance method.

Test Plan:

Test that this iterpolates in the right order via unit tests

Sample usage, loads the internal config, which references bytelatent/configs/entropy_model.yaml. The precendence order is:

- Default pydantic args
- Included configs, eg `config`
- CLI args

```
python -m bytelatent.print_config config=internal/configs/entropy_model.yaml eval=null

```


Summary:

Test Plan:
2025-02-18 18:41:02 +00:00
..
test-cfgs Make it possible to specify multiple config files 2025-02-18 18:41:02 +00:00
tokenizer_data.json Initial commit 2024-12-12 15:32:30 -08:00
tokenizer_data_bpe_delim.json Initial commit 2024-12-12 15:32:30 -08:00
tokens_with_entropies.json Initial commit 2024-12-12 15:32:30 -08:00