blt/bytelatent/data
Pedro Rodriguez b79eb3ef11
Get generation working for BLT ()
Summary:

Create a script for simple generation from BLT

Test Plan:

```
python -m bytelatent.generate_blt config=../internal-blt/configs/eval_blt.yaml
```
2025-04-01 16:07:55 -07:00
..
iterators Update ppl evals to work with blt model, in addition to entropy model () 2025-03-13 10:23:31 -07:00
__init__.py Initial commit 2024-12-12 15:32:30 -08:00
data_types.py This includes fixes that make checkpointing and reloading work correctly. () 2025-01-27 16:56:42 -08:00
file_util.py Update file check script to check sizes () 2025-01-22 13:06:46 -08:00
ngram_processor.py Initial commit 2024-12-12 15:32:30 -08:00
patcher.py Get generation working for BLT () 2025-04-01 16:07:55 -07:00
test_data.py Test first batch matches () 2025-02-13 10:05:08 -08:00