Pedro Rodriguez 083656ce55 Update ppl evals to work with blt model, in addition to entropy model (#82) ... Summary: Test Plan: Run ``` python -m bytelatent.eval config=../internal-blt/configs/eval_blt.yaml validation.max_n_docs=null python -m bytelatent.eval config=../internal-blt/configs/eval_entropy.yaml validation.max_n_docs=null ```		2025-03-13 10:23:31 -07:00
..
iterators	Update ppl evals to work with blt model, in addition to entropy model (#82)	2025-03-13 10:23:31 -07:00
__init__.py	Initial commit	2024-12-12 15:32:30 -08:00
data_types.py	This includes fixes that make checkpointing and reloading work correctly. (#35)	2025-01-27 16:56:42 -08:00
file_util.py	Update file check script to check sizes (#32)	2025-01-22 13:06:46 -08:00
ngram_processor.py	Initial commit	2024-12-12 15:32:30 -08:00
patcher.py	Initial codes and scripts for training entropy model (#34)	2025-01-27 09:46:44 -08:00
test_data.py	Test first batch matches (#53)	2025-02-13 10:05:08 -08:00