blt/bytelatent/data
Pedro Rodriguez ea1fc75862
Add approximate state persistence ()
Summary:

Test Plan:

***
More verbose multiprocess logging, fix get_state_and_recycle

Summary:

Test Plan:
2025-03-05 15:01:45 -08:00
..
iterators Add approximate state persistence () 2025-03-05 15:01:45 -08:00
__init__.py Initial commit 2024-12-12 15:32:30 -08:00
data_types.py This includes fixes that make checkpointing and reloading work correctly. () 2025-01-27 16:56:42 -08:00
file_util.py Update file check script to check sizes () 2025-01-22 13:06:46 -08:00
ngram_processor.py Initial commit 2024-12-12 15:32:30 -08:00
patcher.py Initial codes and scripts for training entropy model () 2025-01-27 09:46:44 -08:00
test_data.py Test first batch matches () 2025-02-13 10:05:08 -08:00