blt/bytelatent
Pedro Rodriguez 4ae7a62594
Some checks failed
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
Run black/isort to fix linting (#117)
Summary:

Test Plan:
2025-05-22 12:17:10 -07:00
..
configs Remove byte tokenizer and add config args to switch between byte/patch packing (#68) 2025-02-25 11:10:59 -08:00
data Tune retry params as temporary fix for excessive file listing (#110) 2025-05-16 10:28:05 -07:00
model Improve HF compatibility (#99) 2025-05-01 11:44:50 -07:00
plotting Add plotting code from paper (#17) 2025-01-09 12:11:50 -08:00
preprocess Improve HF compatibility (#99) 2025-05-01 11:44:50 -07:00
templates Upgrade stool (#107) 2025-05-12 10:00:19 -07:00
tokenizers Remove byte tokenizer and add config args to switch between byte/patch packing (#68) 2025-02-25 11:10:59 -08:00
.DS_Store Initial commit 2024-12-12 15:32:30 -08:00
__init__.py Initial commit 2024-12-12 15:32:30 -08:00
args.py Fix eval mask (#93) 2025-04-08 10:31:40 -07:00
base_transformer.py Improve HF compatibility (#99) 2025-05-01 11:44:50 -07:00
checkpoint.py Add way to call consolidate (#80) 2025-03-11 16:53:33 -07:00
config_parser.py Run black/isort to fix linting (#117) 2025-05-22 12:17:10 -07:00
constants.py Initial commit 2024-12-12 15:32:30 -08:00
distributed.py Init distributed when loading model (#94) 2025-04-08 13:57:28 -07:00
entropy_model.py Improve HF compatibility (#99) 2025-05-01 11:44:50 -07:00
eval.py Open source weights! (#97) 2025-04-17 09:38:56 -07:00
float8.py Initial commit 2024-12-12 15:32:30 -08:00
generate.py Open source weights! (#97) 2025-04-17 09:38:56 -07:00
generate_blt.py Get generation working for BLT (#86) 2025-04-01 16:07:55 -07:00
hf.py Improve HF compatibility (#99) 2025-05-01 11:44:50 -07:00
iterate_data.py Update iterate_data (#81) 2025-03-13 10:14:41 -07:00
logger.py Update checkpointing to use fsspec (#39) 2025-02-06 09:41:58 -08:00
metrics.py Get evals working again. (#46) 2025-03-11 09:57:19 -07:00
norms.py Fix distributed all reduce grad norm (#40) 2025-02-04 16:53:50 -08:00
optim.py Initial commit 2024-12-12 15:32:30 -08:00
print_config.py Make it possible to specify multiple config files (#54) 2025-02-18 10:42:44 -08:00
probe.py Initial commit 2024-12-12 15:32:30 -08:00
profiling.py Initial commit 2024-12-12 15:32:30 -08:00
stool.py Run black/isort to fix linting (#117) 2025-05-22 12:17:10 -07:00
test_blt.py Initial codes and scripts for training entropy model (#34) 2025-01-27 09:46:44 -08:00
test_config_parser.py Make it possible to specify multiple config files (#54) 2025-02-18 10:42:44 -08:00
test_entropy_model.py Improve HF compatibility (#99) 2025-05-01 11:44:50 -07:00
train.py Get evals working again. (#46) 2025-03-11 09:57:19 -07:00
transformer.py Improve HF compatibility (#99) 2025-05-01 11:44:50 -07:00