vikarti.anatra/blt
1
0
Fork 0
mirror of https://github.com/facebookresearch/blt.git synced 2025-09-15 00:29:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Improve HF compatibility
Some checks are pending
Lint with Black / lint (push) Waiting to run
Details
Lint with isort / lint (push) Waiting to run
Details

Browse source 
Summary:

Test Plan:
This commit is contained in:
Pedro Rodriguez 2025-04-18 22:58:06 +00:00
parent 1b67cbe022
commit 05b71e331b
8 changed files with 254 additions and 24 deletions
Download patch file Download diff file Expand all files Collapse all files

2
bytelatent/test_entropy_model.py
View file

@ -34,7 +34,7 @@ def test_entropy_model():
"bpe_tokenizer_path": BLT_DATA / "tokenizer_final_32k.minus_inf_ws.model"
},
)
entropy_model = load_entropy_model(
entropy_model, _ = load_entropy_model(
BLT_DATA / "checkpoint_0100000_consolidated",
os.path.join(
BLT_DATA,