vikarti.anatra/blt
1
0
Fork 0
mirror of https://github.com/facebookresearch/blt.git synced 2025-04-25 19:19:09 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
blt/bytelatent/data/iterators
History
Srinivasan Iyer e299427ae4
Cast int sample id to str () 
Co-authored-by: Srini Iyer <sviyer@meta.com>
2025-04-08 17:45:45 -07:00
..
__init__.py Initial commit 2024-12-12 15:32:30 -08:00
abstract_iterator.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
arrow_iterator.py Cast int sample id to str () 2025-04-08 17:45:45 -07:00
dev_iterators.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
limit_iterator.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
looping_iterator.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
multiprocess_iterator.py Let process start before yielding preloaded prefetch buffer, avoid needlessly losing buffer in edge cases () 2025-03-05 15:02:57 -08:00
packing_iterator.py Update ppl evals to work with blt model, in addition to entropy model () 2025-03-13 10:23:31 -07:00
preprocess_iterator.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
sampling_iterator.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
sequence_iterator.py Reduce per file resources arrow uses () 2025-03-05 15:03:42 -08:00
test_arrow_iterator.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
test_iters.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
test_limit_iterator.py Update iterator inheritance, pass file format args, limit iterator () 2025-02-21 16:21:07 -08:00
test_packing_iterator.py Pass mask in packing_iterator, correctly handle last batch, fix masking () 2025-02-27 11:41:47 -08:00