vikarti.anatra/blt
1
0
Fork 0
mirror of https://github.com/facebookresearch/blt.git synced 2025-04-08 02:39:09 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix: Correct model_args usage in parallelize_model call ()

Browse source
This commit is contained in:
Bocheng Li 2025-02-25 06:40:38 +08:00 • committed by GitHub
parent fc3399ef40
commit a6ed14f689
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions

2
bytelatent/train.py
View file

@ -317,7 +317,7 @@ def train(args: TrainArgs):
model = parallelize_model(
model,
world_mesh,
args.model,
model_args,
args.distributed,
fsdp_grouping_plan=build_fsdp_grouping_plan(model_args),
tp_parallelize=tp_parallelize,