Pedro Rodriguez
8e0732e2a6
Merge c137f4e636 into sapling-pr-archive-EntilZha
2025-01-09 17:02:30 -08:00
Pedro Rodriguez
c137f4e636
Replace regular filesystem calls with fsspec + add s3 support
...
Summary:
For compatibility with either local/nfs or S3 datasets, swap to fsspec.
Add a tool to compare local and remote filesystems
Test Plan:
- Ran regular train script
- Ran with config with data in S3
2025-01-10 01:02:25 +00:00
Pedro Rodriguez
3dadbfea4b
Merge 84854423c4 into sapling-pr-archive-EntilZha
2025-01-09 17:02:04 -08:00
Pedro Rodriguez
84854423c4
Replace regular filesystem calls with fsspec + add s3 support
...
Summary:
For compatibility with either local/nfs or S3 datasets, swap to fsspec.
Add a tool to compare local and remote filesystems
Test Plan:
- Ran regular train script
- Ran with config with data in S3
2025-01-10 01:01:57 +00:00
Pedro Rodriguez
d4ddb95322
Add plotting code from paper ( #17 )
...
Lint with Black / lint (push) Waiting to run
Lint with isort / lint (push) Waiting to run
Summary:
Test Plan:
2025-01-09 12:11:50 -08:00
Pedro Rodriguez
28016f144d
Add plotting code from paper
...
Summary:
Test Plan:
2025-01-09 20:06:26 +00:00
Ink
2fdc6f3cc9
Package bytelatent as a module ( #7 )
...
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
* make installable via pip
* fix missing xformers deps
* remove non-core dependencies
* fix linting
* fix isort
2025-01-06 16:44:50 -08:00
Ikko Eltociear Ashimine
9065bb1cce
docs: update README.md ( #1 )
...
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
folowing -> following
2025-01-03 12:08:00 -08:00
Daniele Sartiano
898671b66b
Update README.md ( #13 )
...
Fixed typo on Meta Lingua
2025-01-03 12:06:47 -08:00
Pedro Rodriguez
bcc039bb75
Initial commit
2024-12-12 15:32:30 -08:00
