Ink
caec8d2621
allow flex-attention to be disabled ( #19 )
...
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
* allow flex-attention to silently fail
* allow flex-attn to be disabled via an env var
2025-01-14 09:32:07 -08:00
Pedro Rodriguez
1da3dd9315
Update preprocess_entropies script to blt inference + add fsspec support ( #23 )
...
Lint with Black / lint (push) Waiting to run
Lint with isort / lint (push) Waiting to run
Summary:
Test Plan:
2025-01-13 15:28:14 -08:00
Pedro Rodriguez
4974f9512d
merge commit for archive created by Sapling
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
2025-01-13 23:26:35 +00:00
Pedro Rodriguez
d718cfa9a1
Update preprocess_entropies script to blt inference + add fsspec support
...
Summary:
Test Plan:
2025-01-13 23:26:27 +00:00
Pedro Rodriguez
95e7e89f42
merge commit for archive created by Sapling
2025-01-13 23:14:27 +00:00
Pedro Rodriguez
3f045f1123
Update preprocess_entropies script to blt inference + add fsspec support
...
Summary:
Test Plan:
2025-01-13 23:14:09 +00:00
Pedro Rodriguez
b0120da72f
Replace regular filesystem calls with fsspec + add s3 support ( #18 )
...
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
Summary:
For compatibility with either local/nfs or S3 datasets, swap to fsspec.
Add a tool to compare local and remote filesystems
Test Plan:
- Ran regular train script
- Ran with config with data in S3
2025-01-10 11:04:41 -08:00
Pedro Rodriguez
5657903dea
merge commit for archive created by Sapling
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
2025-01-10 01:04:26 +00:00
Pedro Rodriguez
a1d05403b4
Replace regular filesystem calls with fsspec + add s3 support
...
Summary:
For compatibility with either local/nfs or S3 datasets, swap to fsspec.
Add a tool to compare local and remote filesystems
Test Plan:
- Ran regular train script
- Ran with config with data in S3
2025-01-10 01:04:18 +00:00
Pedro Rodriguez
3104e8e317
merge commit for archive created by Sapling
2025-01-10 01:03:28 +00:00
Pedro Rodriguez
1bf6d15e5a
Replace regular filesystem calls with fsspec + add s3 support
...
Summary:
For compatibility with either local/nfs or S3 datasets, swap to fsspec.
Add a tool to compare local and remote filesystems
Test Plan:
- Ran regular train script
- Ran with config with data in S3
2025-01-10 01:03:23 +00:00
Pedro Rodriguez
8e0732e2a6
Merge c137f4e636
into sapling-pr-archive-EntilZha
2025-01-09 17:02:30 -08:00
Pedro Rodriguez
c137f4e636
Replace regular filesystem calls with fsspec + add s3 support
...
Summary:
For compatibility with either local/nfs or S3 datasets, swap to fsspec.
Add a tool to compare local and remote filesystems
Test Plan:
- Ran regular train script
- Ran with config with data in S3
2025-01-10 01:02:25 +00:00
Pedro Rodriguez
3dadbfea4b
Merge 84854423c4
into sapling-pr-archive-EntilZha
2025-01-09 17:02:04 -08:00
Pedro Rodriguez
84854423c4
Replace regular filesystem calls with fsspec + add s3 support
...
Summary:
For compatibility with either local/nfs or S3 datasets, swap to fsspec.
Add a tool to compare local and remote filesystems
Test Plan:
- Ran regular train script
- Ran with config with data in S3
2025-01-10 01:01:57 +00:00
Pedro Rodriguez
d4ddb95322
Add plotting code from paper ( #17 )
...
Lint with Black / lint (push) Waiting to run
Lint with isort / lint (push) Waiting to run
Summary:
Test Plan:
2025-01-09 12:11:50 -08:00
Pedro Rodriguez
28016f144d
Add plotting code from paper
...
Summary:
Test Plan:
2025-01-09 20:06:26 +00:00
Ink
2fdc6f3cc9
Package bytelatent
as a module ( #7 )
...
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
* make installable via pip
* fix missing xformers deps
* remove non-core dependencies
* fix linting
* fix isort
2025-01-06 16:44:50 -08:00
Ikko Eltociear Ashimine
9065bb1cce
docs: update README.md ( #1 )
...
Lint with Black / lint (push) Has been cancelled
Lint with isort / lint (push) Has been cancelled
folowing -> following
2025-01-03 12:08:00 -08:00
Daniele Sartiano
898671b66b
Update README.md ( #13 )
...
Fixed typo on Meta Lingua
2025-01-03 12:06:47 -08:00
Pedro Rodriguez
bcc039bb75
Initial commit
2024-12-12 15:32:30 -08:00