vrr/heretic
2
0
Fork 0
mirror of https://github.com/p-e-w/heretic.git synced 2026-07-09 17:28:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: Add bfloat16 to default dtypes list (#44)
Some checks are pending
CI / Check and build (Python 3.10) (push) Waiting to run
Details
CI / Check and build (Python 3.11) (push) Waiting to run
Details
CI / Check and build (Python 3.12) (push) Waiting to run
Details
CI / Check and build (Python 3.13) (push) Waiting to run
Details

Browse source 
Co-authored-by: Vinay Umrethe <vinayumrethe99@gmail.com>
This commit is contained in:
_Vinayyyy_ 2025-11-25 12:22:52 +05:30 • committed by GitHub
parent 1efc4ee9e1
commit 63fc0e7d5a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/heretic/config.py
View file

@ -34,6 +34,8 @@ class Settings(BaseSettings):
"auto",
# If that doesn't work (e.g. on pre-Ampere hardware), fall back to float16.
"float16",
# If float16 fails (e.g. due to range issues) and float32 is too large, try bfloat16.
"bfloat16",
# If that still doesn't work (e.g. due to https://github.com/meta-llama/llama/issues/380),
# fall back to float32.
"float32",