vrr/heretic
2
0
Fork 0
mirror of https://github.com/p-e-w/heretic.git synced 2026-07-09 17:28:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix model loading issues

Browse source
This commit is contained in:
Philipp Emanuel Weidmann 2025-09-21 16:04:41 +05:30
parent af19fbd254
commit 1b37160490
No known key found for this signature in database
GPG key ID: CE6A7756AD520E0F
2 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
config.default.toml
View file

@ -1,4 +1,4 @@
dtypes = ["float32", "float16"]
dtypes = ["float32", "float16", "bfloat16"]
device_map = "auto"

1
src/heretic/model.py
View file

@ -47,6 +47,7 @@ class Model:
self.generate([settings.test_prompt], max_new_tokens=1)
except Exception as error:
self.model = None
empty_cache()
print(f"[red]Failed[/] ({error})")
continue