vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-14 02:49:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

cleaning up

Browse source
This commit is contained in:
HimariO 2025-04-01 21:07:36 +08:00
parent 2eb32933ea
commit d1af45988a
3 changed files with 8 additions and 60 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/llava/qwen2_vl_surgery.py
View file

@ -102,7 +102,7 @@ def main(args):
np_dtype = np.float32
ftype = 0
elif args.data_type == 'fp16':
dtype = torch.float32
dtype = torch.float16
np_dtype = np.float16
ftype = 1
else: