Commit graph

6131 commits

Author SHA1 Message Date
Daniel Han-Chen
75d1a0e2e1 Fix FastLanguageModel 2023-12-27 03:01:45 +11:00
Daniel Han
04093395ed Fix RoPE Scaling issues (#52)
* Fix RoPE Scaling

* Update llama.py

* Update llama.py
2023-12-26 04:32:04 +11:00
Daniel Han-Chen
5dda3f4058 Fix Pytorch 2.1.1 2023-12-25 23:28:05 +11:00
Daniel Han
ef70177a24 Small fixes (#48)
* Fix generation for GQA

* Update _utils.py

* flash attn

* Update _utils.py

* Update llama.py

* Update mistral.py

* platform

* Update _utils.py

* Update llama.py

* Logo changed

* Update README.md

* Update README.md
2023-12-23 04:22:48 +11:00
Daniel Han
37365b6ba9 Fix typo 2023-12-18 12:27:31 +11:00
shimmy
51d6797c7c Update __init__.py
Fixing typo extra '='
2023-12-18 12:19:24 +11:00
Daniel Han-Chen
feec338c08 Torch version, docs, readme, general loader 2023-12-18 04:23:16 +11:00
Daniel Han-Chen
cf5204a52d Fix Mistral
BlockDiagonalCausalMask fix courtesy of https://github.com/Rypo
2023-12-16 13:14:33 +11:00
Daniel Han-Chen
44bf41e113 Update Colab to CUDA 12.1 2023-12-15 16:35:24 +11:00
Daniel Han-Chen
9c6803a573 Fix packaging, readme 2023-12-15 12:57:08 +11:00
Daniel Han
4143ca52e1 Update README.md 2023-12-14 15:10:17 +11:00
Daniel Han
d6fdf151a5 Update README.md 2023-12-14 12:33:51 +11:00
Daniel Han-Chen
9714bf7438 Update llama.py 2023-12-12 13:07:38 +11:00
Daniel Han-Chen
0e0e03c239 Update llama.py 2023-12-12 02:54:54 +11:00
Daniel Han-Chen
b5a9c9c69d tokenizer pad fix 2023-12-12 02:40:37 +11:00
Daniel Han-Chen
870ca65421 Update mistral.py 2023-12-12 00:59:30 +11:00
Daniel Han-Chen
3c790a6680 Update llama.py 2023-12-12 00:57:06 +11:00
Daniel Han-Chen
0912303bfb Mistral, GQA support 2023-12-11 23:58:36 +11:00
Daniel Han-Chen
1fa07c58fb Fix generation 2023-12-07 00:13:29 +11:00
Daniel Han
6416f235cf Pre-release 2023 December version (Mistral, Prelim DPO, WSL, bug fixes) (#16)
* Immediate bug fixes

* Update README.md

* Update README.md

* Update llama.py

* Update llama.py

* Rope Scaling and max_seq_len will change

* Update llama.py

* new images

* Update README.md

* Images

* Update README.md

* Update pyproject.toml

* GQA

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py
2023-12-06 02:59:22 +11:00
Daniel Han-Chen
d1c1748266 Sticker 2023-12-02 03:08:16 +11:00
Daniel Han
30c792ee58 Update README.md 2023-12-01 21:54:31 +11:00
Daniel Han
c1ed527ebe Update README.md 2023-12-01 19:54:04 +11:00
Daniel Han
9f65d942ff Update README.md 2023-12-01 17:50:40 +11:00
Daniel Han
ab9ac86aa0 Update README.md 2023-12-01 16:07:53 +11:00
Daniel Han
a636326598 Update README.md 2023-12-01 16:07:38 +11:00
Daniel Han-Chen
77c527b15d Create Discord.png 2023-12-01 16:04:15 +11:00
Daniel Han
0de488b302 Update README.md 2023-12-01 14:42:52 +11:00
Daniel Han
8712684094 Update README.md 2023-12-01 14:42:42 +11:00
Daniel Han
30932a7831 Update README.md 2023-12-01 14:38:03 +11:00
Daniel Han
0cfb1fa0ad Update README.md 2023-12-01 14:35:51 +11:00
Daniel Han
7178c5d3a8 Update README.md 2023-12-01 14:11:49 +11:00
Daniel Han
e4f402a672 Update README.md 2023-12-01 13:57:28 +11:00
Daniel Han
17d0cd9e3b Update README.md 2023-12-01 13:52:05 +11:00
Daniel Han-Chen
6f1da39738 Merge branch 'main' of https://github.com/unslothai/unsloth 2023-12-01 13:51:33 +11:00
Daniel Han-Chen
fc8c364e66 Create Slim Orca 2GPUs.png 2023-12-01 13:51:05 +11:00
Daniel Han
49eee2e259 Update README.md 2023-12-01 13:50:13 +11:00
Daniel Han
707da68c0c Update README.md 2023-12-01 13:49:53 +11:00
Daniel Han
6bd590276c Update README.md 2023-12-01 13:43:26 +11:00
Daniel Han
9998f617f3 Update README.md 2023-12-01 13:40:52 +11:00
Daniel Han
2c4105cfb1 Update README.md 2023-12-01 13:40:39 +11:00
Daniel Han
d794f4c6ed Update README.md 2023-12-01 13:37:27 +11:00
Daniel Han
9a88efa9f3 Update README.md 2023-12-01 03:29:31 +11:00
Daniel Han
87b4e17d06 Add files via upload 2023-12-01 03:28:49 +11:00
Daniel Han
90195532e6 Update README.md 2023-12-01 02:34:41 +11:00
Daniel Han
e713a7ed11 Update README.md 2023-12-01 01:38:47 +11:00
Daniel Han
3276cf8c7a Add files via upload 2023-12-01 01:34:43 +11:00
Daniel Han
7d4e2501e7 Update README.md 2023-12-01 01:32:45 +11:00
Daniel Han-Chen
30461b4057 images and exclusion 2023-12-01 01:22:09 +11:00
Daniel Han-Chen
71b59482cd images 2023-12-01 01:20:24 +11:00