5 unstable releases
0.3.2 | Aug 14, 2024 |
---|---|
0.3.0 | Aug 13, 2024 |
0.2.1 | Feb 28, 2024 |
0.2.0 | Feb 18, 2024 |
0.1.0 | Dec 16, 2023 |
#426 in Machine learning
341 downloads per month
Used in 12 crates
(5 directly)
165KB
4.5K
SLoC
kalosm-sample
This is a sampling library for Kalosm.
It handles choosing a token from a probability distribution. Samplers can be used to constrain the generation of text for example you can use a sampler to prevent the model from generating the same word twice in a row. Or you could only allow the model to generate a list of single digit numbers.
Dependencies
~1.6–2.6MB
~37K SLoC