Cargo Features
kalosm-llama has no features set by default.
[dependencies]
kalosm-llama = { version = "0.3.4", features = ["accelerate", "cuda", "cudnn", "mkl", "nccl", "metal", "rayon"] }- accelerate
-
Enables accelerate-src, accelerate of candle-core ^0.6.0, candle-nn ^0.6.0, and candle-transformers ^0.6.0
- cuda nccl?
-
Enables cuda of candle-core ^0.6.0, candle-nn ^0.6.0, and candle-transformers ^0.6.0
- cudnn
-
Enables cudnn of candle-core ^0.6.0
- mkl
-
Enables intel-mkl-src, mkl of candle-core ^0.6.0, candle-nn ^0.6.0, and candle-transformers ^0.6.0
- nccl = cuda
-
Enables nccl of cudarc ^0.9.14, num-traits, rand_distr and use-intrinsics of half
- metal
-
Enables metal of candle-core ^0.6.0, candle-nn ^0.6.0, candle-transformers ^0.6.0, and kalosm-common
- rayon
-
Enables rayon
Features from optional dependencies
In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.
- cudarc nccl?
-
Enables cudarc ^0.9.14