Cargo Features

[dependencies]
norma = { version = "0.0.3", default-features = false, features = ["whisper", "serde", "jack", "oboe-shared-stdcxx", "cuda", "flash-attn", "cudnn", "metal", "accelerate", "openssl"] }
default = _mock, serde, whisper

By default ship with all models enabled

whisper default = byteorder, candle-core, candle-nn, candle-transformers, hf-hub, rand, serde_json, strum, tokenizers

Affects models::whisper

_mock default

A mock model used for testing

Affects models::mock

serde default

Enables serde

Serde

jack

Enables jack of cpal

oboe-shared-stdcxx

Enables oboe-shared-stdcxx of cpal

cpal:

Only available on Android. See README for what it does.

cuda cudnn? flash-attn?

Require cuda

Enables cuda of candle-core, candle-nn, and candle-transformers

candle-core:

Whisper

flash-attn = cuda

Enables flash-attn of candle-transformers

cudnn = cuda

Require cudnn

Enables cudnn of candle-core

metal

Only applicable to MacOS

Enables metal of candle-core, candle-nn, and candle-transformers

accelerate

Enables accelerate of candle-core, candle-nn, and candle-transformers

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

candle-core accelerate? cuda? cudnn? metal? whisper
candle-nn accelerate? cuda? metal? whisper
candle-transformers accelerate? cuda? flash-attn? metal? whisper
tokenizers whisper
hf-hub whisper
serde_json whisper
rand whisper
byteorder whisper
strum whisper
openssl cfg(any()) implicit feature

Enables openssl

openssl:

OpenSSL bindings