#tensorflow #metal #neural-network #kernel

tract-metal

Tiny, no-nonsense, self contained, TensorFlow and ONNX inference

1 unstable release

0.21.7 Sep 23, 2024

#8 in #metal

Download history 158/week @ 2024-09-20 37/week @ 2024-09-27 11/week @ 2024-10-04 3/week @ 2024-10-11

209 downloads per month
Used in tract

MIT/Apache

1.5MB
33K SLoC

tract-metal

Updating Metal Flash Attention library

git clone https://github.com/philipturner/metal-flash-attention.git
cd metal-flash-attention

# for iOS
swift build.swift --platform iOS --xcode-path /Applications/Xcode.app
cp build/lib/libMetalFlashAttention.metallib path/to/tract/metal/src/kernels/libMetalFlashAttention-ios.metallib

# for MacOS
swift build.swift --platform macOS --xcode-path /Applications/Xcode.app
cp build/lib/libMetalFlashAttention.metallib path/to/tract/metal/src/kernels/libMetalFlashAttention-macos.metallib

Dependencies

~17–25MB
~334K SLoC