Skip to content

AVX2 and NEON

Compare
Choose a tag to compare
@gotzmann gotzmann released this 20 Apr 16:12
· 36 commits to main since this release
eea0850

Inference performance was boosted for CPUs supporting vector math.

Please use:

--neon flag for Apple Silicon (M1-M3 processors) and ARM servers

--avx for Intel and AMD CPUs which supports AVX2 instruction set