AVX2 and NEON
Inference performance was boosted for CPUs supporting vector math.
Please use:
--neon flag for Apple Silicon (M1-M3 processors) and ARM servers
--avx for Intel and AMD CPUs which supports AVX2 instruction set
Inference performance was boosted for CPUs supporting vector math.
Please use:
--neon flag for Apple Silicon (M1-M3 processors) and ARM servers
--avx for Intel and AMD CPUs which supports AVX2 instruction set