At last year’s iPhone event, Apple announced that, starting with iOS 12 and the new A12 Bionic processor, Core ML models could now take advantage of the Apple Neural Engine (ANE). The ANE is a special co-processor capable of accelerating machine learning models to run up to 9X faster using just a tenth of the energy. While we’ve been able to verify these speedups in certain cases, we noticed they weren’t universal. Some models didn’t seem to be benefitting from the new hardware.
Continue reading Does my Core ML model run on Apple’s Neural Engine?