Investigating Apple’s new "Neural Accelerators" in each GPU core (A19 Pro vs M4 Pro vs M4 vs RTX 3080 – Local LLM Speed Test!)
Hey everyone 😀 I thought it’d be really interesting to compare how Apple's new A17 Pro (and in turn, the M5) with its fancy new "neural accelerators" in each GPU core compare to other GPUs! I ran Gemma 3n 4B on each of these devices, out…