FPGA-based inference accelerator outscores GPUs and ASICs in MLPerf benchmark

Silicon Valley-based startup Mipsology announced today that its Zebra AI inference accelerator achieved the highest efficiency based on the MLPerf inference test.

The benchmark, which measures training and inference performance of ML hardware, software, and services, pitted Mipsology’s FPGA-based Zebra AI accelerator against venerable data center GPUs like the Nvidia A100, V100, and T4. Comparisons were also drawn with AWS Inferentia, Groq, Google TPUv3, and other.