I recently wrote this article about why I’m excited for Hardware 3 (coming sometime around April).
The number of INT8 teraops (a.k.a. DNN teraops or DL teraops) Tesla is aiming for — I think something in the ballpark of 100 INT8 teraops — is a multiple of Mobileye’s EyeQ5 (24 teraops), a fraction of Nvidia’s Pegasus (320 teraops), and about same as what the Google self-driving car project said in mid-2016 it would like to have (100 teraops).
Andrej Karpathy teased that Tesla has bigger, better neural networks ready to go, but they need the new hardware before they can run them in cars.