Skip to content

Excited about the future of AI hardware? Apply to be a part of the Tenstorrent team >

05/10/21
Andrej Karpathy on Building the Software 2.0 Stack
by jyu@tenstorrent.com

A lot of our code is in the process of being transitioned from Software 1.0 (code written by humans) to Software 2.0 (code written by an optimization, commonly in the form of neural network training). In the new paradigm, much of the attention of a developer shifts from designing an explicit algorithm to curating large, varied, and clean datasets, which indirectly influence the code. I will provide a number of examples of this ongoing transition, cover the advantages and challenges of the new stack, and outline multiple opportunities for new tooling.