Developers
Learn how to get your models up and running fast on Tenstorrent hardware.
With two open source SDKs, you can get as close to the metal as possible, or let our AI compiler do the work.
Model Support Table
Qwen 3 32B
QuietBox
LLM
TP=8
QwQ 32B
QuietBox
LLM
TP=8
DeepSeek R1 Distill Llama 3.3 70B
QuietBox
LLM
TP=8
Llama 3.1 70B
Galaxy
LLM
TP=32
Llama 3.1 70B
QuietBox
LLM
TP=8
Llama 3.2 11B Vision
n300
LLM
TP=2
Qwen 2.5 7B
n300
LLM
TP=2
Qwen 2.5 72B
QuietBox
LLM
TP=8
Falcon 7B
n150
LLM
Falcon 7B
QuietBox
LLM
DP=8
Falcon 7B
Galaxy
LLM
DP=32
Falcon 40B
QuietBox
LLM
TP=8
Llama 3.1 8B
p100
LLM
Llama 3.1 8B
p150
LLM
Llama 3.1 8B
2 x p150
LLM
DP=2
Llama 3.1 8B
n150
LLM
Llama 3.2 1B
n150
LLM
Llama 3.2 3B
n150
LLM
Mamba 2.8B
n150
LLM
Mistral 7B
n150
LLM
Mixtral 8x7B
QuietBox
LLM
TP=8
ResNet-50
n150
CNN
224 x 224
ResNet-50
n300
CNN
224 x 224
DP=2
ResNet-50
QuietBox
CNN
224 x 224
DP=8
ResNet-50
Galaxy
CNN
224 x 224
DP=32
ViT
n150
CNN
224 x 224
Stable Diffusion 1.4
n150
CNN
512 x 512
YOLOv4
n150
CNN
320 x 320
YOLOv4
n150
CNN
640 x 640
SegFormer Semantic Segmentation
n150
CNN
512 x 512
Stable Diffusion 3.5 medium
n150
CNN
512 x 512
BERT-Large
n150
NLP
Getting started on Tenstorrent
TT-Forge™
TT-Forge™ is Tenstorrent's MLIR-based compiler.
TT-NN™
TT-NN™ is a user-friendly API for running ML workloads on Tenstorrent hardware.
TT-Metalium™
TT-Metalium™ is Tenstorrent’s open source, low level AI hardware SDK.
Looking for other documentation?
Active Bounties
Solve bugs and add features to win cash prizes, and get our open source software to stable releases even faster.
Upcoming Events
Jun 25
Webinar | TT-Explorer
In this webinar, we'll introduce the TT-Explorer tool as a part of the TT-Forge™ project, highlighting the integration with our current compiler, runtime, and performance tracing infrastructure.
Jul 10
Office Hours | TT-Metal
Get to know Tenstorrent engineers in an informal environment with a focus on the tt-metal library.
Jul 16
Tech Talk Tokyo #2
Learn about data transfer and kernel programming at our second tech talk in Tokyo.
Educational Content
Tutorials
Tutorials
A guide to the Metalium programming model, Tenstorrent’s primary programming model.
Tutorials
Learn how to install and run ttnn-visualizer. ttnn-visualizer helps you gain a complete understanding of a model.
Written Tutorials
Bring up LLMs with TTNN
Get guidance on how to bring up high-performance multi-chip models on Tenstorrent hardware using the TT-Metalium stack.
Op Writer's Guide to Dispatch Overhead
This tutorial covers different methods to optimize dispatch overhead resource allocation, kernel initialization, and runtime arguments.
Join the Community
Get access to support on anything from setting up new hardware, running models or optimizing your setup, plus the latest on Tenstorrent hardware and software.
Interested in contributing?
Tenstorrent's AI software stack is open source. Getting started is as easy as filing an issue.