Developers
Learn how to get your models up and running fast on Tenstorrent hardware.
With two open source SDKs, you can get as close to the metal as possible, or let our AI compiler do the work.
Model Support Table
QwQ 32B
QuietBox
LLM
TP=8
DeepSeek R1 Distill Llama 3.3 70B
QuietBox
LLM
TP=8
Llama 3.1 70B
Galaxy
LLM
TP=32
Llama 3.1 70B
QuietBox
LLM
TP=8
Llama 3.2 11B Vision
n300
LLM
TP=2
Qwen 2.5 7B
n300
LLM
TP=2
Qwen 2.5 72B
QuietBox
LLM
TP=8
Falcon 7B
n150
LLM
Falcon 7B
QuietBox
LLM
DP=8
Falcon 7B
Galaxy
LLM
DP=32
Falcon 40B
QuietBox
LLM
TP=8
Llama 3.1 8B
p100
LLM
Llama 3.1 8B
p150
LLM
Llama 3.1 8B
2 x p150
LLM
DP=2
Llama 3.1 8B
n150
LLM
Llama 3.2 1B
n150
LLM
Llama 3.2 3B
n150
LLM
Mamba 2.8B
n150
LLM
Mistral 7B
n150
LLM
Mixtral 8x7B
QuietBox
LLM
TP=8
ResNet-50
n150
CNN
224 x 224
ResNet-50
n300
CNN
224 x 224
DP=2
ResNet-50
QuietBox
CNN
224 x 224
DP=8
ResNet-50
Galaxy
CNN
224 x 224
DP=32
ViT
n150
CNN
224 x 224
Stable Diffusion 1.4
n150
CNN
512 x 512
YOLOv4
n150
CNN
320 x 320
YOLOv4
n150
CNN
640 x 640
SegFormer Semantic Segmentation
n150
CNN
512 x 512
Stable Diffusion 3.5 medium
n150
CNN
512 x 512
BERT-Large
n150
NLP
Getting started on Tenstorrent
TT-Forge™
TT-Forge™ is Tenstorrent's MLIR-based compiler.
TT-NN™
TT-NN™ is a user-friendly API for running ML workloads on Tenstorrent hardware.
TT-Metalium™
TT-Metalium™ is Tenstorrent’s open source, low level AI hardware SDK.
Looking for other documentation?
Active Bounties
Solve bugs and add features to win cash prizes, and get our open source software to stable releases even faster.
Upcoming Events
May 31
Multi-Agent Hackathon: Build Multi-Modal Workflows with Tenstorrent
This hackathon is focused on building, deploying, and benchmarking multi-modal workflows including image, video, and LLMs using Tenstorrent hardware and Koyeb's cloud platform.
Jun 6
Tenstorrent Meetup Tokyo
Visit Tenstorrent's Tokyo office and get an overview of Tenstorrent hardware and software, with an emphasis on Tenstorrent's AI accelerator and the Tensix cores that power it.
Jun 7
Edge AI Hardware Hack with Tenstorrent
Join for a full day of building on the latest AI hardware with the Tenstorrent team. Whether you’re into compiler internals, ML training, or graphics experiments, there’s something here to build on. The winner will take home a Wormhole™ n150d.
Jun 11
Office Hours | TT-Forge
Get to know TT-Forge engineers in an informal environment ahead of stable release in summer 2025.
Educational Content
Tutorials
Tutorials
A guide to the Metalium programming model, Tenstorrent’s primary programming model.
Tutorials
Learn how to install and run ttnn-visualizer. ttnn-visualizer helps you gain a complete understanding of a model.
Written Tutorials
Bring up LLMs with TTNN
Get guidance on how to bring up high-performance multi-chip models on Tenstorrent hardware using the TT-Metalium stack.
Op Writer's Guide to Dispatch Overhead
This tutorial covers different methods to optimize dispatch overhead resource allocation, kernel initialization, and runtime arguments.
Join the Community
Get access to support on anything from setting up new hardware, running models or optimizing your setup, plus the latest on Tenstorrent hardware and software.
Interested in contributing?
Tenstorrent's AI software stack is open source. Getting started is as easy as filing an issue.