Developers
Learn how to get your models up and running fast on Tenstorrent hardware.
With two open source SDKs, you can get as close to the metal as possible, or let our AI compiler do the work.
Model Support Table
Qwen 3 32B
QuietBox
LLM
TP=8
QwQ 32B
QuietBox
LLM
TP=8
DeepSeek R1 Distill Llama 3.3 70B
QuietBox
LLM
TP=8
Llama 3.1 70B
Galaxy
LLM
TP=32
Llama 3.1 70B
QuietBox
LLM
TP=8
Llama 3.2 11B Vision
n300
LLM
TP=2
Qwen 2.5 7B
n300
LLM
TP=2
Qwen 2.5 72B
QuietBox
LLM
TP=8
Falcon 7B
n150
LLM
Falcon 7B
QuietBox
LLM
DP=8
Falcon 7B
Galaxy
LLM
DP=32
Falcon 40B
QuietBox
LLM
TP=8
Llama 3.1 8B
p100
LLM
Llama 3.1 8B
p150
LLM
Llama 3.1 8B
2 x p150
LLM
DP=2
Llama 3.1 8B
n150
LLM
Llama 3.2 1B
n150
LLM
Llama 3.2 3B
n150
LLM
Mamba 2.8B
n150
LLM
Mistral 7B
n150
LLM
Mixtral 8x7B
QuietBox
LLM
TP=8
BERT-Large
n150
NLP
Sentence-Bert (backbone: bert-base)
n150
NLP
Getting started on Tenstorrent
TT-Forge™
TT-Forge™ is Tenstorrent's MLIR-based compiler.
TT-NN™
TT-NN™ is a user-friendly API for running ML workloads on Tenstorrent hardware.
TT-Metalium™
TT-Metalium™ is Tenstorrent’s open source, low level AI hardware SDK.
Looking for other documentation?
Active Bounties
Solve bugs and add features to win cash prizes, and get our open source software to stable releases even faster.
Upcoming Events
Jul 16
Tech Talk Tokyo #2
Learn about data transfer and kernel programming at our second tech talk in Tokyo.
Jul 23
Building AI agents with Tenstorrent
Tenstorrent hardware is designed to optimize the operations that power AI. Learn how you can run models on Tenstorrent hardware to build multi-agent systems and workflows.
Aug 9
COSCUP 2025
Stop by our booth at the Conference for Open Source Coders, Users & Promoters (COSCUP), the largest open source conference in Asia.
Educational Content
Tutorials
Tutorials
A guide to the Metalium programming model, Tenstorrent’s primary programming model.
Tutorials
Learn how to install and run ttnn-visualizer. ttnn-visualizer helps you gain a complete understanding of a model.
Written Tutorials
Bring up LLMs with TTNN
Get guidance on how to bring up high-performance multi-chip models on Tenstorrent hardware using the TT-Metalium stack.
Op Writer's Guide to Dispatch Overhead
This tutorial covers different methods to optimize dispatch overhead resource allocation, kernel initialization, and runtime arguments.
Join the Community
Get access to support on anything from setting up new hardware, running models or optimizing your setup, plus the latest on Tenstorrent hardware and software.
Interested in contributing?
Tenstorrent's AI software stack is open source. Getting started is as easy as filing an issue.