Attention Pattern Analyzer

Real-time transformer attention visualization powered by in-browser model inference

Input Text
Model
Initializing...
Architecture DistilBERT
Layers 6
Heads / Layer 12
Layer 0
Attention Head Avg
Tokens (0)

Attention Weights

Loading Model...
0.0 1.0
All Heads — Layer 0
Running inference...