Inspect a Tensor
With navigation comfortable (see Explore a Model Architecture), this walks through going from a whole tensor down to a single scalar's exact value.
Steps
- Select any weight tensor - a
q_projormlp.up_projweight is a good first choice - either from the Outliner or by clicking it in the Architecture view. - Look at the Inspector panel: shape, dtype, device, and summary statistics (mean, min/max/absmax) appear immediately, computed in advance rather than on demand.
- Switch to the Matrix and Heatmap view (
2) for a precise 2D read of the tensor's values. - Hover a single cell - its exact value shows immediately. Click it to open the full Scalar Inspector.
- In the Scalar Inspector, note the scalar's full address (model → layer → module → tensor → tile → row/column → this exact value) - the same path a TQL expression would use to select it directly.
✅
If you can see one exact scalar value along with its full address back up to the model, you've completed the drill-down from model to scalar - the same path every deeper investigation in Tensormorph follows.
Try a query
Open the Console (part of the command palette, : prefix for a quick filter) and try a simple TQL expression, such as filtering the current tensor for values above its mean. This is the same statistics you just saw in the Inspector panel, now queried directly instead of read visually.
Next step
Continue to Compare Two Models to see how this same tensor looks against a different revision.
Related resources
- Tensor Statistics - the full set of statistics shown in the Inspector panel.
- TQL: Expressions and Queries - querying tensor data directly.