artifact
active
artifact:one-layer-transformer-1l-model

One-layer transformer (1L model)

2.9M parameter decoder-only transformer studied, d_m=256, 4 heads, 4096 vocab.

Neighborhood — ranked by edge-count

Datasets (2)

dataset