question
active
question:which-of-these-signals-implement-functional-circuits

Which of these signals implement functional circuits?

Motivating example.

Source paper

extracted_from
Characterizing interference weights in a tiny language model
Nicholas L. Turner · Jeffrey Wu · Joshua Batson

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Default circuitsconcept0.770
    Circuits active by default, e.g. can't-answer, suppressed by contrary evidence.
  • Circuit Motifconcept0.738
    A recurring, abstract pattern found in circuits (e.g., equivariance, unioning over cases), inspired by circuit motifs in systems biology
  • Circuits Frameworkframework0.737
    Mechanistic interpretability framework for understanding neural network computation as circuits of features
  • Signalconcept0.726
    Core abstraction in Fruit model: a function from continuous time to a value; foundation for reactive programming in Fruit.
  • One of the three major competing approaches to parallel programming mentioned in the paper; used for comparison with Linda.
  • The key novel property of DiffLogic CA — logic gate networks that are recurrent both spatially and temporally
  • Removing duplicate persistent features to shrink circuit depth.