concept
active
concept:input-injectivityInput-Injectivity
Assumption that DNN layers preserve input information by being injective; key condition for Theorem 1
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (2)
finding
- Supports input-injectivity assumption for transformers at initialisation
- Empirical support for input-injectivity assumption holding in practice
Concepts (1)
concept
- Neural CollapsecontradictsTerminal phase phenomenon in deep learning training relevant to convergence of representations
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Correctness of input statements to an LLM, as opposed to output-truth (correctness of model-generated outputs).
- Input from environment that the agent models and predicts.
- Models maintain ability to accurately transcribe input text while simultaneously reporting on injected thoughts, all models perform above chance, Opus 4/4.1 best.
- Practical restriction of interventions to those producible by actual inputs; standard in DAS practice
- The cognitive outcomes that are directly proportional to the presence of loose parts, according to Nicholson.
- Diagrammatic encoding of program behavior via concept lattices reveals reachability structure and non-determinism without fixed calculational rules.
- Specification relating a program's inputs and outputs, analogous to illocutionary correctness.