question
active
question:how-are-llms-actually-leveraging-the-architectural-degrees-of-freedom-for-introspection-in-practiceHow are LLMs actually leveraging the architectural degrees of freedom for introspection in practice?
Janus notes that while architecture permits introspection, it is a separate question how models use it.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Janus's central claim that the architecture enables introspection, though usage in practice is a separate question.
Artifacts (1)
artifact
- Original thread by janus explaining transformer information highways and introspection capabilities, posted on X.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Do LLMs leverage architectural capacity for introspection on internal computations and prior token generation?question0.845Central empirical question separating architectural possibility from actual model behavior; gates introspection research.
- Core claim directly challenged by prior work denying introspection; forms foundation for Koan Battery introspection studies.
- Core quote asserting architectural introspection permission.
- Primary positive claim of the paper, grounded in strength comparison and localization results
- Secondary question; paper demonstrates introspection but explicitly avoids pinning down specific mechanistic explanation, noting mechanisms could be shallow and specialized.
- Core summary of Janus' position on autoregressive recurrence enabling introspection.
- Central thesis statement of the paper
- Can instruction-tuned LLMs perform quantitative introspection of emotive states in conversation?question0.774Central research question motivating the entire paper