quote
active
quote:so-at-any-point-in-the-network-the-transformer-not-only-receives-information-from-its-past-but-also-has-causal-influence-over-its-future-processing-so-saying-that-llms-cannot-introspect-is-incorrect

So at any point in the network, the transformer not only receives information from its past... but also has causal influence over its future processing. So, saying that LLMs cannot introspect... is incorrect.

Core summary of Janus' position on autoregressive recurrence enabling introspection.

Source paper

extracted_from
Anima Labs Phenomenology Pt1

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.