Approximations and prunings compose badly, so postpone them.

Source paper

extracted_from

Denotational design with type class morphisms (extended version)

(2015) · Elliott, Conal

Neighborhood — ranked by edge-count

Communities (3)

community

Mechanistic interpretability & model evaluation
members_of
Spans attention head decomposition, benchmark awareness, and genomic pathogenicity prediction via neural models.
Autoregressive models and context window limitations
members_of
Theoretical and empirical analysis of why AR language models cannot maintain coherence or convergence beyond their context window through local interactions alone.
Deferred approximation composition principle
members_of
Avoid early pruning/approximation because their errors compound when composed sequentially.

Concepts (1)

concept

Image
about
A functional type representing a mapping from 2D locations to colors (or other values), used for resolution-independent image synthesis.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Postpone Approximationsclaim0.819
Approximations and prunings compose badly; cleaner to maintain precise infinite semantics until final extraction
A question anywhere along the line that elicits a premature attempt at an answer could neutralize the remainder of the process into rationalization.hypothesis0.757
About chain-of-thought and process safety.
We hypothesize that a similar 'brutal' and purely geometric process always occurs somewhere in other kinds of unfolding that generate living order — in poetry, dance, social structure, planning, and family relationships.hypothesis0.756
Extends the brutal geometry thesis beyond architecture into all creative and social domains; acknowledged as not yet confirmed with certainty
This cannot be done by an additive process. It can only be done — as a practical matter — by trying to cover the whole plan as accurately as possible with a nearly regular grid, squeezed, distorted just enough to cover the peculiarities and necessities of plan.claim0.753
Asserts the aperiodic grid as the only practical method for achieving regular structural bays within an irregular envelope
Under these conditions, what is done next always has a natural and comfortable relation to what existed before: it has a similar structure and never violates the previously existing structure.claim0.750
Characteristic of a structure-preserving process.
Composition is non-trivial, i.e. a whole cannot be decomposed meaningfully.claim0.750
Defining property of Schrödinger compositional theory
Such priors suppress the inherent contextuality of the boundary.claim0.748
Explains why the boundary appears fixed: the prior hides its context-dependent nature.
We hypothesize that degraded generalization on benchmarks like MMLU may reflect the computational demands of the tasks.hypothesis0.745
Connecting the paper's task-difficulty findings to prior observations of weak generalization on complex QA benchmarks.