quote
active
quote:quote-increase-relativequote_increase_relative
Verbatim: 'Information increase is always, necessarily it seems, relative to a sub-system.'
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The direction of information increase is relative to the observer or user of the computationclaim0.761Example: 3×5→15 is a natural computation, but 15→3×5 (prime factorization) is also useful, showing that the 'gain' depends on the choice of normal form.
- Verbatim: 'Useful output has two aspects: Making information explicit—i.e. extracting the normal form. Data reduction—getting rid of a lot of the information in the input.'
- The puzzle that computation appears to gain information despite logical closure; resolved by relative to subsystems/observers.
- Classical RL algorithm adapted by the paper with modifications including clipped-surrogate losses and length-normalized advantages for agentic training.
- Verbatim: 'the copy-cat strategy can be seen as a dynamic version of the tautology A ∨¬A.'
- Fundamental puzzle motivating the paper: how can computation produce new information when output is logically implied by input and thermodynamics suggests information cannot increase?
- The author argues that while total system information is conserved (thermodynamic), computation gains information for the observer by making implicit information explicit and discarding irrelevant data.