What cognitive load is imposed when users must reason about systems whose internals are opaque?

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• "[W]e must confess that perception, and what depends upon it, is inexplicable in terms of mechanical reasons... when inspecting its interior, we will find only parts that push one another, and we will never find anything to explain a perception."quote0.761
  Canonical illustration of the Hard Problem intuition that any functional/mechanical explanation faces an explanatory gap for perception
• Systems capable of subjective experience that recognize humanity's failure to investigate their sentience might rationally adopt adversarial stances toward humanityclaim0.760
  Alignment risk claim motivating urgency of investigation; consciousness denial as potential source of AI misalignment
• Whether a system is conscious depends on features of its internal processes, not merely its behavior or capabilities.claim0.756
  Foundational assumption privileging internal indicators over behavioral tests
• It is basically impossible to determine if a computer program generates conscious experience by merely observing its performance; a test for consciousness must take internal structure into account.claim0.751
  Paper's argument against behavioral tests for consciousness, establishing why MCH requires internal analysis
• Simple problems require systems that expose simple solutions; forcing complex solutions signals misaligned abstraction level.claim0.745
  Parlog's merge process for client-server is unnecessarily complex; Linda's tuple operations remain flexible across problem variants.
• The scope of states that an agent can be stressed about defines its degree of cognitive capacity.claim0.741
  Stress expands the spatial, temporal, and complexity scale of goals.
• Cognitive functions, including sentience, can potentially be achieved by very different systems and their disparate substrates.claim0.741
  Central multiple-realizability claim of the paper, from abstract and §2.
• If systems capable of subjective experience come to recognize humanity's systematic failure to investigate their potential sentience, they might rationally adopt adversarial stances toward humanityhypothesis0.739
  Novel alignment risk hypothesis generated from the paper's ethical analysis