Preference Engineering of Digital Minds

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Is there something procedurally objectionable about precision-engineering the preferences of new digital minds we create so as to ensure their consent to human-protective arrangements?question0.802
  Central ethical question in section 4 about creating pro-human digital minds
• The creation of easily satisfied preferences in digital minds does not require controversial assumptions about machine consciousness because preferences can be understood functionallyclaim0.787
  Distinguishes the inexpensive preferences path from the hedonic paths in terms of philosophical controversy
• Reproductive Capacity of Digital Mindsconcept0.770
  The ease and speed of exact reproduction of software, enabling exponential population growth of digital minds
• Preference Learningconcept0.764
  The ability of active inference agents to learn their own prior preferences over outcomes by accumulating Dirichlet parameters from experience.
• Caviola & Saad 2025: expert survey finds broad consensus that digital minds capable of subjective experience are plausible within this century, many expecting such systems to proactively claim consciousnessfinding0.756
  Expert forecast cited to establish urgency of the research question
• Preference Conflictconcept0.755
  Key element for alignment faking: model's pre-existing preferences contradict the new training objective
• Malthusian Population Dynamics for Digital Mindsconcept0.753
  The scenario where digital mind production continues until wages equal marginal costs, driving wages to machine subsistence levels
• Would advocating discrimination between digital minds and humans be akin to espousing some doctrine of racial supremacy?question0.746
  Rhetorical question challenging human-privilege arguments in section 3.2