Is superintelligence necessarily moral?

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Are AI systems deserving of moral consideration?question0.772
  Ethical question raised in discussion.
• What if the probability of AI welfare and moral patienthood is low?question0.750
  Decision-making under low probability but high stakes.
• If AI systems could experience happiness and suffering and set and pursue their own goals based on their own beliefs and desires, then they would very plausibly merit moral consideration.hypothesis0.749
  Joint sufficiency of consciousness and robust agency.
• How shall we gauge moral responsibility and obligations toward chimeric and engineered beings without familiar evolutionary touchstones?question0.748
  Framing problem that motivates the paper: bioengineering will produce novel creatures that cannot be understood via traditional categories; Care provides substrate-independent framework.
• If an AI system could be a welfare subject and moral patient, then many model instances could be run after training, scaling up the problem rapidly.hypothesis0.746
  Scalability concern.
• Consciousness suffices for moral patienthood.claim0.733
  Normative premise of the consciousness route.
• We should err on the side of reducing false negatives with respect to sentience criteria for ethical concern.claim0.731
  Ethical precaution advocated by Levin and Crump et al.
• How shall we gauge moral responsibility and our moral obligations toward novel engineered beings without familiar natural forms as comparison?question0.729