Softmax Function

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• The softmax function may be interpreted as performing lateral inhibition, leading to sharper inferences.claim0.801
  Interpretation of neural implementation in Section 5.1.
• Softmax Activation Function as Neuronal Modelmethod0.787
  Using softmax to translate membrane potentials into firing rates, implementing lateral inhibition.
• Softmax Bottleneckconcept0.779
  Failure mode for output-surjectivity: LLMs may lack capacity to predict all tokens due to rank constraints
• Softmax Inc.institute0.777
  Organisation that hosted the Holistic Intelligence unconference where the paper's ideas originated
• Softmax policy selectionmethod0.746
  Selecting policies using a softmax (normalized exponential) function of negative expected free energy.
• Softmax Policy Priorconcept0.740
  Policies assigned probability via softmax of expected free energy; enables self-evidencing behavior.
• Adaptive Beta Softmax Scalingmethod0.738
  Implementation detail weighting softmax by log(n_memories) to prevent down-weighting of attention values as memory set grows.
• Reward Functionconcept0.711
  In RL, a scalar signal from the environment that defines the agent's goal; in active inference, reward is just another observation with associated preference.