claim
active
claim:the-softmax-function-may-be-interpreted-as-performing-lateral-inhibition-leading-to-sharper-inferences

The softmax function may be interpreted as performing lateral inhibition, leading to sharper inferences.

Interpretation of neural implementation in Section 5.1.

Source paper

extracted_from
Active inference on discrete state-spaces: a synthesis
(2020) · Lancelot Da Costa · Thomas Parr · Noor Sajid · Sebastijan Veselic +2

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • Softmax interpreted as winner-take-all mechanism that sharpens neural representations.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.