concept
active
concept:bertologyBertology
A body of research studying internal representations of transformer language models, especially BERT, including probing methods and attention head analysis
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Token-level BERT embedding similarity metric used for both diversity comparison and relevancy evaluation
- Sentence-level semantic similarity metric repurposed as diversity measure in Tevet and Berant 2021
- Cosine similarity between BERT sentence embeddings; top automatic baseline for semantic diversity
- Criterion of similar brain structure to humans; deemed inadequate for novel agents.
- The systematic first-person investigation of experience as practiced in Buddhism, particularly regarding tanha and dependent origination.
- The circular definition in RL where rewards reinforce behaviors that secure rewards, e.g., going to a cafe because coffee is rewarding.
- Proposed new tradition of studying machine psychology through phenomenology, akin to human introspection research.