question
active
question:how-can-we-scale-head-loadings-and-qk-attributions-to-long-contexts

How can we scale head loadings and QK attributions to long contexts?

Quadratic scaling.

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.