concept
active
concept:4-bit-nf4-quantization

4-bit NF4 Quantization

Quantization applied to LLMs above 12B parameters to enable evaluation on available hardware

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.