quote
active
quote:db-mtl-achieves-loss-scale-balancing-by-performing-logarithm-transformation-on-each-task-loss-and-rescales-gradient-magnitudes-by-normalizing-all-task-gradients-to-comparable-magnitudes-using-the-maximum-gradient-norm

DB-MTL achieves loss-scale balancing by performing logarithm transformation on each task loss, and rescales gradient magnitudes by normalizing all task gradients to comparable magnitudes using the maximum gradient norm.

Concise summary of the DB-MTL method from the abstract.

Source paper

extracted_from
Dual-Balancing for Multi-Task Learning
(2023) · Baijiong Lin · Weisen Jiang · Feiyang Ye · Yu Zhang +5

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.