claim
active
claim:db-mtl-reduces-gradient-conflict-and-improves-task-balance-compared-to-ewDB-MTL reduces gradient conflict and improves task balance compared to EW.
Effect on gradient conflict.
Source paper
extracted_from(2023) · Baijiong Lin · Weisen Jiang · Feiyang Ye · Yu Zhang +5
Neighborhood — ranked by edge-count
Findings (1)
finding
- Analysis of gradient conflict reduction.
Communities (3)
community
- Dual-balancing multi-task learningmembers_ofDB-MTL jointly balances loss scale and gradient magnitude, benchmarked on NYUv2 and Office-31.
- Dual balancing multi-task learningmembers_ofDB-MTL combines loss-scale and gradient-magnitude balancing, benchmarked across NYUv2, Cityscapes, QM9, and Office datasets.
- Dynamic balancing methods that increase gradient alignment and reduce task interference, evaluated on Office-31 domain adaptation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Concise summary of the DB-MTL method from the abstract.
- Core claim of the paper.
- Computational efficiency comparison.
- Training stability claim.
- Training stability analysis.
- Observation illustrating the task balancing problem on NYUv2.
- DB-MTL with EMA forgetting rate β in a wide range performs better than without EMA (β=0) on Office-31.finding0.779Effect of EMA forgetting rate on performance.
- The proposed method combining loss-scale balancing via logarithm transformation and gradient-magnitude balancing via maximum-norm normalization.