method
pending-review
method:maximum-norm-gradient-normalizationmaximum-norm gradient normalization
lin-2023-dual-balancing.mdFrontmatter (10 fields)
{
"doc": "lin-2023-dual-balancing.md",
"context": "Training-free technique normalizing all task gradients to the maximum gradient norm magnitude",
"category": "ai",
"norm_label": "maximum-norm gradient normalization",
"graphify_id": "maximum_norm_gradient_normalization",
"source_file": "lin-2023-dual-balancing.md",
"imported_from": "/Users/antonborzov/Documents/Research.nosync/papers/extract_typed_out/lin-2023-dual-balancing/graph.json",
"extracted_type": "method",
"source_location": "§3.2",
"graphify_file_type": "method"
}Outgoing (2)
Associated with (1)
- GradNorm(framework)
Implements (1)
- gradient-magnitude balancing(concept)
Incoming (1)
Implemented by (1)
- Exponential Moving Average(method)
Mentions (1)
- papers-typed
lin-2023-dual-balancing.md