Skip to content
Snippets Groups Projects
Unverified Commit d5aa496f authored by i-robot's avatar i-robot Committed by Gitee
Browse files

!3834 修复vit网络在pynative模式下性能较差的问题

Merge pull request !3834 from 冯一航/fix_vit_optimizer
parents f7d805d2 37df3dc3
No related branches found
No related tags found
No related merge requests found
......@@ -18,6 +18,7 @@ import numpy as np
import mindspore as ms
import mindspore.ops as ops
from mindspore import ms_function
from mindspore._checkparam import Validator as validator
from mindspore.common.initializer import initializer
......@@ -145,6 +146,7 @@ class AdamW(Optimizer):
self.reciprocal_scale = Tensor(1.0 / loss_scale, ms.float32)
self.clip = clip
@ms_function
def construct(self, gradients):
lr = self.get_lr()
gradients = scale_grad(gradients, self.reciprocal_scale)
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment