2.3K Star 8.1K Fork 4.3K

GVPMindSpore / mindspore

 / 详情

Support group dynamic loss scale manager

TODO
Requirement 成员
创建于  
2022-05-09 15:41
name about labels
RFC Use this template for requirement to be discussed kind/feature or kind/enhancement
Requirement Use this template for Confirmed requirements kind/feature or kind/enhancement

Backgroud(背景信息)

  • Describe/Explain the status of the problem you wish to solve.
  • Attach relevant issues if there is any.
    The dyanmic loss scale currently only support the global overflow status and will be scaled at the same time.

Origin(信息来源)

  • Explain which department/team made this request so that its priority can be given.

Benefit / Necessity (价值/作用)

  • Describe/Explain the key value by fulfilling the request.
    The loss scale configs are divided into serveral groups. Each group has its own overflow status. The loss scale in one group will be scaled according to the overflow status of certain group.

Design(设计方案)

  • Describe/Explain the general idea of the design. Pseudo-code is allowed
    Network
    | <- loss_scale1
    layer1
    | <- loss_scale2
    layer2
    | <- loss_scale3
    layer3
    | <- loss_scale4
    layer4
    | <- loss_scale5
    layer5
    | <- loss_scale6
    fc
    MindSpore support multi-layer dynamic loss scale

评论 (2)

guoqi 创建了Requirement

Please assign maintainer to check this issue.
请为此issue分配处理人。
@guoqi

Please add labels (comp or sig), also you can visit https://gitee.com/mindspore/community/blob/master/sigs/dx/docs/labels.md to find more.
为了让代码尽快被审核,请您为Pull Request打上 组件(comp)或兴趣组(sig) 标签,打上标签的PR可直接推送给责任人进行审核。
更多的标签可以查看https://gitee.com/mindspore/community/blob/master/sigs/dx/docs/labels.md
以组件相关代码提交为例,如果你提交的是data组件代码,你可以这样评论:
//comp/data
当然你也可以邀请data SIG组来审核代码,可以这样写:
//sig/data
另外你还可以给这个PR标记类型,例如是bugfix或者是特性需求:
//kind/bug or //kind/feature
恭喜你,你已经学会了使用命令来打标签,接下来就在下面的评论里打上标签吧!

登录 后才可以发表评论

状态
负责人
项目
里程碑
Pull Requests
关联的 Pull Requests 被合并后可能会关闭此 issue
分支
开始日期   -   截止日期
-
置顶选项
优先级
预计工期 (小时)
参与者(2)
6575002 guoqi1024 1584438719
Python
1
https://gitee.com/mindspore/mindspore.git
git@gitee.com:mindspore/mindspore.git
mindspore
mindspore
mindspore

搜索帮助