Dev global step (#2100)
* assign op AddGlobalStepOpConf fix ARITHMETIC_DATA_TYPE_SEQ identity_op_conf add ops GenNewSnapshotName SnapshotOp cleanup blob name LearningRateScheduleOp LearningRateScheduleKernel LearningRateScheduleKernel AddLearningRateScheduleOpConf learning rate cleanup fix fix * remove total_mbn_num * date time format * save * refine * refine * revert * refine snapshot * fix * refine * AutoGlobalStep * refine * GenLogicalBlobName * AutoLearningRate * remove JobDesc lr * fix snapshot path * Maybe<void> * learning_rate blob * remove next_model_vid fix fix fix learning_rate * train_conf * fix for global step on multi nodes * Fix optimizer initializer (#2095) * fix optimizer initializer * rename lars data temp bn
Showing
- oneflow/core/actor/normal_forward_compute_actor.cpp 1 addition, 2 deletionsoneflow/core/actor/normal_forward_compute_actor.cpp
- oneflow/core/job/job.proto 3 additions, 1 deletiononeflow/core/job/job.proto
- oneflow/core/job/job_desc.cpp 0 additions, 2 deletionsoneflow/core/job/job_desc.cpp
- oneflow/core/job/job_desc.h 0 additions, 2 deletionsoneflow/core/job/job_desc.h
- oneflow/core/job_completer/adam_optm.cpp 2 additions, 1 deletiononeflow/core/job_completer/adam_optm.cpp
- oneflow/core/job_completer/auto_global_step.cpp 1 addition, 1 deletiononeflow/core/job_completer/auto_global_step.cpp
- oneflow/core/job_completer/auto_learning_rate.cpp 61 additions, 0 deletionsoneflow/core/job_completer/auto_learning_rate.cpp
- oneflow/core/job_completer/auto_learning_rate.h 13 additions, 0 deletionsoneflow/core/job_completer/auto_learning_rate.h
- oneflow/core/job_completer/job_completer.cpp 2 additions, 0 deletionsoneflow/core/job_completer/job_completer.cpp
- oneflow/core/job_completer/lars_optm.cpp 5 additions, 1 deletiononeflow/core/job_completer/lars_optm.cpp
- oneflow/core/job_completer/momentum_optm.cpp 5 additions, 1 deletiononeflow/core/job_completer/momentum_optm.cpp
- oneflow/core/job_completer/naive_optm.cpp 1 addition, 1 deletiononeflow/core/job_completer/naive_optm.cpp
- oneflow/core/job_completer/optimizer.cpp 18 additions, 16 deletionsoneflow/core/job_completer/optimizer.cpp
- oneflow/core/job_completer/optimizer.h 2 additions, 1 deletiononeflow/core/job_completer/optimizer.h
- oneflow/core/job_completer/rmsprop_optm.cpp 1 addition, 1 deletiononeflow/core/job_completer/rmsprop_optm.cpp
- oneflow/core/kernel/adam_model_update_kernel.cpp 19 additions, 12 deletionsoneflow/core/kernel/adam_model_update_kernel.cpp
- oneflow/core/kernel/adam_model_update_kernel.cu 25 additions, 9 deletionsoneflow/core/kernel/adam_model_update_kernel.cu
- oneflow/core/kernel/adam_model_update_kernel.h 6 additions, 4 deletionsoneflow/core/kernel/adam_model_update_kernel.h
- oneflow/core/kernel/lars_model_update_kernel.cpp 10 additions, 14 deletionsoneflow/core/kernel/lars_model_update_kernel.cpp
- oneflow/core/kernel/lars_model_update_kernel.cu 10 additions, 10 deletionsoneflow/core/kernel/lars_model_update_kernel.cu
Please register or sign in to comment