* modified SetInputArgModifyFn

* Delete the CHECK changes in the assign_op.cpp file

* Format

* Modified the OutputArgModifyFn interface

* add return

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* OutputArgModifier return maybe part_1

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* input_arg_modifier return maybe

* gen_bw_fn return maybe

* bw_gen_fn return maybe

* registry_callback_fn return maybe

* fix bug after merge master

* fix bug

Co-authored-by: aishangjj <702572275@qq.com>

* modified SetInputArgModifyFn

* Delete the CHECK changes in the assign_op.cpp file

* Format

* Modified the OutputArgModifyFn interface

* add return

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* OutputArgModifier return maybe part_1

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* input_arg_modifier return maybe

* gen_bw_fn return maybe

* bw_gen_fn return maybe

* fix bug: return Maybe without JUST

Co-authored-by: aishangjj <702572275@qq.com>

* move btob to op

* auto format by CI

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* shorten XXIsDynamic4ArgNameAndIndex to be xxIsDynamic

* auto format by CI

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* delete const_cast in Output

* "refactor infer ctx input_isdynamic"

* refactor infer_ctx output_isdynamic

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* delete const_cast in Output

* "refactor infer ctx input_isdynamic"

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Add interface InferContext::InputDType

* Make `*dtype` variables const reference

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: liufengwei0103 <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refactor SbpXXX to cfg::SbpXXX

* modify ParallelDistributionHint4InputArgNameAndIndex to be const function

* fix sbp to cfg::sbp in job_pass

* fix bug ToProto, InitFromProto and pb passed to cfg

* auto format by CI

* fix gpt segment fault

* fix xla

* tmp commit

* tmp commit

* fix xla compile error

* [fix bug] return tmp in model_io_v2

* auto format by CI

Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: poohRui <yuruil@qq.com>

* refactor Dtype4ArgNameAndIndex into OutputDType

* remove const

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add interface InferContext::InputShape

* delete repeated interface calling in dropout_op.cpp

* refactor_infer_ctx_output_shape

* auto format by CI

Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add interface InferContext::InputShape

* delete repeated interface calling in dropout_op.cpp

* auto format by CI

Co-authored-by: liufengwei <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Rename InferXXXFn as XXXInferFn

* rename interface_name

* modify infer_xxx_fn to xxx_infer_fn

Co-authored-by: binbinHan <han_binbin@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add blob object id and eager blob object interface

* use maybe for blob object id

* minor fix

* add registry for data type, modified dropout as example

* revert origin data type infer

* add infer data type entry

* minor fix infer data type

* user op 32~40

* add unchange data type

* user op 26~40

* fix inferDataType from 0-25

* remove infer data type from util no change

* fix is_dynamic attribute

* user op 70~80

* user op 66~70

* remove redundant dtype

* minor fix one hot

* move data infer interface to user op

* review and fix

* Zailiang_Make infer data type away from tensor desc (#4544)

* same_padding_op.cpp

* scalar_add_op.cpp

* scalar_by_tensor_op.cpp

* scalar_mul_op.cpp

* scalar_pow_op.cpp

* Sigmoid_cross_entropy_op.cpp

* slice_op.cpp

* smooth_l1_loss_op.cpp

* softmax_cross_entropy_op.cpp

* Update scalar_by_tensor_op.cpp

* sigmoid_op.cpp

* Dev split infer data type from tensor desc (81~95) (#4545)

* Splite InferDataType form 81 to 95

* Add is_dynamic

* fix relu

* Fix relu_op

* Add Reduce ops InferDataType

* start up (#4539)

* start up

* 121~128 done

* refine

* edit test_ops.cpp

* SetPhysicalTensorDescInferFn

* finished

* reformat

* remove reduntant code

* upsampling

* test_ops

Co-authored-by: poohRui <yuruil@qq.com>
Co-authored-by: Yurui Li <32978179+poohRui@users.noreply.github.com>

* Dev refactor split infer data type (#4547)

* softmax_op.cpp

* 107:sort_op.cpp

* 106-115

* 108-109

* 110

* 111

* 112

* 113

* 115

* 106-115

* modify 106-115

* modify assign

* zzk fix

Co-authored-by: MARD1NO <359521840@qq.com>
Co-authored-by: Yurui Li <32978179+poohRui@users.noreply.github.com>

* fix compile bug

* warning fix

* user op 41-80 (#4540)

* user op 41-50

* user op 51-55

* fix image_object_preprocess ops

* user op 56-65

* update

* update

* update

* fix a bug

* fix bug

* fix bug

* fix devconv bug

* fix multiple bugs

* make tensor buffer to tesor list as todo

* add impl for tensor buffer to tensor list

* remove data type from infer shape in matmul

* add check

* fix transpose bug

* fix test op bug

* add check for add n

* fix cast to static shape op bug

* fix dynamic loss

* remove unnecessary code in flatten op

* fix hierarchical parallel

* fix leaky relu op

* fix math binary broadcast

* remove unnecessary data type infer in math binary

* fix terrible bug in math binary

* format

* fix softmax bug

* remove unnecessary code for softmax cross entropy

* fix conv

* remove unnecessary code in maximum

* add comments

* fix image preprocess

* fix layer norm

* auto to auto&

* fix partial fc sample

* fix partial fc sample

* fix image preprocess ops

* format

* user sigmoid op

* format

* fix partial fc

* fix prelu

* add newer ops

* fix bug in math binary

* fix combined margin loss op

* fix ofrecord reader

* add fused bias add op

* format

Co-authored-by: MARD1NO <359521840@qq.com>
Co-authored-by: Zailiang <zailiangyu@gmail.com>
Co-authored-by: Zhenhua <1209435+hengzi@users.noreply.github.com>
Co-authored-by: doombeaker <later@usopp.net>
Co-authored-by: Hongsheng Wang <31394900+wanghongsheng01@users.noreply.github.com>
Co-authored-by: Mosout <mosout@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Remove batch_axis

* rm partial tick

* temp fix bug of flow.math.add

* fix bug of input_blob_def.split_axis init

* [KEY] refine infer sbp order value consider logical shape enable split

* ignore op get sbp sign ERROR.

* filter and check valid sbp sign by logical shape; rm magic num

* fix bug of return

* merge rm sigmoid cross entropy op

* rm sigmoid batch axis fn

* more debug log for check valid in get sbp sign

* rm useless check

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* parallel_cast user op

* replace parallel_cast in PruneParallelCastOpsPass

* replace parallel_cast in IndexedSlicesOptimizerRewritePass

* replace parallel_cast in DoParallelCastBeforeWideningTypeCast

* replace parallel_cast in autograd

* rm old parallel_cast op

* rm special check of parallel_cast in auto mixed precision

* fix typo

* update PruneParallelCastOpsPass

* improve code

* use string attr to indicate sbp

* make common sbp_parallel util function

* modify by review

Co-authored-by: guo ran <360112263@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>