* modified SetInputArgModifyFn

* Delete the CHECK changes in the assign_op.cpp file

* Format

* Modified the OutputArgModifyFn interface

* add return

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* OutputArgModifier return maybe part_1

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* input_arg_modifier return maybe

* gen_bw_fn return maybe

* bw_gen_fn return maybe

* registry_callback_fn return maybe

* fix bug after merge master

* fix bug

Co-authored-by: aishangjj <702572275@qq.com>

* modified SetInputArgModifyFn

* Delete the CHECK changes in the assign_op.cpp file

* Format

* Modified the OutputArgModifyFn interface

* add return

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* OutputArgModifier return maybe part_1

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

* input_arg_modifier return maybe

* gen_bw_fn return maybe

* bw_gen_fn return maybe

* fix bug: return Maybe without JUST

Co-authored-by: aishangjj <702572275@qq.com>

* Add interface InferContext::InputDType

* Make `*dtype` variables const reference

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: liufengwei0103 <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refactor Dtype4ArgNameAndIndex into OutputDType

* remove const

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add interface InferContext::InputShape

* delete repeated interface calling in dropout_op.cpp

* refactor_infer_ctx_output_shape

* auto format by CI

Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add interface InferContext::InputShape

* delete repeated interface calling in dropout_op.cpp

* auto format by CI

Co-authored-by: liufengwei <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Rename InferXXXFn as XXXInferFn

* rename interface_name

* modify infer_xxx_fn to xxx_infer_fn

Co-authored-by: binbinHan <han_binbin@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add blob object id and eager blob object interface

* use maybe for blob object id

* minor fix

* add registry for data type, modified dropout as example

* revert origin data type infer

* add infer data type entry

* minor fix infer data type

* user op 32~40

* add unchange data type

* user op 26~40

* fix inferDataType from 0-25

* remove infer data type from util no change

* fix is_dynamic attribute

* user op 70~80

* user op 66~70

* remove redundant dtype

* minor fix one hot

* move data infer interface to user op

* review and fix

* Zailiang_Make infer data type away from tensor desc (#4544)

* same_padding_op.cpp

* scalar_add_op.cpp

* scalar_by_tensor_op.cpp

* scalar_mul_op.cpp

* scalar_pow_op.cpp

* Sigmoid_cross_entropy_op.cpp

* slice_op.cpp

* smooth_l1_loss_op.cpp

* softmax_cross_entropy_op.cpp

* Update scalar_by_tensor_op.cpp

* sigmoid_op.cpp

* Dev split infer data type from tensor desc (81~95) (#4545)

* Splite InferDataType form 81 to 95

* Add is_dynamic

* fix relu

* Fix relu_op

* Add Reduce ops InferDataType

* start up (#4539)

* start up

* 121~128 done

* refine

* edit test_ops.cpp

* SetPhysicalTensorDescInferFn

* finished

* reformat

* remove reduntant code

* upsampling

* test_ops

Co-authored-by: poohRui <yuruil@qq.com>
Co-authored-by: Yurui Li <32978179+poohRui@users.noreply.github.com>

* Dev refactor split infer data type (#4547)

* softmax_op.cpp

* 107:sort_op.cpp

* 106-115

* 108-109

* 110

* 111

* 112

* 113

* 115

* 106-115

* modify 106-115

* modify assign

* zzk fix

Co-authored-by: MARD1NO <359521840@qq.com>
Co-authored-by: Yurui Li <32978179+poohRui@users.noreply.github.com>

* fix compile bug

* warning fix

* user op 41-80 (#4540)

* user op 41-50

* user op 51-55

* fix image_object_preprocess ops

* user op 56-65

* update

* update

* update

* fix a bug

* fix bug

* fix bug

* fix devconv bug

* fix multiple bugs

* make tensor buffer to tesor list as todo

* add impl for tensor buffer to tensor list

* remove data type from infer shape in matmul

* add check

* fix transpose bug

* fix test op bug

* add check for add n

* fix cast to static shape op bug

* fix dynamic loss

* remove unnecessary code in flatten op

* fix hierarchical parallel

* fix leaky relu op

* fix math binary broadcast

* remove unnecessary data type infer in math binary

* fix terrible bug in math binary

* format

* fix softmax bug

* remove unnecessary code for softmax cross entropy

* fix conv

* remove unnecessary code in maximum

* add comments

* fix image preprocess

* fix layer norm

* auto to auto&

* fix partial fc sample

* fix partial fc sample

* fix image preprocess ops

* format

* user sigmoid op

* format

* fix partial fc

* fix prelu

* add newer ops

* fix bug in math binary

* fix combined margin loss op

* fix ofrecord reader

* add fused bias add op

* format

Co-authored-by: MARD1NO <359521840@qq.com>
Co-authored-by: Zailiang <zailiangyu@gmail.com>
Co-authored-by: Zhenhua <1209435+hengzi@users.noreply.github.com>
Co-authored-by: doombeaker <later@usopp.net>
Co-authored-by: Hongsheng Wang <31394900+wanghongsheng01@users.noreply.github.com>
Co-authored-by: Mosout <mosout@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Remove batch_axis

* rm partial tick

* temp fix bug of flow.math.add

* fix bug of input_blob_def.split_axis init

* [KEY] refine infer sbp order value consider logical shape enable split

* ignore op get sbp sign ERROR.

* filter and check valid sbp sign by logical shape; rm magic num

* fix bug of return

* merge rm sigmoid cross entropy op

* rm sigmoid batch axis fn

* more debug log for check valid in get sbp sign

* rm useless check

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add cpu version

* add hardsigmoid kernel

* add test case

* fix

* add license at root dir

* check in empty files

* rm space

* check in script

* update script

* fix bug

* add print

* fix

* add exit

* add to of_format

* add CI task

* fix license

* Revert "fix license"

This reverts commit 818b6d7691d3a8b4a25dd41a47ff2c5922b8ec57.

* only add once

* quick fix

* fix script

* dont fmt empty file

* fix

* quick fix

* fix py

* add license

* fix exit

* add license for hpp

* add license

* license new vm files

Co-authored-by: tsai <caishenghang@oneflow.org>

* refactor user op get sbp sign

* refine interface name

* remove AddSplitSbpSignList interface

* Add interface for OpArg vec

* refine UserOpSbpSignBuilder to lvalue; using sbp_sig_tmp; set default sbp fn B2B

* using SbpSignatuerList

* Dev cc user sbp feature (#2859)

* ut save data draft

* 将数据存入全局dict里

* change sbp to new interface

* rewrite the reshape user op util

* fix conflicts

* details of the repair

* modify the newly merged user op

* fix format check

* update if

* fix blank line and remove clear

Co-authored-by: ouyangyu <64632757+ouyangyu62@users.noreply.github.com>
Co-authored-by: tsai <caishenghang@oneflow.org>

* Add gelu

* Add cuda implementation, python api and test

* Fix wrong input name

* Move nn.gelu to math.gelu, switch between user op/legacy op by env var

* Delete duplicate ops/gelu_kernel.cu

* refine tf_gelu

* re-format files

* add new method

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

* add relu user op

* rename kernel

* add python ifs nn.relu

* test relu fwd ok

* of format

* add namespace

* modify relu test file

* modify test_activations.py

* rm useless file

* fix

* update python interface

* fix matmul test

* update python api and test file

* SetInplaceProposalFn

* s->s

* AlwaysComputeWhenAllOutputsEmpty