* Add interface InferContext::InputDType

* Make `*dtype` variables const reference

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: liufengwei0103 <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refine and add test case

* support ellipsis type slice

* refine

* refine

* support slice assign ellipsis type

* refine

* register fn to localtensor

* set_lower_precision_avoid_ci_failing

* fix numpy runtime warning

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* update flatbuffer

* fix align

* revert

* add FLATBUFFERS_BUILD_TESTS=OFF

* revert

* refine

* add note

* Update flatbuffers.cmake

* FLATBUFFERS_BUILD_TESTS=OFF

* Update flatbuffers.cmake

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Update README.md

* Update release.yml

* Update release.yml

* Update README.md

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* added flatten backward

* flatten and softmax backward

* auto format by CI

* rename test functions, deleted useless attributes

* add cpu version of upsample

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refactor SbpXXX to cfg::SbpXXX

* modify ParallelDistributionHint4InputArgNameAndIndex to be const function

* fix sbp to cfg::sbp in job_pass

* fix bug ToProto, InitFromProto and pb passed to cfg

* auto format by CI

* fix gpt segment fault

* fix xla

* tmp commit

* tmp commit

* fix xla compile error

* [fix bug] return tmp in model_io_v2

* auto format by CI

Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: poohRui <yuruil@qq.com>

* add ReplicationPad2d

* add replicationpad2d

* update

* update

* update replicationpad2d

* update docstring

* auto format by CI

* Update test_replicationpad2d.py

update test

* bug fix about value

* auto format by CI

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* CMake logs CUDA version and root dir

* refine

* refine

* refine

* add timeout limit

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add kldivloss module

* support for larger range of target values

* add doctest

* separate testcase

* delete deprecated argument

* fix zeros device bug

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* first commit of floor

* Added function floor_op_tensor

* fixed a copy paste bug

* added test for backward_cpu

* Added more test cases, added doctest

* fix conflicts

* changed doctest testmod, eliminated the print commands in doctest

* made sure the math_op.py is the same as in the latest master branch

* added an ending newline

* auto format by CI

* fix test_tensor python format

* auto format by CI

* fix license

* fix docstring

* fix doc test format

* auto format by CI

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* Add auto cancel step for outdated commit

* refine

* add log

* add more set -x

* fix script

* rename 1node test a name not smiliar to 1node op test

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refine and add test case

* fix device

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* rename dl => platform

* rename ns

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add ConstantPad2d

* add ConstantPad2d

* add ConstantPad2d

* add ContantPad2d

* update constantpad2d

* update doctest

* update doctest

* Update ConstantPad2d.py

update line

* update name

* update

* review

* auto format by CI

* update docstring

Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

Co-authored-by: Houjiang Chen <chenhoujiangcug@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* fix bert backward bug

* fix argwhere module bug

* align dropout module with torch

* add adaptive_avg_pool2d ops register

* add adaptive_avg_pool2d ops register

* add adaptive_avg_pool2d ops register

* add adaptive_avg_pool2d forward kernel

* add adaptive_avg_pool2d backward kernel

* export flow.adaptive_avg_pool2d and test

* export flow.adaptive_avg_pool2d and test

* recover code

* fix op register bug

* get segment fault

* adaptive avgpool2d module

* delete useless user_op code

* add adaptive_avg_pool2d module test

* refine test_adaptive_avgpool2d module

* fix test_adaptive_avgpool2d op bug

* fix adaptive_avgpool2d_module bug

* fix adaptive_avgpool2d_module bug

* fix adaptive_avgpool2d_module bug

* add adaptive avg_pool2d module

* fix adaptive avg pool2d module backward bug

* fix adaptive avg pool2d module backward bug

* fix comments

* fix comment

* fix comment

* fix comment

* add adaptive_avg_pool_gpu_kernel

* add adaptive_avg_pool2d gpu kernel

* add adaptive_avg_pool2d gpu kernel

* udpate gpu kernel

* add adaptive avg pool2d backward

* add adaptiveavgpool2d danymic attrs

* code format

* add gradient funcs for adaptive_pool

* fix comments

* fix comments

* fix comments

* fix commnets

* fix commments

Co-authored-by: Ldpe2G <liangdepeng@gmail.com>

* refine and add test case

* support ellipsis type slice

* refine

* refine

* support slice assign ellipsis type

* refine

* register fn to localtensor

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* init instancenorm.

* fix bert backward bug

* set time limit

* add time limit

* add instancenorm and unittests

* add to rst

* clean code.

* add references to pytorch

* add tests

* auto format by CI

Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: jackalcooper <jackalcooper@gmail.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* add flag -lrt for cares

* Don't build cares exes so it won't fail at linkage

* refine

* refine

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Add CMake arg PIP_INDEX_MIRROR

* refine

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* check in files

* fix indentation

* refine

* first commit of op floor

* first commit of op acos

* split acos from math_ops and add doctest

* resolve conflicting files

* fix format bug

* auto format by CI

* add check license

* synchronize local with remote

* auto format by CI

* first commit of op acos

* Update tensor.cpp

* solve conflicts

* add of_softmax_use_fast_math (#4979)

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* auto format by CI

* ci check license

Co-authored-by: Luyang <flowingsun007@163.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: JiaojiaoYe1994 <jiaojiaoye@tum.de>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Add min/max modules

* Add backward test

* Fix bug

* Add backward test

* Revert

* fix min module backward error

* Add max test

* delete unnecessary code

* Revert sum module

* Update doctest

* Fix experimental api

* fix loss test

* Fix Std op

* Rename keepdims to keepdim

* Fix l1loss import bug

Co-authored-by: Ldpe2G <liangdepeng@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* added flatten backward

* flatten and softmax backward

* auto format by CI

* rename test functions, deleted useless attributes

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* add argmax test

* fix ci error

* fix docstring warning

* fix tensor greater and less bug

* init commit

* init commit

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refine imports

* refine

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* module l1_loss

* modify l1_loss

* add l1loss_backward_testCase

* modify doctest format

* set raise_on_error=True

* add empty line

* modify empty line

* auto format by CI

* modify note

* modify tolerance

* modify testCase

* modify and add more testCase

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* Update generated functional files only when different.

* Use default target other than custom command.

* fix typo

Co-authored-by: jackalcooper <jackalcooper@gmail.com>

* update nightly version 0.5.0

* list cu112

* fix conflict

* add topk op and testcases

* add old top_k testcase

* fix doc_test

* fix testcase

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refine and add test case

* support scalar input

* ../oneflow/python/nn/modules/eq.py

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>