* init of op diag

* init of op diag

* modify  op diag

* merge testcase

* delete no use tensor diag

* amend diag api docs

* resolve conficts

* resolve confict

* resolve confict

* resolve confict

* auto format by CI

* add tensor.diag

* auto format by CI

* amend API description

* add non_square test

* amend diag API description

* amend diag API description

* compact test code

* compact code

* auto format by CI

* amend API description

* amend API description

* motify functional API

* motify test_diag

* amend diag functional API

* amend diag docstring

* auto format by CI

* amend code standards

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* fix(Tensor): fix Tensor.grad setter bug

* refine error message

* fix(Tensor): fix bug

* add grad = grad * constant test

* update tensor.py to pr head

* format code

* fix(Parameter): fix Parameter construction bug

* fix bug

Co-authored-by: tea321000 <834914152@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add argmax test

* fix ci error

* fix docstring warning

* fix tensor greater and less bug

* fix conflict

* add test_flow_xxx_against_pytorch func

* add autotest part1

* add asin and arcsin module test

* auto format by CI

* try to fix export oneflow.python.test ci error

* delete __init__.py

* delete autotest tensor api

* fix ci export test_tensor_against_pytorch bug

* recover

* add tensor test

* auto format by CI

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Optimize tensor getitem.

* Fix merge

* Refine code style

* Fix typo and copy input if it's getitem is identity.

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Signed-off-by: daquexian <daquexian566@gmail.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Add in_top_k function

* auto format by CI

* fix bug

* Update oneflow/python/ops/math_ops.py

Co-authored-by: Yao Chi <later@usopp.net>

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: Yao Chi <later@usopp.net>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* startup: use python, not C extension

* rst changes test

* refine

* add F.rst

* add bernoulli add docstr example

* add doctest for functional method

* del docstr utils immediately in init.py

* refine test case

* use sin, cos instead of add, mul

* refine

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Throw exception if check failed.

* Fix undefined symbol

* Optimize reduce mean

* Fix mean axis.

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* export Tensor only to python

* address review comments

* address review comments

* refine

* Update tensor_tuple_util.py

fix bug

* Update tensor.cpp

fix bug

* Update tensor.cpp

fix bug

* auto format by CI

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: clackhan <han_binbin@163.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* Modified the OutputArgModifyFn interface

* maybe error stack from CheckAndConstructOp to OutputArgModifier callback function

Co-authored-by: aishangjj <702572275@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add torch maxpool2d cpu kernel implementation

* refine cpu implementation

* op gpu implemetation

* bug-fix

* refine

* add pooling kernel util

* reimplementation of cpu kernel

* gpu kernel implementation

* gpu kernel implementation

* bug fix

* change indice index

* change indice index of grad compute

* add flag: return_indices

* format code

* update inteface param

* add param dilation

* bug-fix

* update padding param

* add maxpool2d test case

* format code

* bug fix

* update tese case

* update sbp of indice

* add code sample

* add new line

* use oneflow_api.BlobDesc

* add op torch maxpool1d

* add sample codes

* change dtype of indice

* add torch maxpool3d interface

* add implementation of maxpool3d

* reformat codes

* add atomic add

* bug-fix

* backward bug fix

* update search index

* format code

* update imterface params

* add sample code of maxpool3d

* refine and add test case

* support ellipsis type slice

* refine

* refine

* support slice assign ellipsis type

* refine

* register fn to localtensor

* merge master

* update maxpooling ops

* refactor maxpool2d op

* add ceil mode testcase

* rm useless code

* refine

* refactor maxpool3d op and test cases

* refine

* add maxpool1d implementation

* simplify params using struct

* fix sbp fn

* del notes

* refine

* refine

* add pooling functional api impl

* refine

* update sbp fn

* refin thread num

* refine

* auto format by CI

* rm bn test for debug

* limit registers num

* remove double dtype

* .

* auto format by CI

* update data type

* refine

* add cuda synchronize and error string capture

* move synchronize placement

* debug all kernel compute

* debug

* debug

* debug

* debug

* auto format by CI

* debug std infinity

* debug

* add numeric utils

* format

* refine

* add reference

* remove useless header

* move namespace to detail

* fix doctest error

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* replace ForeignJobInstance using JobInstance

* LazyJobStreamType

* NNGraphIf

* NNGraph -> NNGraphIf

* fix compile bugs

* add unit tests for instruction RunLazyJob

* GetInputBufferName/GetOutputBufferName

* address pr comments

* add cuda complie switch

* refine

Co-authored-by: liufengwei <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: clackhan <han_binbin@163.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* feat(add_): support inplace add

* fix(add_): fix push bug

* Add InplaceableBinaryFunctor

* feat(add_): add tensor += other

* docs(add_): fix docs

* fix relu module bug

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* multi_client_session, single_client_session

* refactor

* modify according to MultiClientSessionContext api

* InitScopeStack in multi-client

* add function flag and scope attr

* address review

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* fix -1 index not support bug

* add test case

* fix -1 index not support bug

* Refactor infer ctx input tensordesc and related calls

* Modify the missing content

* Modify the post-merged error

* Add input judgment

* Missing modifications

* Fix merge errors

* format

* Modify omission

* Fix the crash caused by lack of judgment

* Delete comment

* Optimize naming

* Delete comment

* Delete blank lines

Co-authored-by: liufengwei0103 <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add argmax test

* fix ci error

* fix docstring warning

* fix tensor greater and less bug

* fix conflict

* add test_flow_xxx_against_pytorch func

* fix concat backward bug

* auto format by CI

* format

* Add autograd engine warning (#5444)

* add autograd engine warning

* fix bug

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* format

Signed-off-by: daquexian <daquexian566@gmail.com>

* only call getAsString() when isClassType() is true

Signed-off-by: daquexian <daquexian566@gmail.com>

* only call getAsString() when not null and isClassType() is true

Signed-off-by: daquexian <daquexian566@gmail.com>

* unset env vars, only set plugin when building oneflow itself

Signed-off-by: daquexian <daquexian566@gmail.com>

* reformat to llvm style

Signed-off-by: daquexian <daquexian566@gmail.com>

* Debug -> Release

Signed-off-by: daquexian <daquexian566@gmail.com>

* add missing JUST in master

Signed-off-by: daquexian <daquexian566@gmail.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* MultiClientSessionContext

* export multi-client session context

* add NOTE

* fix for new IsMultiClient

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* graph api

* add graph dummy test

* add test

* add recursive module mode

* graph.build test pass

* add detail check on graph inner node

* support config and train

* add repr for debug

* test buffer

* test buffer add

* refine test

* add comment

* refine test

* refactor Node to Block

* add named_state

* refine Graph.named_state()

* add state_tensortuple

* graph._compile()

* add mc session 0

* nn.graph: state tuple to private var; add BlockType; add simple multi client session

* NNGraphIf

* rm old graph.cpp

* nn.graph: add cpp NNGraph; export and call NNGraph

* add comment

* nn.Graph: rm prototype MultiClientSession

* nn.Graph: rm prototype MultiClientSession test

* nn.Graph: add TODO

* nn.Graph: hack to get Graph object name

* nn.Graph: get obj name

* nn.Graph: get obj name 2

* nn.Graph: format for review

* nn.Graph: format

* nn.Graph: format

* nn.Graph: pass flake8 check

* Update graph.py

* name with init count

* name with init count 2

Co-authored-by: Xinqi Li <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* implement smoothl1loss

* add smoothl1loss  test

* fix bug

* fix bug

* remove swp file

* fix bug

* refine

* refine_grpc_cmake_for_conda

* refine

* refine

* refine

* rm

* refine

* refine

* refine

* refine

* also fix opencv

* refine

* reorder

* refine gflags and glog

* rm useless

* rm useless

* rm useless

* refine

* rm var only available in protobuf

* add not-suppported check for reduce and size_average

* add test for datatype of int32

* auto format by CI

* implement backward and rebuild Factor

* rebuild Factor for smooth_l1_loss_grad

* auto format by CI

* fix bug

Co-authored-by: jackalcooper <jackalcooper@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* refine

* refine

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* store is_multi_client in a separate global obj, add launcher

Signed-off-by: daquexian <daquexian566@gmail.com>

* only call MasterSendAbort in single client

Signed-off-by: daquexian <daquexian566@gmail.com>

* remove is_multi_client in ProcessCtx proto

Signed-off-by: daquexian <daquexian566@gmail.com>

* ClusterInstruction::HaltBarrier -> OF_ENV_BARRIER

Signed-off-by: daquexian <daquexian566@gmail.com>

* use Maybe<bool> to store is_multi_client flag, restore init.py changes

Signed-off-by: daquexian <daquexian566@gmail.com>

* set an Error as initial value of Global<Maybe<bool>, MultiClient>

Signed-off-by: daquexian <daquexian566@gmail.com>

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* remove --user

Remove --user to fix the problem that oneflow cannot be installed to anaconda envs

* Update README.md

* Update README.md

* Update README.md

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* rm nn.Graph.train

* Update graph.py

GraphCofig default predict

* Update test_graph.py

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add pixelshufflev2 module

* update pixel shuffle module to v2

* handle pixelshufflev1

* handle pixelshufflev1

* auto format by CI

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* refactor_build_wheel_to_support_oneflowinc_images

* address review

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add bernoulli module

* fix doc test

* add bernoulli functor

* make changes according to review

* refine (#5415)

* refine rng related tests; make generator.seed() as api

Co-authored-by: Ldpe2G <liangdepeng@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add arg skip_audit

* refine

* support inplace forward

* support inplace backward

* add test case

* add test case for clone

* inplace is not support for leaf nodes

* refine clone

* add checks

* refine

* forbid clone with no grad

* Separate autograd meta to tensor (#5267)

* separate autograd meta

* minor fix

* fix acc_grad interface

* fix acc_grad with null

* minor fix

* inplace without clone

* refine

* minor fix

* remove maybe from constructor

* change from create to set

* fix merge bugs

* fix merge bug

* remove inplace flag in local_call_opkernel_phy_instr_operand

* remove out-date codes

* refine code

* add JUST

* fix merge master bug

* revert autograd engine input_grad check

* fix bug in tensor_hook

Co-authored-by: wyg1997 <wyg19970408@gmail.com>
Co-authored-by: Houjiang Chen <chenhoujiangcug@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>