* update automated test framework

Signed-off-by: daquexian <daquexian566@gmail.com>

* rename func -> generator

Signed-off-by: daquexian <daquexian566@gmail.com>

* reformat

Signed-off-by: daquexian <daquexian566@gmail.com>

* update more powerful conv test

Signed-off-by: daquexian <daquexian566@gmail.com>

* new imperative autotest api

Signed-off-by: daquexian <daquexian566@gmail.com>

* update automated test framework

Signed-off-by: daquexian <daquexian566@gmail.com>

* add some tests and refine code

Signed-off-by: daquexian <daquexian566@gmail.com>

* update test_matmul.py

Signed-off-by: daquexian <daquexian566@gmail.com>

* fix test_matmul.py

Signed-off-by: daquexian <daquexian566@gmail.com>

* add atol and rtol, fix test_matmul.py

Signed-off-by: daquexian <daquexian566@gmail.com>

* auto format by CI

* reformat

Signed-off-by: daquexian <daquexian566@gmail.com>

* tricky export

* tricky export

* fix comments

* auto format by CI

* fix comments

* auto format by CI

* fix code

* dirtyfix

* fixname

* fix

* fix bug

* fix comments

Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: tsai <jackalcooper@gmail.com>

* Multi-Client LogicalRun degenerate to PhysicalRun

* Add Logical->Physical in Multi-Client for IdGenerator and InstructionsBuilder

* multi client test

Signed-off-by: daquexian <daquexian566@gmail.com>

* auto format by CI

* fix wrong std::shared_ptr

Signed-off-by: daquexian <daquexian566@gmail.com>

* run module api test by test_multi_client/generic_test.sh

Signed-off-by: daquexian <daquexian566@gmail.com>

* fix test script

Signed-off-by: daquexian <daquexian566@gmail.com>

* use oneflow.distributed.launch -m unittest discover instead of bash for loop to speed up the test

Signed-off-by: daquexian <daquexian566@gmail.com>

* update ci/test_multi_client/generic_test.sh

Signed-off-by: daquexian <daquexian566@gmail.com>

Co-authored-by: chengtbf <472491134@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>

* mkdir compatible/single_client

* mv to compatible/singe_client/python

* mv to ./python/compatible/

* use oneflow.compatible.single_client

* back up

* backup

* refactor oneflow.xxx to oneflow.compatible.single_client.xxx

* mv to single_client

* refactor import oneflow to oneflow.compatible.single_client

* backup

* refine

* refine

* make single_clint ci test copy from correct path

* refine

* refine

* delete ioconf and split single-clint ci test

* auto format by CI

* delete default session

* fix method of erase sess id

* delete string multi client in test.yml

* fix spell error

* delete space

* refine

* mv single client python file to compatible_single_client_python

* refine

* fix ci error

* fix bug

* fix bug

* refine

* refine

* delete skip if in test/(modules/tensor)/* because of default eager env

* fix bug

* synchronization oneflow/compatible_single_client and oneflow/python

* fix distributed_run bug

* fix test_multi_process dead lock

* fix test_multi_process dead lock

* synchronization modify between oneflow/python and oneflow/compatible_single_client

* refine

* minor fix

* fix bug

* fix doctest.sh

* rm files

* remove files and add checks

* delete moduels

* Revert "delete moduels"

This reverts commit f95ab369f556b71fd0663b67c6dd51c9b6d5ee81.

Co-authored-by: Xinqi Li <lixinqi0703106@163.com>
Co-authored-by: liufengwei <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: tsai <jackalcooper@gmail.com>

* startup: add sum testcase

* mean, max, min, sum

* refine test mul

* refine test mul case

* refine div, mul, sub test case

* refine masked_fill test case

Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refine gather test

* add masked_fill backward test

* add mean module backward test

* rewrite module to test

* refien

* add layernorm backward test

* refine math_ops tests

Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>

* add experimental apis

* merge master fix conflict

* revert flow._oneflow_internal.dtype to flow.dtype

* refine

* fix test optimizer

* update module docs

* fix unit tests

* fix matmul module test

* fix adamw and rmsprop tests

* fix crossentropy loss grad

Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add logsoftmax module

* add sigmoid module

* add maskedfill module

* format

* add unsquuze module

* add eq module

* add arange module

* fix arange module

* add softmax module

* refine

* update logsoftmax module

* update eq module

* update eq module

* refine

* refine according to comments

* refine softmax test case

* fix unsqueeze module

* refine according to comments

* refine

* format

* format

Co-authored-by: Yinggang Wang <wyg19970408@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>