* cmake dont panic when build cuda

* naive changes

* fix cudaMemcpyKind

* fix acc actor

* fix actor

* fix gdb

* fix vm

* fix work type

* fix cuda type

* fix cuda type

* fix collective backend

* fix global scope

* amp

* rm PackKernelUtil gpu

* fix log

* fix rand

* fix sync size

* fix allocator

* fix vm

* fix kernel

* fix kernel

* fix kernels

* fix kernel

* fix softmax

* fix kernels

* fix reshape kernels

* add workaround

* try fix symbol not found

* fix vm

* fix vm

* fix jpeg

* fix broadcast gpu

* fix broadcast like

* fix transpose

* fix matmul

* fix CopyElemOnGpu

* fix sigmoid

* fix sigmoid and softmax

* fix relu

* fix sparse cross entropy

* fix kernels

* fix tanh

* fix same padding

* fix softmax

* fix undefined symbol: gzgets

* fix CopyField

* fix scalar add

* fix CopyNDGpuImpl

* copier

* fix slice boxing

* fix mem copier

* fix zero like

* fix acc actor

* fix dev pure cpu (#3410)

* add pure cpu message

* add default for src dir in ci

* add cpu workflow

* fix extra_oneflow_cmake_args

* fix link problem add update readme

* fix _GetDefaultConfigProto

* use gpu

* rm default value for gpu dev num

* rm cpu ci

* check in skip code

* refine ci and add back

* add arg for appendix

* fix env arg

* fix env arg

* rm make nccl

* add back to pass gpu ci

* get with cuda in py

* fix fmt

* fix test kernels

* fix activation

* add skips

* fmt

* skip all reduce

* fix assign

* fix bn

* fix bn

* rm tmp_wheel

* rm tmp_wheel

* move clean up

* for CPU-only OneFlow make gpu_device_num equivalent to cpu_device_num

* change warning to info

* only run 3 iters for cpu

* skip bert for cpu

* fix check

* add warning

* add cpu Integration test

* Dev pure cpu test cases (#3422)

* fix test cpu cases

* change os.getenv('ONEFLOW_TEST_CPU_ONLY') == 'True' to os.getenv('ONEFLOW_TEST_CPU_ONLY')

* print traceback for info and warning

* fix test cpu cases

* add more info on why skip check of resnet

* skip gan in cpu

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Co-authored-by: tsai <caishenghang@oneflow.org>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Co-authored-by: JackieWu <wkcn@live.cn>
Co-authored-by: OuYang Yu <xuanjiuye@gmail.com>

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

1. add link
2. add item in table of contents

Co-authored-by: Yao Chi <yaochi@oneflow.org>

* add conv1d conv3d

* add transpose in conv3d NDHWC

* fix

* fix

* NCHW->NCDHW

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* Add tensor_buffer_to_tensor and tensor_to_tensor_buffer

* const auto& => const auto

* move comp note up

* add sorry

* quick fix readme

* add readme

* CheckPoint.save in eager

* fix minor spell error

* add test

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* use tf protobuf headers

* add readme

* rm patch

* add inc file

* fix rare grpc build bug

* use different headers

* fix file path

* fix cublas conflict with tf

* use cublas dlib for xla

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* Update const std::string param type

* Fix lambda return type

Co-authored-by: tsai <caishenghang@oneflow.org>

This reverts commit e338a5f3.

* Final Cut (#3354)

* bump version

* rm pip install

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

* remove windows directory (#3358)

* fix building error and warning in gcc10

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Co-authored-by: OuYang Yu <xuanjiuye@gmail.com>
Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* fix benchmark links

* Bert -> BERT

Co-authored-by: ShawnXuan <xiexuanx2@gmail.com>

* CopyBodyFromNdarray

* modify call oneflow_api

* implement StaticTensorAutoMemCopyFrom in ofblob

* Final Cut (#3354)

* bump version

* rm pip install

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

* remove windows directory (#3358)

* install python pkgs from dev-requirements.txt in configure time, remove PY3 flag (#3351)

* install python pkgs from dev-requirements.txt in configure time

* remove PY3 cmake flag, add dev-requirements.txt to CMAKE_CONFIGURE_DEPENDS, remove unused cmake functions

* build nccl with -jN

* special tag for gpu (#3362)

Co-authored-by: tsai <caishenghang@oneflow.org>
Co-authored-by: daquexian <daquexian566@gmail.com>

* ci master (#3366)

Co-authored-by: ouyangyu <xuanjiuye@gmail.com>
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Co-authored-by: tsai <caishenghang@oneflow.org>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* fix test train warning

* rename trainable to func_config_type

* Final Cut (#3354)

* bump version

* rm pip install

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

* Add B21SubTskGphBuilder

* remove windows directory (#3358)

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Co-authored-by: OuYang Yu <xuanjiuye@gmail.com>

* add automerge.yml

* run bot on self-hosted runner and retry forever

* Update automerge.yml

* remove unlabled trigger, set timeout to 12h

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* Final Cut (#3354)

* bump version

* rm pip install

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

* remove windows directory (#3358)

* install python pkgs from dev-requirements.txt in configure time, remove PY3 flag (#3351)

* install python pkgs from dev-requirements.txt in configure time

* remove PY3 cmake flag, add dev-requirements.txt to CMAKE_CONFIGURE_DEPENDS, remove unused cmake functions

* build nccl with -jN

* special tag for gpu (#3362)

Co-authored-by: tsai <caishenghang@oneflow.org>
Co-authored-by: daquexian <daquexian566@gmail.com>

* ci master (#3366)

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Co-authored-by: OuYang Yu <xuanjiuye@gmail.com>
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: tsai <caishenghang@oneflow.org>

* Final Cut (#3354)

* bump version

* rm pip install

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

* remove windows directory (#3358)

* install python pkgs from dev-requirements.txt in configure time, remove PY3 flag (#3351)

* install python pkgs from dev-requirements.txt in configure time

* remove PY3 cmake flag, add dev-requirements.txt to CMAKE_CONFIGURE_DEPENDS, remove unused cmake functions

* build nccl with -jN

* special tag for gpu (#3362)

Co-authored-by: tsai <caishenghang@oneflow.org>
Co-authored-by: daquexian <daquexian566@gmail.com>

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Co-authored-by: OuYang Yu <xuanjiuye@gmail.com>
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: tsai <caishenghang@oneflow.org>

* bump version

* rm pip install

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

* support __version__

* add license

Co-authored-by: tsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>

* refine readme

* refine readme

* Update README.md

* refine readme

* refine readme

* Update README.md

* refine readme