* add nvidia version requirements

* add link

* fix case

* rm number

* Check global function signature

* oft_checker

* oneflow typing check for watch callback

* transform global function result by annotation

* change protobuf enum oneflow.dtype.* to class

* add static  members

* adjust signature

* Adjust dtype.py

* fix flow.dtypes

Co-authored-by: tsai <caishenghang@oneflow.org>

* cmake target to install dev requirements

* add dependency

Co-authored-by: tsai <caishenghang@oneflow.org>

* add license at root dir

* check in empty files

* rm space

* check in script

* update script

* fix bug

* add print

* fix

* add exit

* add to of_format

* add CI task

* fix license

* Revert "fix license"

This reverts commit 818b6d7691d3a8b4a25dd41a47ff2c5922b8ec57.

* only add once

* quick fix

* fix script

* dont fmt empty file

* fix

* quick fix

* fix py

* add license

* fix exit

* add license for hpp

* add license

* license new vm files

Co-authored-by: tsai <caishenghang@oneflow.org>

* vm::cuda_allocator interface

* Implement of CudaAllocator::Allocate

* Implement of CudaAllocator::Deallocate

* Add cuda allocator test scripts and fix bug of CudaAllocator::pieces_ and pass test

* remove part note

* fix CudaAllocator::total_memory_bytes_ strategy and Pass all test

* CudaAllocator Support dynamic growth and garbage collection

* add interface note

* refine total_memory_bytes when garbage collection

* fix bug of merge

* remove log and strong boundary test

* SingleThreadOnlyAllocator and ThreadSafeAllocator implement and test

* SingleThreadOnlyAllcoator for CudaStreamHanldeDeviceCtx

* ThreadOnlyAllcoator for CudaStreamHanldeDeviceCtx

* fix spell

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>
Co-authored-by: guo ran <360112263@qq.com>

* use cudnnDeriveBNTensorDescriptor

* CudnnTensorDescHelper

* fix bn min eps

Co-authored-by: guo ran <360112263@qq.com>

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

* refactor_placement

* delete useless code

* fix code style

* remove prior device placement call

* fix placement_util

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

* lazy adam model_diff mut_dptr->dptr

* of format

Co-authored-by: Juncheng <liujuncheng1022@gmail.com>

* add siganture to ops api

* Adjust function signature

* remove python api keras

* remove detection.py

* dynamic_concat

* check dynamic shape less than static shape

* grad and test

* update kernel match to hob

* combine dynamic concat to concat

* minor fix

* backward compatible

* minor fix

* modify by review

* refactor rand input code

* fix bug

* update test

* update test

* changes by suggestions

* check log

* refactor if

* rename

* add import as

Co-authored-by: tsai <caishenghang@oneflow.org>

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

* save naive draft

* works but unittest not found

* update api gen

* not working

* push to compare

* restore file

* revert changes

* add rm

* dont' clean

* smarter cleanup

Co-authored-by: tsai <caishenghang@oneflow.org>

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

* #3196 refactor user op c++ register draft

* #3196 refactor op register c++ api part2

* #3196 refine interface

* #3196 user new get

* #3196 rename

* #3196 finish Op reg

* #3196 finish Op grad reg

* #3196 refine

* #3196 op kernel reg part 1

* #3196 op kernel reg part 2

* #3196 op kernel reg part 3

* #3196 op kernel reg part 4

* #3196 op kernel reg part 5 fix

* #3196 compile & test pass

* #3196 merge branch develop

* #3196 rm useless code

* add load_mnist.py for document demo

* remove chinese character

* del test code

* del useless code

* del useless code

* modify load_mnist, add tqdm to setup.py

* add tqdm to dev-requirements.txt

* refine load_mnist.py

* add code api doc

* refine docstring

* undo changes of api docs

* add required library 'requests' to setup.py

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* fix and test

* fix

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

* rm support for legacy code

* rm user op in task name and script name

Co-authored-by: tsai <caishenghang@oneflow.org>

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* add upsample op

* rename

* use NdIndexOffsetHelper

* add test case

* refine

* fix

* refine

* fix

* ndarray()->numpy()

* format

* fix

* refine

* use flow.scope.placement

Co-authored-by: Juncheng <liujuncheng1022@gmail.com>

* optimize L1L2RegularizeGradientKernel

* use thread pool

* Remove reduce/broadcast system op

* Remove add system op

* fix

* fix op type name

* Remove constant system op

* fix

* fix

* AutoTrainStep use assign user op


boxing util use assign


assign to system.assign


revert

* flow.assign use user op

Co-authored-by: guo ran <360112263@qq.com>

* replace FixedTensorDef with Numpy.Def

* oneflow.Numpy.Def demo

* support eager global_function input signature

* replace FixedTensorDef with Numpy.Def

* oneflow.Numpy.Def demo

* remove code in Attr relevant to 'attr_type_name'

* refine Attr call of array_ops.py

* refine Attr call of categorical_ordinal_encode_op.py constant_op.py data_ops.py

* refine Attr call of layers.py loss_ops.py

* refine Attr call in eager_nccl_ops.py  layers.py linalg.py math_ops.py

* refine Attr call in math_ops.py

* refactor Attr call in nn_ops.py

* refactor Attr call in 6 files

one_hot.py
pad.py
random_ops.py
reduce_ops.py
sort_ops.py
two_stage_reduce.py

* refactor Attr call in user_data_ops.py

* refactor Attr call in 9 files

user_op_builder.py
test_reshape.py
test_TestDataTypeAttr.py
test_TestListDataTypeAndListShapeAndListStringAttr.py
test_TestRandomSource.py
test_TestReshape.py
test_TestReshape4KeepHeaderOnly.py
test_TestSourceMultiGpuFixedOutNum.py
test_user_op_attr_auto_type.py

* remove 3rd argument of Attr method

* reformat

* refactor Attr call in nn_ops.py line 710

* add 'attr_type_name=None' for downward compatibility

* add warning message for deprecated Attr call

Co-authored-by: Yao Chi <yaochi@oneflow.org>
Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>