Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

Co-authored-by: roger <roger@rogers-MacBook-Pro.local>

* refactor OpGraphPass to JobPass

* refactor methods of JobPassCtx

* make float/double as aliases of float32/float64

* make assert in generate_oneflow_api.py clearer

Co-authored-by: OuYang Yu <xuanjiuye@gmail.com>

* Add Repeat/Acc user op

* ssp_variable_proxy op/kernel/task_node

* SspVariableProxyActor

* bind inplace relation between var and ref

* fix ssp_variable_proxy bugs

* address comments

* Update test_ssp_variable_proxy.py

Co-authored-by: liujuncheng <liujuncheng1022@gmail.com>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* RtRegst/Regst access blob by ordinal

* refine

* fix doc

* fix

* refine doc of placement

Co-authored-by: guoran <guoran@oneflow.org>
Co-authored-by: binbinHan <han_binbin@163.com>

* fix cfg sub proto pb2 module process bug

* Decoupling oneflow and cfg

* using proxy input blob_object for cross machine op

* fix typo

* fix a bug in Build121To

* Add InterNodeOneToMany boxing, make some boxing inter-node

* rename MasterMachineOnly -> SingleMachine

* extract long expression as variable

Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* add onerec

* add verify for each example

* parser not use multithread

* fix read dataset

* fix gitmodules

* fix hob warning

* add instream check

* merge develop

* update submodule

* use swap

* update flatbuffers.cmake lz4.cmake

* format

* fix

* fix

* fix

* fix

* state and batch

* batch shuffle, verify_example

* merge master

* add batch_random_shuffle_dataset

* refine

* fix

Co-authored-by: guoran <guoran@oneflow.org>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* build_img

* fix use_tuna_yum

* disable nvidia-ml

* cmake working

* fix docker ignore

* third party working

* add

* create tmp bash file

* fun create_tmp_bash_and_run

* add

* check in files

* fix currenrt dir

* fmt

* add

* fix ld

* fix cmd

* add DWITH_XLA

* rm bd 3d party

* add default_wheel_house_dir

* fix name

* add rm -rf build

* add

* rm -it

* add retry

* add retry

* fix .returncode

* rm log

* add retry

* use_aliyun_mirror

* update workflow

* fix yml fmt

* fix ${tmp_dir}

* spawn new bash for xla

* add assert

* fix  == 1

* fix actions/whl

* fix indentation

* fix bug

* fix CalledProcessError

* fix python_version

* add set -x

* rm "

* ci fix log dir

* reorganized arg

* rm upload

* refactor

* fix eval

* use env.HOME

* fix context

* use ~

* absolute path

* specify src dir

* reorganize arg

* fix ${src_dir}

* fix exe path

* fix path

* mv set python bin path into generated bash

* add ci_tmp_working_dir

* rm gcc7 enable in dockerfile

* bash_args

* arg for custom img

* refactor args.skip_third_party

* add debug line

* fix house_dir_arg

* refactor dir args

* fix docker None:None

* fix make -j in grpc and openssl

* safer log dir path

* larger tol for test_unsorted_segment_sum.py

* rm commented line

* refactor auto upload

* fix indentation

* add --recursive for upload

* fix secrets

* rm ALL_PROXY as docker build arg

* larger tol for test_nn_conv2d_padding_dynamic

Co-authored-by: tsai <caishenghang@oneflow.org>
Co-authored-by: tsai <caishenghang@gmail.com>

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* fix cfg build bug

* add comment in template.cfg.cpp

* move logic of copy pb2.py to cfg

* update generated cfg file when cfg tool updates

* delete useless line in cfg.cmake

* optimize cfg

* optimize cfg

* optimize cfg.cmake

* fix a small bug

* optimize cfg tool

* optimize cfg tool

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* refactor user_op_registry Attr

* Replace the User Op Registry Attr with a new interface (#3714)

* replace user op attr

Co-authored-by: lixinqi <lixinqi0703106@163.com>

* detect_cxx11_abi_availibility

* crash on compiling error

* fix unpacked mirrored blob object shape

* add missing import

* add missing import

* address comments

Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>

* fix cfg bug when the package of .proto is none

* remove *cfg.cpp generator

* fix python code format

* Move body of cfg-constructor from proto obj to InitFromProto() primary

* move InitFromProto() & ToProto() to message.h

* add a comment line & remove template.cfg.cpp

* delete a useless word in comment line

* finetune cfg

* fix complier bug at only_cpu mode

* remove useless line

* remove useless line

* remove useless line

* add Instruction.proto to cfg.cmake

* adjust cfg struct

* fintune cfg struct

* fix oneflow.cmake

* fix oneflow.cmake bug

* delete useless line in oneflow.cmake

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>

* slice_assign implementation

* new slice op

* check step > 0, add more tests, refine the code

* revert the initializer changes

* remove print

* set y to 0 for partialsum

* check sbp, fix incorrect attr check

* add more tests

* rename slice2->logical_slice

* update tests

* extract common python code into a function

* get_size_in_slice -> GetSizeInSlice, rm unused test file

* minor update about step > 0

* minor update on tests

* add WITH_CUDA guard

* address comments

* split ConstructSliceParams into two functions

* add comments for SliceContext

* remove duplicated registeration

* add TODO comment

* rename slice_assign -> logical_slice_assign, move logical_slice(_assign) to experimental namespace

* logical_slice AlwaysComputeWhenAllOutputsEmpty true -> false

* address comments

* fix tests in eager mode

* BROADCAST -> SPLIT_AXIS_FOR_BROADCAST

* move SPLIT_AXIS_FOR_BROADCAST into anonymous namespace

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* universal start global device for one machine

* update machine_id() and device_id()

Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* Remove CheckNoCycle in chain graph

* remove hack code in oneflow.where op test

* new rule for order in graph

* remove ordered_chain_nodes_ in chain graph

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* add ops needed by clip gradient

* pass compiling

* add xla tests

* transform square_sum into user op

* add square_Sum kernel

* fix square sum kernel bug

* mv square sum op into user op and pass test

* fix shape bug

* update test scripts

* modify as reviewed

* fixparallel_conf

* run ci/check/run_license_format.py, run_clang_format.py, run_py_format.py

* format code

* fix ScopeSymbolId

* rm SquareSum op_conf

* format code

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* add eager

* conv's filter_diff is never dynamic

* fix test_coco_reader bug at eager mode

* add blank line at the end of file

* skip model_io & interface_op_read_and_write test case under eager mode

* sikp ops/test_sparse_softmax_cross_entropy_ms under eager mode

* skip test_softmax case under eager mode

* fix test_TestMultiOutputOrder bug

* fix test_pool bug under eager mode

* fix VirtualCloseJob() bug

* fix bug test_pool_pad

* Fix eager mode bug (#3681)

* fix(eager): close eager job but not release Glabol<JobDesc>

* refactor(job): refactor job_build_mgr when closing

* style(*): use clang format

* chore(gdb): remove all gdb function

remove gdb.h(cpp) and calling in kernel.cpp

https://github.com/Oneflow-Inc/oneflow/pull/3681#discussion_r505137787



* fix test_sparse_cross_entropy_ms bug

* fix code style

* add TODO in test_pool & test_pool_pad

* fix test_image_resize bug

* remove magic num

* fix code format

Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: wyg1997 <wyg19970408@gmail.com>

Co-authored-by: guo <guo@example.com>
Co-authored-by: guoran <guoran@oneflow.org>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* add api docs

* fix docs

* add api doc in math_ops

* Change the theme to read_the_docs

* add equation docs in math_add

* add equation docs in sub, mul, addn

* add mod div tanh docs

* add gelu, relu docs

* add sigmoid unsorted_segment_sum api docs

* add unsorted_segment example docs

* add equal to greate_equal example docs

* add logical and example docs

* add other example docs, include squared difference

* add requirements of sphinx_rtd_theme

* delete the requirement of sphinx-material

* use make of format

* add optimizer docs

* add scheduler docs

* fix multiplier docs in warmup

* add api docs for math binary elementwise ops

* add math unary api docs

* fix docs about round

* add api docs for reduce mean

* add api docs for reduce ops

* fix code block for reduce ops

* fix math equation

* fix math equation erf

* add code example for layers

* fix docs in layers

* fix of format

* add warmup module in rst

* fix focs for sbp author:yaochi

* fix details in api docs

* add nn api docs and add optimizer_grad_clip module in rst

* fix details in api docs

* fix details in nn

* add prelu api docs

* add smooth l1 loss api docs

* add api docs for matmul

* add api docs for constant op

* fix docs format in RMSProp

* add api docs for array ops

* add docs for random ops

* add api docs for tensor buffer ops

* fix an error in instance_dims doc

* add api docs for tensor_list_ops

* fix annotation in image_decode

* fix of_format

* fix docs for gather_nd

* fix docs

* fix error in constant op

* fix conflict and little error

* fix index to indices

* fix error and add link

* fix broadcast like example and update flow.scope.placement docs

Co-authored-by: doombeaker <later@usopp.net>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* Try to Delete the check of Batch Axis

* log about op

* fix of_format

* add a attribute for transpose op

* fix format and delete some test code

* fix bug

* add test case and annotation

* add todo

* update index.rst

* add api docs of flow.typing

* rm placement.rst

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* fix fuse_scalar_mul_by_tensor sbp

* refine

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* fix read_images_by_cv

* "L" can't convert to "BGR" directly

Co-authored-by: oneflow-bot <69100618+oneflow-bot@users.noreply.github.com>

* fix readme

* Update README.md

* test use uuid log dir

* mv random to paralell run

* better docker ignore

* add readme

* add

* conver type uuid