- Jun 04, 2021
-
-
liufengwei0103 authored* add interface InferContext::InputShape * delete repeated interface calling in dropout_op.cpp * refactor_infer_ctx_output_shape * auto format by CI Co-authored-by:
lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Luyang authored
* refine gather test * add masked_fill backward test * add mean module backward test * rewrite module to test * refien * add layernorm backward test * refine math_ops tests * add 4dim test Co-authored-by:
Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Yurui Li authored
* refactor tensor.detach * add test case * share tensor storage * remove reference * add comment * remove unnecessary code * format * seperate Just * format Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Xiaoyu Zhang authored
Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Shenghang Tsai authored
Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Li Xinqi authored
* add interface InferContext::InputShape * delete repeated interface calling in dropout_op.cpp * auto format by CI Co-authored-by:
liufengwei <2472937968@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Xiaoyu Zhang authored
* add argmax test * add cast module backward * rewrite module to backward * rewrite mul module backward * rewrite ones_like module * refine ones_like module * refine reciprocal module * rewrite sub and mul module * fix conflict * add sub module backward * refine sub module test * refine unittest * refine tensor to module * refine nn.Embedding * refine * fix comment Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Luyang authored
* refine gather test * add masked_fill backward test * add mean module backward test * rewrite module to test * refien * add layernorm backward test * refine math_ops tests Co-authored-by:Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com> -
Xiaoyu Zhang authored
* add argmax test * delete useless license * rewrite equal module unit_test * delete useless code * add div module backward test, report bug * auto format by CI Co-authored-by:
oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
-
- Jun 03, 2021
-
-
Xiaoyu Zhang authored
* add round module * auto format by CI Co-authored-by:
oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org> -
Juncheng authored
Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Shenghang Tsai authored
* Remove redundant copyright header * ci check if license duplicated * refine * refine * refine * address review Co-authored-by:
liujuncheng <liujuncheng1022@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
YongtaoShi authored
* add maxpool2d backward module * fix maxpool2d numpy backward * fix maxpool backward description * add avgpool backward description * add maxpool testcase * add MaxPool2d doctest * add MaxPool1d module * add MaxPool3d module * add MaxPool3d testcase * update docstring * delete cuda device * delete maxpool1d module and test case Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
yayeoCddy authored
* add flow.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.sin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * update test_asin.py including forward and backward * Update test_math_ops.py remove asin testcase * update testcase including forward and backward * add torch.asinh and torch.Tensor.asinh * update testcase of asin and asinh * update testcase of asin and asinh * update testcase of asin and asinh * update testcase * update testcase * make format * update license * update testcase * check in * qq mail * wrong fmt * auto format by CI * use youarefly@qq.com * wrong fmt * auto format by CI * use ci-bot@oneflow.org * wrong fmt * auto format by CI * mv op testcase to test_tensor.py * auto format by CI * update docstring * update docstring * update doctest * update doctest * auto format by CI * update arcsinh * fix warnning in np.arcsin * bug * fix test_asin.py warning by limitting input in [-1,1] * mv test_*.py to test_math_ops.py and fix bugs * ~ * auto format by CI Co-authored-by:
陈岱渊 <chendy@zhejianglab.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: jackalcooper <jackalcooper@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <373331853@qq.com>
Co-authored-by: oneflow-ci-bot <youarefly@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org> -
zev123456 authored
* add atan2 sinh and softplus module * add module testcase * add docs * auto format by CI * delete commented code * check import * check import * auto format by CI * check import Co-authored-by:
oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Zhenhua authored
* Add log1p module * Add grad test * Resolve conflicts * Add doctest * Fix test case * Code format Co-authored-by:
Luyang <flowingsun007@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
zjlablichenyang authored
* [New] test_acosh * [Add] acosh test * [Modify] acosh.py and test_acosh.py * [Modify]Blank line * [Update] add doctest * refine doctest of acosh * [Add] Docstring * [Add] acosh, sin and sign * Fix bug * auto format by CI Co-authored-by:
YaoChi <later@usopp.net>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Luyang authored
* refine add module backward test * refine batchnorm backward test * refine broadcast_like test * add cast backward test * refine constant test * refine flatten test * refine * refine
-
Hongsheng Wang authored
* Add scalar support of greater less module (#4841) * add scalar input support * format Co-authored-by:
oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9b11938c
* Refine optimizer (#4840)
* refactor(Optim): refine optimizer codes
* docs(SGD): add document for SGD
* docs(SGD): fix code
* test(Adam): fix test_optim_adam bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: cd6ffac6
* add docstring (#4846)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: da82bb8c
* fix eager with unknow symbol id (#4752)
* fix eager with unknow symbol id
* minor fix
* fix conflict
* remove unnnecessary function
* remove unnecessary header
* remove unnecessary methods
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: aa9f6f76
* Dev fix linear module (#4836)
* add broadcast matmul support
* refine
* add batch matmul support
* remove redundant test case
* linear module support high dimension input
* format
* fix linear
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: f1ccf2a3
* Add rmsprop optimizer (#4834)
* add rmsprop optimizer
* fix rmsprop optimizer bug
* fix rmsprop optimizer bug
* add rmsprop optimizer docs
* add rmsprop docs
* fix comment
* fix comment
* fix comment
* fix comment
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: f476d48d
* add adamw optimizer (#4824)
* init adamw optimizer
* fix adamw optimizer bug
* fix comment
* fix comment
* code format
* fix comment
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: f15a8aea
* add experimental apis (#4817)
* add experimental apis
* merge master fix conflict
* revert flow._oneflow_internal.dtype to flow.dtype
* refine
* fix test optimizer
* update module docs
* fix unit tests
* fix matmul module test
* fix adamw and rmsprop tests
* fix crossentropy loss grad
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c50ff3cc
* remove MakeParallelDescByDevice, fix the missing setting of parallel_desc in InstructionMsg copy constructor (#4850)
Signed-off-by: daquexian <daquexian566@gmail.com>
Former-commit-id: d5d7ef56
* add experimental (#4856)
Former-commit-id: 505d4865
* A more efficient implementation of NLL Loss (#4854)
* A more efficient implementation of NLL Loss
* A more efficient implementation of NLL Loss
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: ad5b0129
* Add where module (#4845)
* add broadcast_like module
* add where module, still has bug
* fix where module bug
* fix where module bug
* fix bug and add where module
* fix where module commnet
* code format
* fix where module
* code format
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: edf9a190
* dev_compare_cfg_file (#4860)
* dev_compare_cfg_file
* add def of org_content
* minor fix
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 5e399d38
* stateful local opkernel: return a temp parallel ctx (#4857)
* add temp parallel ctx for single card
Signed-off-by: daquexian <daquexian566@gmail.com>
* add TODO comment
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: f450ff89
* Optimize memory occupancy for interface 1.0 (#4844)
* Do not save inputs in function nodes even if requires_grad is true.
* Allocate raw memory with actual size.
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: e5dadaf5
* use less event records (#4861)
* use less event records
* more comments
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 218f61e3
* Refine cast grad func. (#4853)
Former-commit-id: dfe7759e
* copy eager blob object to/from numpy in c++, use busy loop to wait (#4839)
* numpy: create np arr in python and copy in c++, use busy loop to wait
Signed-off-by: daquexian <daquexian566@gmail.com>
* reformat
Signed-off-by: daquexian <daquexian566@gmail.com>
* add CopyBetweenMirroredTensorAndNumpy
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 87c0c3d8
* align squeeze module with torch (#4855)
* align squeeze module with torch
* fix comment
* fix argmax bug
* fix bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: a57b7649
* Fix adam weight decay param (#4835)
* fix adam weight decay
* fix adam weight decay
* fix comment
* fix comment
* fix commnet
* fix commnet
* fix commnet
* fix bug
* fix(Adam): fix Adam test bug
* revert adam test threshold to 1e-3
* fix(Adam): fix adam test bug and adjust param to increase error
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: wyg1997 <wyg19970408@gmail.com>
Former-commit-id: 1d5f743d
* Fix groupnorm (#4848)
* fix GroupNorm and modify test case
* add grad op for reshape_like op
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9bf14b8b
* use composed attr map in contexts (#4838)
* use composed attr map
Signed-off-by: daquexian <daquexian566@gmail.com>
* move implementation to .cpp
Signed-off-by: daquexian <daquexian566@gmail.com>
* OpExpr::New returns Maybe
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9d78fdba
* flow.Size support negative index and add test (#4870)
* feat(PySize): support negative index and add test
* style(*): refine code
* format code
Former-commit-id: 3519d2e7
* fix export experimental docs bug (#4867)
* fix export experimental docs bug
* fix export experimental docs bug
* fix export experimental docs bug
Co-authored-by: Yao Chi <later@usopp.net>
Former-commit-id: d78c2bc6
* reorder VirtualMachine fields (#4873)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 1ce9f262
* Align module params with torch (#4865)
* align mean module
* allow negative dim param
* support tuple of negative dim param
* refine
* format
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 373cefce
* Generate cfg header and source files in parallel and prevent rebuild from scratch when Python version changes (#4876)
* refine
* Update cfg.cmake
* Update cfg.cmake
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 72204213
* fix interpreter determin output leaf and grad (#4872)
* fix interpreter determin output leaf and grad
* fix GradMode get
* simplify
* add test for no_grad
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: de05e7a5
* support crossentropy loss 3dim (#4875)
* support crossentropy loss 3dim
* merge conflict
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 4e689d25
* supoort nllloss 3dim (#4874)
* supoort nllloss 3dim
* supoort nllloss 3dim
* merge conflict
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 30a75cee
* Device compute dep object (#4862)
* Device::compute_dep_object_
* sequantialize instructions in the same stream.
* adjust atexit sort
Co-authored-by: Houjiang Chen <chenhoujiangcug@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: clackhan <han_binbin@163.com>
Former-commit-id: 55a223cf
* remove cambricon quantization test (#4879)
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9cddc629
* Use dlopen to call ibverbs APIs (#4852)
* check in naive struct
* refine
* refine
* refine
* refine
* add functions
* refine
* refine
* refine
* fmt
* refine
* refine
* refine
* refine
* refine
* refine
* add note
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* rm include
* revert cmakelist changes
* refine
* address review
* rename
* address review
* address review
* remove glog dependency
* fix
* refine
* refine
* print lib path in stdout
* address review
* address review
* fix
* support ONEFLOW_LIBIBVERBS_PATH
* add case
* update init_cluster_env.py for ONEFLOW_LIBIBVERBS_PATH
* fix comment
* address review
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 75f11b82
* Add copy user op (#4842)
* copy user op
* add to module and tensor.to interface
* remove unnecessary code
* backward for tensor.to
* remove capture of input
* support cpu only tensor
* module to (#4858)
* remove backward kernel and op
* friendly deal with when tensor.grad is None
* minor fix
* minor fix
* revert
* suport 1m1d only
* skip test normalization
* skip test normalization
* skip conv
* support construct device using string
* minor fix
* minor fix
* use maybe
* fix device id type for device infer ctx
* skip batchnorm
* skip some tensor test case
Co-authored-by: Xiaoyu Xu <xiaoyulink@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 2d5fae50
* Fix reduce sum grad func. (#4882)
* Fix reduce sum grad func.
* Fix zeros op
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: a4022285
* align dim size funtion (#4880)
* align dim size funtion
* fix dim usage
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 4592d467
* support expand and repeat op int datatype (#4883)
* support expand and repeat op int datatype
* code format
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 2939e8cb
* return LocalTensor (TensorTuple) directly from op expr __call__ (#4864)
* expose local tensor
Signed-off-by: daquexian <daquexian566@gmail.com>
* mt19937 -> minstd_rand
Signed-off-by: daquexian <daquexian566@gmail.com>
* revert unnecessary diff
Signed-off-by: daquexian <daquexian566@gmail.com>
* fix comments
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 72b76a29
* Support custom parameters for optimizer (#4881)
* feat(Optim): support custom parameters for optimizer
* feat(Adam): adam support custom parameters
* feat(Adamw): adamw support custom parameters
* feat(RMSprop): rmsprop support custom parameters
* style(Optim): refine adam and adamw
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Former-commit-id: a26f7080
* align transpose module with pytorch (#4877)
* align transpose module with pytorch
* fix comment
* align tranpose module
* support expand and repeat op int datatype
* fix bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 2a5bc359
* Add ones like op (#4889)
* Add ones like op.
Conflicts:
oneflow/api/foreign_lock_helper.h
oneflow/api/python/autograd/autograd.cpp
oneflow/api/python/framework/tensor.cpp
oneflow/core/framework/op_interpreter/op_interpreter.cpp
oneflow/core/framework/op_interpreter/op_interpreter_util.cpp
oneflow/core/framework/tensor.cpp
oneflow/core/framework/tensor_impl.cpp
oneflow/core/framework/tensor_impl.h
* Add ones_like unittest.
* Use SwithCase
* Fix typo
* undef
* Bugfix
* Fix merge conflicits
Co-authored-by: hjchen2 <hjchen2>
Co-authored-by: Yinggang Wang <wyg19970408@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 7b4c8c50
* Cpu support conv module (#4894)
* support expand and repeat op int datatype
* support conv cpu module
* support conv cpu module
* support conv cpu module
* support conv cpu module
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 59fcd027
* Async cuda stream type (#4895)
* add class AsyncCudaStreamType
* fix bug
* remove useless headfile
Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 8784b21d
* skip infer instr when physical operand != nullptr, remove unused code (#4868)
* Disable infer instruction if instruction type has physical operand
Signed-off-by: daquexian <daquexian566@gmail.com>
* remove more infer instructions
Signed-off-by: daquexian <daquexian566@gmail.com>
* raise UNIMPLEMENTED() in infer
Signed-off-by: daquexian <daquexian566@gmail.com>
* fix hanging on exit
Signed-off-by: daquexian <daquexian566@gmail.com>
* reformat
Signed-off-by: daquexian <daquexian566@gmail.com>
* fix typo
Signed-off-by: daquexian <daquexian566@gmail.com>
* wrap results by Tensor() in .to()
Signed-off-by: daquexian <daquexian566@gmail.com>
* set need_check_mem_case to false for copy op
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 3137f51c
* fix and check to with module on forwad and backward (#4897)
* fix and check to on forwad and backward
* add todo
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 585afc09
* add JUST (#4891)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 98b88e20
* Fix docs bug (#4892)
* support expand and repeat op int datatype
* fix modules docs bug
* fix docs bug
* fix docstring bug
* fix docs bug
* fix docs bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: fb164b58
* Add warning when no param update (#4896)
* style(Optim): add warning when no param update
* style(Optim): add TODO
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 7e9902aa
* Add gather embedding module (#4826)
* add gather module
* add gather module
* add test case
* add embedding module
* fix comments
* update embedding module and test case
* refine
* fix comment
* fix comment
* fix comment
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 986becca
* Support create cpu only tensor (#4863)
* support create cpu tensor
* add empty op
* remove skip tensor test case:
* remove skip tensor test case
* remove TODO
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: dab6ba23
* Add permute module (#4901)
* support expand and repeat op int datatype
* fix modules docs bug
* fix docs bug
* fix docstring bug
* fix docs bug
* fix docs bug
* add permute module
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 698e8cd5
* remove useless code in expand module test (#4903)
Former-commit-id: ac06d3c8
* Add conv docs (#4904)
* remove useless code in expand module test
* add conv2d docs
Former-commit-id: 422ced27
* Fix eager test bug (#4678)
* skip test_gpt_data_loader in eager mode
* 1_node_fix_egaer_test_bug
* remove useless head file
* skip tensor and module
* skip 2-D sbp in eager mode
* fix error
* fix bug and remove some skip under eager
* fix error
* del oneflow_api
* rm test_tensor.py
* skip test_summary in eager mode
* skip test_stateful_local_kernel under cpu only mode
* add class AsyncCudaStreamType
* fix bug
* import os
* remove BlobObject::is_python_shutting_down_
* fix error
* sikp 2d sbp
* minor fix
* refine comment
* make of_format
Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 425bd439
* cache cudnn handle in bn infer (#4906)
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 516b3e5e
* Fix ones zeros like (#4907)
* feat(xxxLikeOp): ones_like and zeros_like use user op
* fix(Optim): fix learning rate device error bug
* style(*): format codes
* style(*): use int instead of np.int
* test(Optim): add optimizer gpu test (#4908)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 6d7c6d8b
* Bump nccl from 2.8.3 to v2.9.8 (#4899)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 3294cf2a
* Add prelu module (#4902)
* support expand and repeat op int datatype
* add prelu module
* add prelu module
* add prelu module
* fix comments
* fix comment
* fix comment
* add backward test
* fix comment
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 138af616
* add InitEagerSession for eager mode (#4589)
* try to merge eager ofrecord to master branch
* refine
* temp fix
* try to add seed but fails
* try to add seed but failsclear
* use global function to init mirror/conssitent flag
* fix test
* add modules
* fix record modules
* fix destruction order
* fix mirror gen seed
* skip record unit test
* remove TODO
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: mosout <mosout@qq.com>
Co-authored-by: Ldpe2G <liangdepeng@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: a139f49e
* add hardtanh module (#4914)
Former-commit-id: d3c91a97
* fix_matmul_module_test_ci_bug (#4905)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 5c4a0d74
* Cpu support of batchnorm layernorm module (#4890)
* add rsqrt moduel
* add batchnorm module cpu support
* refine
* update
* fix param ini
* add reduce series modules
* add batchnorm,layernorm modules and test cases
* refine
* update .rst
* refine according to comments
* refine
* update
* fix layernorm bug
* refine
* remove additional license
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9262e1ae
* Add flow.tensor (#4829)
* add flow.tensor
* small fix
* fix dtype
* Update oneflow/python/framework/tensor.py
Co-authored-by: daquexian <daquexian566@gmail.com>
* deal with multi-dimension list or tuple
* remove list
* Update oneflow/python/framework/tensor.py
Co-authored-by: daquexian <daquexian566@gmail.com>
* add unit test case
* format
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c43caa88
* Feat lr scheduler (#4921)
* feat(LrScheduler): add ConsineScheduler
* feat(LrScheduler): update cosine_scheduler and add test
* feat(LrScheduler): refine codes
* style(*): format codes
* docs(LrScheduler): add document
* docs(LrScheduler): refine documents
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: f7881ce7
* Fix CommNetIf::RegisterMemory/UnRegisterMemory lock scope (#4918)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 1a7c26b1
* add leakyrelu module (#4912)
* add leakyrelu module
* code format
* update docs
* update docs
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 2b74432f
* Support cast in tensor.to (#4917)
* support cast in to
* refactor to interface
* refine doc
* refine doc
* refine kwargs
* add test case support tensor
* minor fix and test case
* format
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9fac6f36
* add hard swish module (#4915)
* add hard swish module
* fix bug
* fix bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 98f937f1
* Replace oneflow_worker with worker agent (#4900)
* naive impl
* refine
* refine
* add log
* refine
* refine
* refine
* refine
* add todo
* refine
* refine
* sync dynamic libs
* refine
* fix docker cmd
* fix rank
* refine
* refine
* add callbacks simple rpc
* refine
* refine
* fix
* refine
* refine
* refine
* fix conn
* support tradional mode
* refine
* refine
* refine
* rm
* refine
* refine
* refine
* refine todo
* refine
* refine
* rm unused
* rm todo
* revert
* refine
* add log
* refine
* refine
* fix order
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* rm
* rename
* add comment
* refine
* rm
* refine
* refine
* refine
* refine
* add todo
* add info
* refine
* refine
* refine
* add back some legacy code
* refine
* refine
* refine
* refine
* refine
* rm oneflow_worker exe
* rm log
* fix bug
* support --cmd
* add check
* refine
* fix
* fmt
Former-commit-id: 37c63928
* add hardsigmoid module (#4919)
* add hardsigmoid module
* refine docs
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 937ccaf3
* Refactor tensor (#4916)
* refactor Tensor
* Export ConsistentTensor::is_cuda
* minor fix
* minor fix
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 087c9753
* add relu6 module (#4925)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c013fac1
* add cuda test for add method(module) (#4888)
* copy user op
* add to module and tensor.to interface
* remove unnecessary code
* backward for tensor.to
* remove capture of input
* support cpu only tensor
* module to (#4858)
* remove backward kernel and op
* friendly deal with when tensor.grad is None
* minor fix
* minor fix
* revert
* suport 1m1d only
* skip test normalization
* skip test normalization
* skip conv
* support construct device using string
* minor fix
* minor fix
* use maybe
* fix device id type for device infer ctx
* skip batchnorm
* skip some tensor test case
* startup of add backward
* startup of add gpu test
* refine
* add cuda test for Linear module
* refine after sum fixed
* gpu backward
* gpu backward crashed
* retain grad
* refine according to comments of WangYinggang
* refine: construct specified device tensor
* refine testcase
* refine: specifiy device when construct in test case
* refien testcase for linear
* refine
* refien to_device
* refine import statement
* refine import path
* remove useless _to_device fun
Co-authored-by: poohRui <yuruil@qq.com>
Co-authored-by: Yurui Li <32978179+poohRui@users.noreply.github.com>
Co-authored-by: Xiaoyu Xu <xiaoyulink@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 2e268dfc
* add upsample module (#4923)
* add upsample module
* add upsample2d unittest
* add upsample2d unittest
* add docs
* add UpsamplingNearest2d and UpsamplingBilinear2d module
* code format and add docs
* add more unit_test
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 8125b43f
* add elu module (#4924)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 4dfc375a
* improve ofrecord unit test (#4920)
* improve ofrecord unit test
* remove no_grad
* fix codes according to review
* fix format
Former-commit-id: 984b1f08
* align inplace param (#4933)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 8b0bdcdc
* refactor SGDUpdate and MomentumUpdate UserOp (#4930)
* refactor(ModelUpdate): SGDUpdate and MomentumUpdate use optional input
for learning rate
* fix(*): fix bugs
* style(*): refine code
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 49d53fec
* Dev support tensor slice (#4898)
* add scalar input support
* format
* update tensor slice function
* add slice slice_update module
* add slice funtion in tensor
* refine
* fix tensor slice
* fix bug
* add tenser slice test case
* add logical_slice_assign module
* fix LogicalSliceAssign kernel to support eager local
Signed-off-by: daquexian <daquexian566@gmail.com>
* fix tests
Signed-off-by: daquexian <daquexian566@gmail.com>
* update export strategy
* refine
* fix docs
* add more test case
* fix comments
* refine according to comments
* add TODO item
* format
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 4c958482
* add tensor.zeros_() and SoftSyncStream instr (#4927)
* add tensor.zeros_() and soft sync stream instr
Signed-off-by: daquexian <daquexian566@gmail.com>
* separate cpu and gpu version of SoftSyncStream
* Remove SyncAutoMemset
* fix compile error
Signed-off-by: daquexian <daquexian566@gmail.com>
* fix wrong parallel_desc()
Signed-off-by: daquexian <daquexian566@gmail.com>
* remove unused code
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 0e7f1c6a
* Only upload log if distributed test fails (#4934)
* only upload log if distributed test fails
* refine
* refine
* reduce timeout
* refine
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 08d62afa
* Add logsigmoid softplus module (#4929)
* add logsigmodi and softplus module
* code format
* fix docs
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 0a636c6f
* Add module backward test (#4926)
* add scalar input support
* format
* update tensor slice function
* add slice slice_update module
* add slice funtion in tensor
* refine
* fix tensor slice
* fix bug
* add tenser slice test case
* update softmax testcase
* refine softmax backward
* add logsoftmax backward test
* add maskedfill backward test case
* add sigmoid backward test
* rewrite transpose bacckward op
* add transpose backward test
* format
* refine
* rm useless code
* Fix transose unittest.
* refine according to comments
* update
* refine
* refine
* format
* fix backward testcase
* fix perm param
* fix bug
* numpy method to cal sigmoid grad
* format
* refine
* refine comments
Co-authored-by: hjchen2 <chenhoujiangcug@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 7911d713
* fix flow.save (#4941)
Signed-off-by: daquexian <daquexian566@gmail.com>
Former-commit-id: dbd9d76e
* add math.abs (module)
Former-commit-id: 9670c24a707e01d5445196dc01c145bda792995d
* add math.abs (module)
* fix zero point in fake quantization pass (#4586)
* fix zero point
Signed-off-by: daquexian <daquexian566@gmail.com>
* round zero_point in fake quant kernel to align with onnx
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: bc9ec6c4
* also allow ONEFLOW_DEBUG (#4950)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: f65019f2
* Add Device Descriptor (#4939)
* Add Device Descriptor
* format
* refine
* refine
* check cuda version
* check cuda version
* fix
* fix
* fix WorkSize
* handle more error
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 1cc67da5
* Refactor Optimizers for eager (#4938)
* refactor(Adam): refactor Adam to use dynamic learning rate
* refactor(Adamw): refactor Adamw Optimizer
* refactor(Rmsprop): refactor Rmsprop to use dynamic learning rate
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 49060956
* Add instructions on making sys env permanent (#4949)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 64d3a1d9
* add gradient functions for dim_gather op (#4913)
* start up
* bugs left
* add backward test case
* fix bugs
* refine testcase
* refine
* replace optrait with composedAttrs
* refine
Former-commit-id: e400bc0b
* add gradient funs for unary and binary math op (#4961)
* add gradient funs for unary and binary math op
* add test exp and pow example
* refine pow test case
* refine
* rename register macro
Former-commit-id: a559f632
* Refactor consistent tensor (#4937)
* refactor Tensor
* Export ConsistentTensor::is_cuda
* remove ConsistentTensor::blob_object
* minor fix
* minor fix
* fix compiler complains
* remove unused code
* skip test_creating_consistent_tensor
* del useless function
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: clackhan <han_binbin@163.com>
Former-commit-id: 662cda36
* add backward test case
Former-commit-id: 28353e85d5d1aac17aefbcab9f15d78e9aa3bb0e
* add backward test case
* support tensorrt7 qat (#4958)
* support tensorrt7
* Ignore handling bias
* support label quantization
Former-commit-id: 53881e39
* modify math.abs test case
Former-commit-id: 1aa043e7221e71f3d049bcc89b8bd673f132b4bc
* modify math.abs test case
* fix softmax testcase (#4948)
* add scalar input support
* format
* fix softmax testcase
* fix logsoftmax test
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 10ca2bc0
* add module backward (#4935)
* add reshape module backward
* add expand module backward
* add expand backward
* add expand module backward
* add expand module test
* add squeeze module backward
* code format
* add repeat module backward
* code format
* fix bug
* fix comment
* align expand module with torch
* align repeat module with torch
* fix comment
* fix comment
* fix comment
* fix code format
* fix confilict
* fix bug
* fix comment
* add module backward
* fix pow bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 5362a0d8
* rewrite unsqueeze backward (#4966)
* rewrite unsqueeze backward
* fix comments
* fix comment
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: ec1c80ff
* add module backward (#4942)
* add exp module backward
* add greater test
* add less module test
* add negative module backward
* code format
* add matmul backward
* add broadcast_matmul_backward
* code format
* add batch_matmul backward
* add argmax module test
* delete unuseless code
* fix comment
* fix comment
* fix comment
* fix comment
* fix commet
* code format
* fix bug
* fix pow bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: d20a9953
* fix activation ci bug (#4980)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 4e974d7b
* Hashable attr map (#4951)
* Device::compute_dep_object_
* sequantialize instructions in the same stream.
* refactor AttrMap
* remove redundant header file includes
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: ded8a780
* Fix Global<CommNet>::Delete() (#4981)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 8aade7e7
* delete unused headfile
Former-commit-id: 2b3c27a907fbc75c537cabbbaaf5818efb2e2a29
* delete unused headfile
* update test case format
Former-commit-id: 9cda51fb978fe91245d8c40a4d3fc6a10f2dd4dc
* update test case format
* add of_softmax_use_fast_math (#4979)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: ba6c64e7
* NetIB device enumeration (#4974)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 3f1038d6
* Fix local tensor requires grad (#4992)
* fix(Tensor): add requires_grad setter for ExportTensor
* test(Tensor): refine tensor autograd test
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 09552182
* Support localtensor slice (#4985)
* add scalar input support
* format
* register local tensor slice methods
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 4f4ce1f2
* Symbol::shared_from_symbol (#4969)
* Symbol::shared_from_symbol
* fix bug in Symbol::shared_from_symbol
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: a30eb43f
* CI formats code automatically (#4983)
* check in
* qq mail
* wrong fmt
* auto format by CI
* use youarefly@qq.com
* wrong fmt
* auto format by CI
* use ci-bot@oneflow.org
* wrong fmt
* auto format by CI
Co-authored-by: oneflow-ci-bot <373331853@qq.com>
Co-authored-by: oneflow-ci-bot <youarefly@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9cfee9b1
* Eager consistent tensor (#4984)
* Device::compute_dep_object_
* sequantialize instructions in the same stream.
* refactor AttrMap
* refactor Tensor
* Export ConsistentTensor::is_cuda
* remove ConsistentTensor::blob_object
* refactor TensorImpl
* minor fix
* fix compiler' complains
* Implements EagerConsistentTensorImpl::New
* minor fix
* fix compiler complains
* remove unused code
* skip test_creating_consistent_tensor
* backup code
* Symbol::shared_from_symbol
* remove redundant header file includes
* fix bug in Symbol::shared_from_symbol
* symbolize ParallelDesc and ParallelDistribution
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: clackhan <han_binbin@163.com>
Former-commit-id: 3356bcad
* add resnet50 model test (#4957)
* add resnet50 model test
* udpate script
* udpate script
* relax tolerant
* run resnet50 in 1n1d
* fix format
* test resnet50 fun parameters
* add resnet50 with and without bn test
* fix resnet50 without bn train overflow
* change assertEqual to assertTrue
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 01278a66
* Add arg where module (#4998)
* add argmax test
* add argwhere module
* add argwhere module
* code format
* update unit_test
* fix commet
* update docs
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 816983aa
* fix hierarchical_sub_task_graph_builder condition (#4990)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 0cc74104
* Add __str__ and tolist for tensor (#4928)
* add __str__ and tolist
* initial tensor printer
* reorginized tensor str
* minor fix
* user nparray2string
* Add FunctionNode op_name (#4970)
* feat(FunctionNode): add op_type_name
* style(FunctionNode): rename op_name to op_type_name
* add test case for numel
* style(OpExpr): rename type_name to op_type_name (#4976)
* add test for tensor str
* minor fix
* minor fix
* support for local tensor
* support for local tensor
* format
* fix typo
Co-authored-by: Yinggang Wang <wyg19970408@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: cf2ec98e
* Add squeeze module backward (#5007)
* add argmax test
* add squeeze module backward
* fix conflict
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 10c40f28
* RPC backend local supports barrier of barrier_num > 1 (#4968)
* check in changes
* refine
* fix
* erase when barrier exits
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c3371486
* add activation module backward test (#4967)
* add tanh module backward test
* add gelu module backward
* fix activation ci bug
* add reshape module backward
* add tensor reshape module and code format
* add permute module backward
* fix conflict
* add argmax test
* fix permute module bug
* add prelu module cpu backward
* fix prelu gpu backward bug
* code format
* restruct hardtanh module test
* add hardtanh backward
* add hardswish backward
* add hardsigmoid module backward
* add relu module backward
* add relu6 module backward
* add elu module backward
* fix comments
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c1873f74
* Add sys_ptrace for build docker container (#5005)
* add sys_ptrace build docker container
* refine
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 659f59e1
* Refine pythonpath in cmake (#5002)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 7b80f84f
* Refactor scope parallel desc (#4996)
* Symbol::shared_from_symbol
* fix bug in Symbol::shared_from_symbol
* symbolize Scope::GetParallelDesc()
* IsScalarType
* fix compiler complains
* fix bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: clackhan <han_binbin@163.com>
Former-commit-id: 0be87a94
* add arange module backward (#4978)
* add arange module backward
* update
* refine
* fix comments
* refine
* fix docs
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 3878aea7
* CI skips resnet50 to prevent segfault (#5017)
* CI skip resnet50
* fix
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 13b46125
* NetSocket device enumeration (#4997)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c38ccebb
* Add device unmatch info (#4989)
* add argmax test
* add device unmatch error
* delete unuse code
* delete unuse code
* refine code
* fix var name error bug
* add prelu exception get
* add prelu exception get
* add prelu exception get
* add prelu exception get
* add exception
* code format
* fix commet
* add more error information
* refine error info
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 8b0905b8
* BindFwBwObaPairs skip parallel_cast (#4986)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 3a8bee33
* rewrite matmul op backward (#4988)
* rewrite matmul op backward
* refine
* update
* fix comments
* refine
* refine
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: f06bf705
* Add concat module backward (#5013)
* add argmax test
* add concat module backward
* add concat backward impl
* add concat module backward
* fix concat module backward bug
* fix concat module backward bug
* fix concat module backward bug
* add concat module backward
* delete unuse code
* fix comments
* fix comments
* fix comments
* fix comments
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 21f1bddb
* rewrite dropout backward (#5014)
* rewrite dropout backward
* refine
* fix comments
* auto format by CI
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: bd778bf3
* fix has_grad template (#4962)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 1559abd4
* Upload core files optionally (#5020)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 7b5eb78c
* Fix docs bug (#5019)
* add argmax test
* fix oneflow docstring bug
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 1e9c6ff4
* Doesn't allow CI to run PRs in parallel (#5016)
* update commit
* fix sha
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: d770a56d
* try fix (#5029)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 5b7c7649
* add cosh module (#4943)
* add cosh module
* fix the calculation of cosh backward
* add testcase of cosh
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 7142ed99
* Fix log level (#5009)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 539d6093
* oop oneflow.Model with training, validation and checkpoint (#4972)
* trainer structure
* add test
* add nnmodel api
* nn Model draft
* try run global_func in Model
* fit to be refined
* model run global_func train & eval
* nn Model for function style execution draf test pass
* refactor nn model
* nn model with nessary component
* format
* rm nn prefix of Model
* flow.Model multi-task numpy-input
* (flow.Model)op_dataload support multi job
* (flow.Model) auto job_func signature for numpy input
* (flow.Model)support auto numpy input job
* (flow.Model) nump input multi job train test pass
* (flow.Model)fix classmethod
* fix test
* (oneflow.Model)training_step multi output, refine according to pep8
* (oneflow.Model)pep8 check pass by flake8
* pytorch-style module
Signed-off-by: daquexian <daquexian566@gmail.com>
* fix typo, update parameter
Signed-off-by: daquexian <daquexian566@gmail.com>
* Model refine
* Model fix typo
* oneflow.Model optimizer variable lazy get, numpy job signature to DataModule
* oneflow.Model merge and format
* oneflow.Model: comment empty func to be overried
* Optimizer: lazy get var add check and tips
* oneflow.Model: refactor
* oneflow.Model: refactor 2
* add TODO, remove unused import, set consistent to True in parameter
Signed-off-by: daquexian <daquexian566@gmail.com>
* oneflow.Model: ModelStage -> SubStep, TrainStage -> TrainStep
* fix format
* oneflow.Model: SubStep to SubModel
* oneflow.Model: infer_oneflow_data_placeholder and _infer_job_signature
* set placement of parameter
Signed-off-by: daquexian <daquexian566@gmail.com>
* reformat
Signed-off-by: daquexian <daquexian566@gmail.com>
* add __init__.py in oneflow.python.nn.modules
Signed-off-by: daquexian <daquexian566@gmail.com>
* add todo for GetCurrentJobName()
* fix typo
* oneflow.Model: refine error message
* fix format
* OOPModel: import new Module
* oneflow.Model: rm FunctionConfig in Model
* oneflow.Model config_exe to config_execution
* OOPModel: add and test naive validate
* oneflow.Model: merge module
* Optimizer: user mode to confirm that Optimizer.Variable() is called inside a job
* merge master
* oop model : predict demo
* model inherit new module
* refine
* refine oneflow.mode
* add test oop model
* add test
* no_grad on ones_like
* fix has_grad template
* format
* fix data input
* fix
* check oop model
* add model checkpoint
* rm useless code
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 121b1423
* Add upsample module backward (#5025)
* add argmax test
* add upsample module backward
* update upsample unittest
* fix unittest bug
* refine upsample backward
* code format
* fix comment
* fix comment
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 86d4a672
* Prevent CMake from using highest version of python3 (#5034)
* Use conda python if available
* refine
* refine
* refine
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 01e1a714
* rewrite slice backward (#5018)
* rewrite slice backward
* remove unuse .h
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c1880c01
* fix qat (#5038)
* fix qat
* format
* refine
* add comment
* Update test.yml
* Update test_quantize_op.py
* Update test_quantize_op.py
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Former-commit-id: 2dfb5b56
* Support convert tensorbuffer to list of numpy (#4940)
* support convert tensorbuffer to list of numpy
* improve speed
* remove useless codes
* get tensor_buffer shapes and dtypes by single function
* add __eq__ and __hash__ to DType
* add dynamic_out to tensor_buffer_to_list_of_tensors_v2
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 577568af
* Add JUST (#5041)
Former-commit-id: 994b0df0
* Add broadcast like module backward (#5037)
* add argmax test
* add broadcastlike module backward, bug need fixed
* fix broadcast_like backward bug
* auto format by CI
* refine code
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: e7bb21bb
* Fix segfault caused by zlib in conda when share lib is enabled (#5045)
* check in changes
* address review
* address review
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 9bec9735
* Fix norm grad func to support dynamic attrs. (#5043)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: cc1c554c
* Fix segfault in new interface (#5042)
* fix data race about composed attr map
Signed-off-by: daquexian <daquexian566@gmail.com>
* move ResetPrior before ChooseOpKernel
Signed-off-by: daquexian <daquexian566@gmail.com>
* delete vm before others
Signed-off-by: daquexian <daquexian566@gmail.com>
* revert deletion order change, sync by atexit
Signed-off-by: daquexian <daquexian566@gmail.com>
* add comments
Signed-off-by: daquexian <daquexian566@gmail.com>
* rename
Signed-off-by: daquexian <daquexian566@gmail.com>
* fix multi machine bug
Signed-off-by: daquexian <daquexian566@gmail.com>
* auto format by CI
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Former-commit-id: 68a5c10b
* Add where module backward (#5035)
* add argmax test
* add where module backward
* fix where module unit_test bug
* add zerolike and where op function
* add backward code
* add broadcast like backward
* refine
* fix where module backward bug
* rebuild test
* fix comment
* fix comment
* fix comment
* fix comment
* fix comments
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: dec89a96
* Query system status if CI failed (#5052)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 26bbcfcd
* fix(vm): add virtual mechine backpressure (#5050)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: cd21df2f
* change in_edages/out_edages to from SKIPLIST to LIST (#5047)
* change in_edages/out_edages to from SKIPLIST to LIST
* minor fix
* refine
Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: b9568262
* Stop heartbeat and add barrier before Global<CtrlServer>::Delete() (#5010)
refine
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: e861dd3b
* fix error on exiting (#5053)
* fix error on exiting
Signed-off-by: daquexian <daquexian566@gmail.com>
* lazily get rank
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 51335128
* Restore eager r50 case (#5055)
Former-commit-id: 64665e75
* Add argmax softplus logsigmoid module backward (#5049)
* add argmax test
* add argmax module backward, bug need fixed
* add leakyrelu module backward
* delete argmax backward test
* delete argmax backward test
* add softplus module backward
* code format
* add softplus module backward
* add logsigmoid module backward
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 06b549b3
* add doctest (#5046)
* add doctest
* refine
* update modules doctest
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 7394ec5f
* refactor DType (#5024)
* refactor DType
* fix compiler complains
* DType is only allowed to be used in python code
* dtype api bugfix
* fix error on exiting
Signed-off-by: daquexian <daquexian566@gmail.com>
* lazily get rank
Signed-off-by: daquexian <daquexian566@gmail.com>
* Export const DType* into python
Co-authored-by: binbinHan <han_binbin@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: daquexian <daquexian566@gmail.com>
Former-commit-id: c2b2eb25
* remove try_init_session in new interface (#5061)
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 912bc97d
* Rewrite batch broadcast matmul backward (#5012)
* rewrite matmul op backward
* refine
* update
* fix comments
* refine
* refine
* rewrite batch broadcast matmul backward
* refine
* refine
* refine
* refine
* Add JUST
* restructure matmul series module backward
* refine
* fix comments
* fix comments
* refine
Co-authored-by: hjchen2 <chenhoujiangcug@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: c4f277a1
* modify format
Former-commit-id: 5bdb45adbb0881263ef5fe0afe13dd606a8e6ff6
* modify format
* run make of_format
Former-commit-id: e976b9b0f88bc2e91fddb3053dab5bd5001e8318
* run make of_format
* lock cmake version in manylinux cmake (#5057)
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: fe662377
* Doctest support in CI (#4973)
* check in changes
* refine
* fix
* add test on obj
* add relu example
* run doctest in ci
* dont delete python
* address review
* address review
* address review
* address review
* address review
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 56f6348d
* Update README for 0.4.0 (#4965)
* refine
* remove content
* refine
* require py36
* address review
* refine
* address review
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: cc316206
* Add step lr and lambda lr (#5063)
* feat(StepLR): add StepLR
* feat(LambdaLR): add LambdaLR
* docs(LambdaLR): fix document
* style(LambdaLR): add comment
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 4c005b7c
* Release cuda 112 (#5060)
* Nightly for cu112
* add arg
* nightly
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 72cfa991
* add flow.asin, flow.Tensor.asin, flow.arcsin, flow.Tensor.arcsin, flow.asinh, flow.Tensor.asinh, flow.arcsinh, flow.Tensor.arcsinh (#4955)
* add flow.asin and torch.arcsin
* add torch.asin and torch.arcsin
* add torch.sin and torch.arcsin
* add torch.asin and torch.arcsin
* add torch.asin and torch.arcsin
* add torch.asin and torch.arcsin
* add torch.asin and torch.arcsin
* add torch.asin and torch.arcsin
* update test_asin.py including forward and backward
* Update test_math_ops.py
remove asin testcase
* update testcase including forward and backward
* add torch.asinh and torch.Tensor.asinh
* update testcase of asin and asinh
* update testcase of asin and asinh
* update testcase of asin and asinh
* update testcase
* update testcase
* make format
* update license
* update testcase
* check in
* qq mail
* wrong fmt
* auto format by CI
* use youarefly@qq.com
* wrong fmt
* auto format by CI
* use ci-bot@oneflow.org
* wrong fmt
* auto format by CI
* mv op testcase to test_tensor.py
* auto format by CI
* update docstring
* update docstring
* update doctest
* update doctest
* auto format by CI
* update arcsinh
* auto format by CI
Co-authored-by: 陈岱渊 <chendy@zhejianglab.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: jackalcooper <jackalcooper@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <373331853@qq.com>
Co-authored-by: oneflow-ci-bot <youarefly@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Former-commit-id: 95748870
* Add modules doctest bbuf (#5058)
* add argmax test
* add nllloss doctest
* add doctest
* add crossentropyloss doctest
* add expand module doctest
* add squeeze module doctest
* add repeat module doctest
* add exp module doctest
* add argmax module doctest
* add matmul module doctest
* add greater module doctest
* add less module doctest
* add negative module doctest
* add linear module doctest
* add tanh module doctest
* add gelu module doctest
* add reshape module doctest
* add transpose module doctest
* add where module doctest
* add permute module doctest
* add prelu module doctest
* add hardtanh module doctest
* add activation module doctest
* add activation module doctest
* add upsample module doctest
* auto format by CI
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Former-commit-id: 58183f87
* remove origin testCase in test_math_ops
Former-commit-id: 3a4bae704e2698225b15734fb440a6f8ddef5120
* remove origin testCase in test_math_ops
* Add tensor detach python api (#5068)
* add argmax test
* add tensor detach python api
* delete unuse code
Former-commit-id: 9b30b7c9
* Delete preprocessor_internal.h.REMOVED.git-id
* Delete nn_ops.py.REMOVED.git-id
Co-authored-by: Lyon <flowingsun007@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Yinggang Wang <wyg19970408@gmail.com>
Co-authored-by: Yurui Li <32978179+poohRui@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Liang Depeng <liangdepeng@gmail.com>
Co-authored-by: daquexian <daquexian566@gmail.com>
Co-authored-by: binbinHan <han_binbin@163.com>
Co-authored-by: Houjiang Chen <chenhoujiangcug@gmail.com>
Co-authored-by: Li Xinqi <lixinqi2010@gmail.com>
Co-authored-by: Shijie <821898965@qq.com>
Co-authored-by: Yao Chi <later@usopp.net>
Co-authored-by: Shenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Xiaoyu Xu <xiaoyulink@gmail.com>
Co-authored-by: lixinqi <lixinqi0703106@163.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Juncheng <liujuncheng1022@gmail.com>
Co-authored-by: mosout <mosout@qq.com>
Co-authored-by: poohRui <yuruil@qq.com>
Co-authored-by: guo ran <360112263@qq.com>
Co-authored-by: oneflow-ci-bot <373331853@qq.com>
Co-authored-by: oneflow-ci-bot <youarefly@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: YongtaoShi <73167956+YongtaoShi@users.noreply.github.com>
Co-authored-by: yayeoCddy <Dy_Chen95@163.com>
Co-authored-by: 陈岱渊 <chendy@zhejianglab.com>
-
- Jun 02, 2021
-
-
Xiaoyu Zhang authored
* add argmax test * rewrite crossentropyloss grad unittest * rewrite nllloss * fix nllloss reduction param not align with torch * auto format by CI Co-authored-by:
oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org> -
daquexian authored
* release gil in receive Signed-off-by:
daquexian <daquexian566@gmail.com>
* only acquire/release gil when necessary
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
yayeoCddy authored
* add flow.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.sin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * update test_asin.py including forward and backward * Update test_math_ops.py remove asin testcase * update testcase including forward and backward * add torch.asinh and torch.Tensor.asinh * update testcase of asin and asinh * update testcase of asin and asinh * update testcase of asin and asinh * update testcase * update testcase * make format * update license * update testcase * check in * qq mail * wrong fmt * auto format by CI * use youarefly@qq.com * wrong fmt * auto format by CI * use ci-bot@oneflow.org * wrong fmt * auto format by CI * mv op testcase to test_tensor.py * auto format by CI * update docstring * update docstring * update doctest * update doctest * auto format by CI * update arcsinh * fix warnning in np.arcsin * bug * auto format by CI Co-authored-by:
陈岱渊 <chendy@zhejianglab.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: jackalcooper <jackalcooper@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <373331853@qq.com>
Co-authored-by: oneflow-ci-bot <youarefly@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org> -
Houjiang Chen authored
-
Juncheng authored
Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Xiaoyu Zhang authored
* add argmax test * add tensor detach python api * delete unuse code
-
Xiaoyu Zhang authored
* add argmax test * add nllloss doctest * add doctest * add crossentropyloss doctest * add expand module doctest * add squeeze module doctest * add repeat module doctest * add exp module doctest * add argmax module doctest * add matmul module doctest * add greater module doctest * add less module doctest * add negative module doctest * add linear module doctest * add tanh module doctest * add gelu module doctest * add reshape module doctest * add transpose module doctest * add where module doctest * add permute module doctest * add prelu module doctest * add hardtanh module doctest * add activation module doctest * add activation module doctest * add upsample module doctest * auto format by CI Co-authored-by:
oneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
yayeoCddy authored
add flow.asin, flow.Tensor.asin, flow.arcsin, flow.Tensor.arcsin, flow.asinh, flow.Tensor.asinh, flow.arcsinh, flow.Tensor.arcsinh (#4955) * add flow.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.sin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * add torch.asin and torch.arcsin * update test_asin.py including forward and backward * Update test_math_ops.py remove asin testcase * update testcase including forward and backward * add torch.asinh and torch.Tensor.asinh * update testcase of asin and asinh * update testcase of asin and asinh * update testcase of asin and asinh * update testcase * update testcase * make format * update license * update testcase * check in * qq mail * wrong fmt * auto format by CI * use youarefly@qq.com * wrong fmt * auto format by CI * use ci-bot@oneflow.org * wrong fmt * auto format by CI * mv op testcase to test_tensor.py * auto format by CI * update docstring * update docstring * update doctest * update doctest * auto format by CI * update arcsinh * auto format by CI Co-authored-by:
陈岱渊 <chendy@zhejianglab.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: jackalcooper <jackalcooper@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <373331853@qq.com>
Co-authored-by: oneflow-ci-bot <youarefly@qq.com>
Co-authored-by: oneflow-ci-bot <ci-bot@oneflow.org>
-
- Jun 01, 2021
-
-
Shenghang Tsai authored
* Nightly for cu112 * add arg * nightly Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Yinggang Wang authored
* feat(StepLR): add StepLR * feat(LambdaLR): add LambdaLR * docs(LambdaLR): fix document * style(LambdaLR): add comment Co-authored-by:
Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Shenghang Tsai authored
* refine * remove content * refine * require py36 * address review * refine * address review Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Shenghang Tsai authored
* check in changes * refine * fix * add test on obj * add relu example * run doctest in ci * dont delete python * address review * address review * address review * address review * address review Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Shenghang Tsai authored
Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Luyang authored
* rewrite matmul op backward * refine * update * fix comments * refine * refine * rewrite batch broadcast matmul backward * refine * refine * refine * refine * Add JUST * restructure matmul series module backward * refine * fix comments * fix comments * refine Co-authored-by:
hjchen2 <chenhoujiangcug@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
daquexian authored
Signed-off-by:
daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Li Xinqi authored
* refactor DType * fix compiler complains * DType is only allowed to be used in python code * dtype api bugfix * fix error on exiting Signed-off-by:
daquexian <daquexian566@gmail.com>
* lazily get rank
Signed-off-by: daquexian <daquexian566@gmail.com>
* Export const DType* into python
Co-authored-by: binbinHan <han_binbin@163.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: daquexian <daquexian566@gmail.com> -
Luyang authored
* add doctest * refine * update modules doctest Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Xiaoyu Zhang authored
* add argmax test * add argmax module backward, bug need fixed * add leakyrelu module backward * delete argmax backward test * delete argmax backward test * add softplus module backward * code format * add softplus module backward * add logsigmoid module backward Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Shenghang Tsai authored
-
daquexian authored
* fix error on exiting Signed-off-by:
daquexian <daquexian566@gmail.com>
* lazily get rank
Signed-off-by: daquexian <daquexian566@gmail.com>
Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> -
Juncheng authored
refine Co-authored-by:oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
-