Infer consistent tensor meta (#5362)
* Device::compute_dep_object_ * sequantialize instructions in the same stream. * refactor AttrMap * refactor Tensor * Export ConsistentTensor::is_cuda * remove ConsistentTensor::blob_object * refactor TensorImpl * minor fix * fix compiler' complains * Implements EagerConsistentTensorImpl::New * minor fix * fix compiler complains * remove unused code * skip test_creating_consistent_tensor * backup code * Symbol::shared_from_symbol * remove redundant header file includes * fix bug in Symbol::shared_from_symbol * symbolize ParallelDesc and ParallelDistribution * symbolize Scope::GetParallelDesc() * IsScalarType * fix compiler complains * InputConsistentTensorMeta * refactor Scope with PlacementScope * fix bug in exporting Scope to python * backup code * refactor DType * fix compiler complains * backup code * DType is only allowed to be used in python code * backup code * dtype api bugfix * fix error on exiting Signed-off-by:daquexian <daquexian566@gmail.com> * lazily get rank Signed-off-by:
daquexian <daquexian566@gmail.com> * Export const DType* into python * minor fix * fix bug * refine * refactor signature of OpExpr::InferLogicalShapeAndDtype * fix bug * backup_code * fix bug * refactor SbpXXX to cfg::SbpXXX * merge refactor_sbp_to_cfg_sbp * fix bug * Infer ConsistentTensorMeta * Implement EagerConsistentInterpret::ApplyImpl * 1) move XXXTensorMeta into the new file tensor_meta.h; 2) add new Class ConsistentTensorInferCache * add class ConsistentTensorInferResult * remove unused OpArgMutConsistentTensorMeta::parallel_distribution_ * fix stack-overflow bug in Tensor::mut_eager_mirrored_tensor_impl * ignore empty parallel distribution constaint * fix bug * add explicit of cfg * fix xla compile bug * auto format by CI * fix according comment * fix bug * refine * refine Co-authored-by:
lixinqi <lixinqi0703106@163.com> Co-authored-by:
Li Xinqi <lixinqi2010@gmail.com> Co-authored-by:
oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> Co-authored-by:
daquexian <daquexian566@gmail.com> Co-authored-by:
Shenghang Tsai <jackalcooper@gmail.com> Co-authored-by:
oneflow-ci-bot <ci-bot@oneflow.org>
Showing
- oneflow/core/framework/consistent_tensor_infer_cache.cpp 11 additions, 10 deletionsoneflow/core/framework/consistent_tensor_infer_cache.cpp
- oneflow/core/framework/consistent_tensor_infer_cache.h 3 additions, 7 deletionsoneflow/core/framework/consistent_tensor_infer_cache.h
- oneflow/core/framework/op_interpreter/eager_consistent_op_interpreter.cpp 1 addition, 2 deletions...mework/op_interpreter/eager_consistent_op_interpreter.cpp
Please register or sign in to comment