Dev build and infer ctx (#2089)
* add job_build_and_infer_ctx interface * lbn_with_split_hint * fix maybe macro * fix signature of Maybe<T>::Error() * job_build_and_infer_if * add c_api_util wrapper for job_build_and_infer_ctx * implement python/job_build_and_infer interface * CurJobBuildAndInferCtx_AddPlacementGroup * BuildJobAndInferCtx and Mgr c++ implement (#2074) * job_build_and_infer_ctx_mgr * refine interface of infer_ctx_mgr * JobBuildInferCtx set job conf; add and refine error type * revert job.proto * half impl of add op in build_infer_ctx * generate op produced empty logical blob desc ; infer out blob desc interface * job_build_and_infer_ctx VERSION 1 * add InferOutBlobDesc for conv op; remove record_piece_size in interface op * maybe return * job_set hold by job_build_and_infer_ctx_mgr * check placement when infer ctx mgr leave cur job * Global New/Delete JobBuildAndInferCtxMgr * add JUST when ctx add op * remove unused job_conf.arg_op_name * fix bugs caused by python new api * fix bugs caused by lack of Global<JobDesc> * fix bugs caused by new api * refactor compiler.Compile * merge dev_python * remove unused message proto * rename api
Showing
- oneflow/core/common/error.proto 29 additions, 1 deletiononeflow/core/common/error.proto
- oneflow/core/common/error_util.cpp 35 additions, 0 deletionsoneflow/core/common/error_util.cpp
- oneflow/core/common/error_util.h 19 additions, 0 deletionsoneflow/core/common/error_util.h
- oneflow/core/common/maybe.h 11 additions, 6 deletionsoneflow/core/common/maybe.h
- oneflow/core/common/protobuf.cpp 14 additions, 0 deletionsoneflow/core/common/protobuf.cpp
- oneflow/core/common/protobuf.h 3 additions, 0 deletionsoneflow/core/common/protobuf.h
- oneflow/core/job/critical_section_desc.cpp 3 additions, 3 deletionsoneflow/core/job/critical_section_desc.cpp
- oneflow/core/job/critical_section_desc.h 1 addition, 1 deletiononeflow/core/job/critical_section_desc.h
- oneflow/core/job/environment_objects_scope.cpp 3 additions, 0 deletionsoneflow/core/job/environment_objects_scope.cpp
- oneflow/core/job/inter_job_mem_sharing_util.cpp 0 additions, 15 deletionsoneflow/core/job/inter_job_mem_sharing_util.cpp
- oneflow/core/job/job.proto 0 additions, 1 deletiononeflow/core/job/job.proto
- oneflow/core/job/job_build_and_infer_ctx.cpp 222 additions, 0 deletionsoneflow/core/job/job_build_and_infer_ctx.cpp
- oneflow/core/job/job_build_and_infer_ctx.h 57 additions, 0 deletionsoneflow/core/job/job_build_and_infer_ctx.h
- oneflow/core/job/job_build_and_infer_ctx_mgr.cpp 53 additions, 0 deletionsoneflow/core/job/job_build_and_infer_ctx_mgr.cpp
- oneflow/core/job/job_build_and_infer_ctx_mgr.h 35 additions, 0 deletionsoneflow/core/job/job_build_and_infer_ctx_mgr.h
- oneflow/core/job/job_desc.h 0 additions, 1 deletiononeflow/core/job/job_desc.h
- oneflow/core/job/model_init_job.cpp 0 additions, 1 deletiononeflow/core/job/model_init_job.cpp
- oneflow/core/job/oneflow.cpp 1 addition, 5 deletionsoneflow/core/job/oneflow.cpp
- oneflow/core/job/parallel_desc.cpp 7 additions, 0 deletionsoneflow/core/job/parallel_desc.cpp
- oneflow/core/job/parallel_desc.h 3 additions, 0 deletionsoneflow/core/job/parallel_desc.h
Please register or sign in to comment