Implementation of SavedModel and InferenceSession (#4066)
* save model and load model demo * fix * tensor.proto and copy signature * pass test * add load_saved_model function for InferenceSession * wait_for_all_jobs_finished * test_alexnet_save_and_load * support change batch_size * support batch axis * add ci test * revert job_build_and_infer_ctx api * simplify test script * following update * improve search function of InferenceSession * fix break update * add cv2 to dev-requirements * Update Dockerfile * rm 3.5 * fix * quick workaround * speed up bazel * port changes * revert workaround * rm batch_axis in JobInputDef and JobOutputDef * rm export for ImageNetRecordDataset * refine Complete api for GraphBuilder and SignatureBuilder * refine check op is moirrored * fix by review comment ci test * InferenceSession is not responsible to destroy env Co-authored-by:Shenghang Tsai <jackalcooper@gmail.com> Co-authored-by:
Tsai <caishenghang@oneflow.org> Co-authored-by:
oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Showing
- .github/workflows/test.yml 5 additions, 0 deletions.github/workflows/test.yml
- ci/test/1node_model_serve_test.sh 13 additions, 0 deletionsci/test/1node_model_serve_test.sh
- cmake/cfg.cmake 1 addition, 0 deletionscmake/cfg.cmake
- dev-requirements.txt 1 addition, 0 deletionsdev-requirements.txt
- oneflow/api/python/framework/framework.cpp 3 additions, 0 deletionsoneflow/api/python/framework/framework.cpp
- oneflow/api/python/framework/framework.h 22 additions, 0 deletionsoneflow/api/python/framework/framework.h
- oneflow/api/python/framework/framework_api.h 10 additions, 0 deletionsoneflow/api/python/framework/framework_api.h
- oneflow/api/python/job_build/job_build_and_infer.cpp 17 additions, 0 deletionsoneflow/api/python/job_build/job_build_and_infer.cpp
- oneflow/api/python/job_build/job_build_and_infer.h 59 additions, 0 deletionsoneflow/api/python/job_build/job_build_and_infer.h
- oneflow/api/python/job_build/job_build_and_infer_api.h 47 additions, 0 deletionsoneflow/api/python/job_build/job_build_and_infer_api.h
- oneflow/core/common/protobuf.cpp 13 additions, 1 deletiononeflow/core/common/protobuf.cpp
- oneflow/core/common/protobuf.h 2 additions, 0 deletionsoneflow/core/common/protobuf.h
- oneflow/core/job/job_build_and_infer_ctx.cpp 61 additions, 0 deletionsoneflow/core/job/job_build_and_infer_ctx.cpp
- oneflow/core/job/job_build_and_infer_ctx.h 2 additions, 1 deletiononeflow/core/job/job_build_and_infer_ctx.h
- oneflow/core/job/job_conf.proto 18 additions, 1 deletiononeflow/core/job/job_conf.proto
- oneflow/core/job/oneflow.cpp 4 additions, 5 deletionsoneflow/core/job/oneflow.cpp
- oneflow/core/job_rewriter/add_input_output_ops_pass.cpp 177 additions, 0 deletionsoneflow/core/job_rewriter/add_input_output_ops_pass.cpp
- oneflow/core/serving/saved_model.proto 19 additions, 0 deletionsoneflow/core/serving/saved_model.proto
- oneflow/python/framework/c_api_util.py 83 additions, 0 deletionsoneflow/python/framework/c_api_util.py
- oneflow/python/framework/compiler.py 3 additions, 2 deletionsoneflow/python/framework/compiler.py
Please register or sign in to comment