Dev flow.utils.data part1 (#5406)
* refine and add test case
* support ellipsis type slice
* refine
* refine
* support slice assign ellipsis type
* refine
* register fn to localtensor
* basic implemetation of dataloader
* format
* refine as comments
* fix comments
* remove useless code
* add test case into unnitest
* refine ascomments
* refine as comments
Co-authored-by:
oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Showing
- oneflow/python/test/dataloader/test_numpy_dataset.py 51 additions, 0 deletionsoneflow/python/test/dataloader/test_numpy_dataset.py
- oneflow/python/test/dataloader/test_tensor_dataset.py 81 additions, 0 deletionsoneflow/python/test/dataloader/test_tensor_dataset.py
- oneflow/python/utils/__init__.py 0 additions, 0 deletionsoneflow/python/utils/__init__.py
- oneflow/python/utils/data/__init__.py 58 additions, 0 deletionsoneflow/python/utils/data/__init__.py
- oneflow/python/utils/data/_utils/__init__.py 57 additions, 0 deletionsoneflow/python/utils/data/_utils/__init__.py
- oneflow/python/utils/data/_utils/collate.py 114 additions, 0 deletionsoneflow/python/utils/data/_utils/collate.py
- oneflow/python/utils/data/_utils/fetch.py 68 additions, 0 deletionsoneflow/python/utils/data/_utils/fetch.py
- oneflow/python/utils/data/dataloader.py 528 additions, 0 deletionsoneflow/python/utils/data/dataloader.py
- oneflow/python/utils/data/dataset.py 312 additions, 0 deletionsoneflow/python/utils/data/dataset.py
- oneflow/python/utils/data/decorator.py 126 additions, 0 deletionsoneflow/python/utils/data/decorator.py
- oneflow/python/utils/data/sampler.py 250 additions, 0 deletionsoneflow/python/utils/data/sampler.py
Please register or sign in to comment