Optimize/add explicit move copy ctor (#561)

* Erase by swap in filter.

* Fix more usage.

* Fix mistake.

* Add the explicit copy/move ctor and assign. Remove some extra copy.

Co-authored-by: Yee <2520865+yixinglu@users.noreply.github.com>
Co-authored-by: cpw <13495049+CPWstatic@users.noreply.github.com>