pangu moe host_device

official/nlp/pangu_alpha/README.md

official/nlp/pangu_alpha/scripts/run_distribute_train.sh

.../nlp/pangu_alpha/scripts/run_distribute_train_and_eval.sh

...ngu_alpha/scripts/run_distribute_train_moe_host_device.sh

official/nlp/pangu_alpha/src/adam.py

official/nlp/pangu_alpha/src/pangu_alpha.py

official/nlp/pangu_alpha/src/pangu_alpha_config.py

official/nlp/pangu_alpha/src/pangu_alpha_wrapcell.py

official/nlp/pangu_alpha/src/utils.py

official/nlp/pangu_alpha/train.py