Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Megatron-LM: Training
Multi-Billion Parameter Language Models Using Model Parallelism
arXiv 提交日期:17 Sep 2019(GPT 2 blog 发布约半年后,即:February
14, 2019 -> 17 Sep 2019)
代码:Megatron-LM
作者:
摘要: