Alpa: Automating Model Sharding for Distributed Deep Learning – InfoQ
Alpa: Automating Model Sharding for Distributed Deep Learning – InfoQ
Sabri Bolkar is a machine learning applied scientist and engineer who is interested in the complete lifecycle of learning-based systems from R&D …
Link to Full Article: Alpa: Automating Model Sharding for Distributed Deep Learning – InfoQ