【创源大讲堂】分布式大模型训练加速:方法和系统

来源:计算机与人工智能学院 发布日期: Fri Sep 08 00:00:00 CST 2023 浏览次数:2151

讲座时间:2023年09月11日(星期一)下午16:30

讲座地点:犀浦校区X31541学术报告厅

主讲人:徐洁 教授

主讲人简介:

Jie Xu is Chair of Computing at the University of Leeds, Director of the UK White Rose Grid e-Science Centre, involving the three White Rose Universities of Leeds, Sheffield and York, and Head of the Distributed Systems and Services (DSS) Theme at Leeds. Xu has worked in the field of Distributed Computing Systems for over thirty-five years, engaging closely with industrial leaders such as Alibaba, BAE Systems, JLR, and Rolls-Royce. Professor Xu is an executive member of UKCRC (UK Computing Research Committee) and an awarded Turing Fellow in AI and Data Science. He is the co-founder of two university's spin-outs that specialise in data analytics and AI software for maximising data centre performance and in co-simulation and digital twins.

内容简介:

This talk reports our latest experience with speeding up pre-trained DNN models through fine-grained GPU parallelism and introduces an application of multi-task learning for predicting passengers' demands.