← NSFGrants
HomeNsf Awards

CAREER: Efficient and Scalable Large Foundational Model Training on Supercomputers for Sci — NSF Award to Rutgers University New B

Deep learning (DL) methods, especially the large foundational models, enable exciting new approaches to problems in many science and engineering disciplines, such as genomics, bioinformatics, meteorology, and natural language processing. Training foundational models at extreme scales is time-consuming, prone to low uti

Award titleCAREER: Efficient and Scalable Large Foundational Model Training on Supercomputers for Sci
Award ID2340011
AwardeeRutgers University New Brunswick
CityNEW BRUNSWICK
StateNJ
Amount obligated$599,707
Principal investigatorZhao Zhang
ProgramCAREER: FACULTY EARLY CAR DEV
Start date07/01/2024
AbstractDeep learning (DL) methods, especially the large foundational models, enable exciting new approaches to problems in many science and engineering disciplines, such as genomics, bioinformatics, meteorology, and natural language processing. Training foundational models at extreme scales is time-consuming, prone to low utilization with limited scalability, and human-effort demanding. This NSF CAREER project addresses the convergence, performance, and scalability gaps of large foundational model pre-
SourceNSF Awards

🔍 Search all NSF awards →