Challenges and Solutions in Low-Precision Training Methods

Add to your list(s) Download to your calendar using vCal

• Taowen (Tony) Liu (Imperial College)
• Monday 11 December 2023, 13:00-14:00
• Department of Electrical and Electronic Engineering, Room 909B.

If you have a question about this talk, please contact George A Constantinides.

This presentation reviews low-precision training methods in neural networks and the main challenges associated with these techniques. We will discuss the current solutions, focusing on mixed precision and stochastic rounding. Additionally, we will identify critical unsolved problems in the field and propose our approaches for addressing these issues.

This talk is part of the CAS Talks series.

This talk is included in these lists:

• Andrea Picciau's list
• CAS Talks
• Circuits and Systems Group: Internal Seminars
• Department of Electrical and Electronic Engineering, Room 909B

Note that ex-directory lists are not shown.