Heavy-tailed large deviations and deep learning`s generalization mystery

LIST

모드선택 :              
세미나 신청은 모드에서 세미나실 사용여부를 먼저 확인하세요

Heavy-tailed large deviations and deep learning`s generalization mystery

수리과학부 0 1188
구분 수학강연회
일정 2021-09-16(목) 16:00~17:00
세미나실 129동 101호
강연자 이창한 (Northwestern University)
담당교수 현동훈
기타
https://snu-ac-kr.zoom.us/j/87197218314 Zoom ID: 871 9721 8314 Abstract: While the typical behaviors of stochastic systems are often deceptively oblivious to the tail distributions of the underlying uncertainties, the ways rare events arise are vastlydifferent depending on whether the underlying tail distributions are light-tailed or heavy-tailed. Roughly speaking, in light-tailed settings, a system-wide rare event arises because everything goes wrong a little bit as if the entire system has conspiredup to provoke the rare event (conspiracy principle), whereas, in heavy-tailed settings, a system-wide rare event arises because a small number of components fail catastrophically (catastrophe principle). In the first part of this talk, I will introduce therecent developments in the theory of large deviations for heavy-tailed stochastic processes at the sample path level and rigorously characterize the catastrophe principle. In the second part, I will explore an intriguing connection between the catastropheprinciple and a central mystery of modern AI—the unreasonably good generalization performance of deep neural networks. This talk is based on the ongoing research in collaboration with Mihail Bazhba, Jose Blanchet, Bohan Chen, Sewoong Oh, Insuk Seo, Zhe Su, Xingyu Wang, and Bert Zwart. Short Bio: Chang-Han Rhee is an Assistant Professor in Industrial Engineering and Management Sciences at Northwestern University. Before joining Northwestern University, he was a postdoctoralresearcher in the Stochastics Group at Centrum Wiskunde & Informatica and in Industrial & Systems Engineering and Biomedical Engineering at Georgia Tech. He received his Ph.D. in Computational and Mathematical Engineering from Stanford University. His researchinterests include applied probability, stochastic simulation, and statistical learning. He was a winner of the Outstanding Publication Award from the INFORMS Simulation Society in 2016, a winner of the Best Student Paper Award (MS/OR focused) at the 2012 WinterSimulation Conference, and a finalist of the 2013 INFORMS George Nicholson Student Paper Competition.

    정원 :
    부속시설 :
세미나명