Academy of Mathematics and Systems Science, CAS Colloquia & Seminars | Speaker: | 朱裕华 博士,Stanford University | Inviter: | 周爱辉 研究员 | Title: | Fokker-Planck Equations and Machine Learning | Time & Venue: | 2021.11.08 10:00-11:00 腾讯会议 ID:835 248 507 | Abstract: | As the continuous limit of many discretized algorithms, PDEs can provide a qualitative description of algorithm's behavior and give principled theoretical insight into many mysteries in machine learning. In this talk, I will give a theoretical interpretation of several machine learning algorithms using Fokker-Planck (FP) equations. In the first one, we provide a mathematically rigorous explanation of why resampling outperforms reweighting in correcting biased data when stochastic gradient-type algorithms are used in training. In the second one, we propose a new method to alleviate the double sampling problem in model-free reinforcement learning, where the FP equation is used to do error analysis for the algorithm. In the last one, inspired by an interactive particle system whose mean-field limit is a non-linear FP equation, we develop an efficient gradient-free method that finds the global minimum exponentially fast. | | | |