Applied Mathematics

Kyle Loh

I am a fourth-year joint B.S.–M.S. student at Florida Atlantic University studying applied mathematics, where I work with Jason Mireles-James and Yu Xiang.

My research focuses on the mathematical foundations of machine learning, and on using those foundations to build better algorithms.

Research

Rigorous numerics for optimizers

I use computer-assisted proofs to study quasiperiodic and chaotic structures, and routes to chaos, in adaptive optimizers such as RMSProp and Adam. My goal is to understand which mechanisms in an adaptive optimizer drive chaotic behavior.

A torus-doubling cascade in RMSProp, shown in four panels: smooth invariant curves break up into progressively more scattered point clouds as a parameter is varied.
A torus-doubling cascade in RMSProp.

Conformal inference

I am developing conformal inference frameworks that bound the false discovery rate under practical constraints: decentralization, limited communication bandwidth, and non-exchangeability.

Publications

Google Scholar

Awards