Portrait of Paul Caillon

Hello, I am Paul Caillon, an Associate Professor at Université Paris Dauphine – PSL. Welcome to my homepage!

I work on the foundations of frugal deep learning: how can neural networks learn and process information with less computation? My research combines theoretical analysis with the design of more efficient learning algorithms and neural architectures, from alternatives to backpropagation to efficient attention mechanisms.

News

Research

My research focuses on making deep learning more computationally efficient by rethinking how neural networks learn and process information. I am particularly interested in efficient learning algorithms and neural architectures, and in how gradients and information propagate through deep networks.

I investigate how deep networks can be trained more efficiently, how attention mechanisms can handle long sequences at lower computational cost, and how architectures can adapt their capacity during learning. More broadly, I explore how models can learn effectively from limited data and supervision. These questions connect my work on language models and scientific machine learning, with an emphasis on understanding the trade-offs between efficiency, generalization, and robustness.

From 2019 to 2023, I was a PhD student at LORIA under the supervision of Christophe Cerisara. I then joined LAMSADE as a postdoctoral researcher from 2023 to 2025, working with Alexandre Allauzen. From 2025 to 2026, I was a PSL AI Fellow. Since the 1st of September 2026, I am an Associate Professor at Université Paris Dauphine – PSL.


I also enjoy working with PhD students and research interns. Current and former students I have supervised or co-supervised include:


  • Nan An — former intern.
  • Zakariae Moutaouakil — former intern, co-supervised with Blaise Delattre.

Interested in joining?

I welcome enquiries about research internships and PhD opportunities in frugal deep learning. If you are interested in working together, please get in touch with your CV and a short description of your research interests.

Publications

* Equal contribution.

For older publications and my full research record, see Google Scholar .