Jean Kaddour

PhD Student in Machine Learning @UCL

Hello, thanks for stepping by, it’s great to have you here! :)

I am a PhD student in the Foundational AI CDT at University College London, working with Ricardo Silva and Matt Kusner. Previously, I obtained a MSc. in Advanced Computing at Imperial College London and interned at Reka AI.

If you are interested in my work or would like to chat about common interests, potential collaboration, etc., please feel free to get in touch!

Publications

  1. No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
    Kaddour, Jean, Key, Oscar, Nawrot, Piotr, Minervini, Pasquale, and Kusner, Matt J.
    In Advances in Neural Information Processing Systems 2023
  2. Evaluating Self-Supervised Learning for Molecular Graph Embeddings
    Wang, Hanchen, Kaddour, Jean, Liu, Shengchao, Tang, Jian, Lasenby, Joan, and Liu, Qi
    In Advances in Neural Information Processing Systems 2023
  3. Challenges and Applications of Large Language Models
    Kaddour, Jean, Harris, Joshua, Mozes, Maximilian, Bradley, Herbie, Raileanu, Roberta, and McHardy, Robert
    2023
  4. Spawrious: A benchmark for fine control of spurious correlation biases
    Lynch, Aengus, Dovonon, Gbètondji JS, Kaddour, Jean, and Silva, Ricardo
    arXiv preprint arXiv:2303.05470 2023
  5. The MiniPile Challenge for Data-Efficient Language Models
    Kaddour, Jean
    2023
  6. Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging
    Kaddour, Jean
    In Has it Trained Yet? NeurIPS 2022 Workshop 2022
  7. Causal Machine Learning: A Survey and Open Problems
    Kaddour, Jean, Lynch, Aengus, Liu, Qi, Kusner, Matt J., and Silva, Ricardo
    2022
  8. When Do Flat Minima Optimizers Work?
    Kaddour, Jean, Liu, Linqing, Silva, Ricardo, and Kusner, Matt
    In Advances in Neural Information Processing Systems 2022
  9. DAG Learning on the Permutahedron
    Zantedeschi, Valentina, Franceschi, Luca, Kaddour, Jean, Kusner, Matt, and Niculae, Vlad
    In The Eleventh International Conference on Learning Representations 2023
  10. Causal Effect Inference for Structured Treatments
    Kaddour, Jean, Zhu, Yuchen, Liu, Qi, Kusner, Matt J., and Silva, Ricardo
    In NeurIPS 2021
  11. Probabilistic Active Meta-Learning
    Kaddour, Jean, Sæmundsson, Steindór, and Deisenroth, Marc
    In NeurIPS 2020