Shuhaib Mehri

prof_pic.jpg

Hi 👋! I am a PhD Student at the University of Illinois Urbana-Champaign, advised by Prof. Dilek Hakkani-Tur. I try to build AI that is useful to people in the real world, and my current research focuses on user simulation, which I believe to be an important part of the puzzle. Some recent highlights:

  • Identified user representations as a bottleneck in user simulation, and trained UserRepGen-4B to generate representations that lead to more faithful simulation [paper].
  • Measured the distributional gap between real and simulated user behaviors [tweet] [paper].
  • Built MultiSessionCollab, a benchmark for multi-session human–AI collaboration, and leveraged user simulators to train collaborative agents that use memory more effectively [tweet] [paper].
  • Showed that user simulators in interactive benchmarks (e.g., τ-Bench) do not actually follow their assigned goals. Introduced user goal state tracking and trained goal-aligned user simulators [tweet] [paper].

I interned at Microsoft Research, where I had the wonderful opportunity to work with Michel Galley from the Deep Learning Group and Philippe Laban from the AI Interaction and Learning Group. Before that, I also interned at IBM Research, and Amazon (x3).

news

Jul 04, 2026 ✈️ Taking a break from my internship at Microsoft Research to give an oral at ACL 2026 on Goal Alignment in LLM-Based User Simulators for Conversational AI
Mar 24, 2026 Very excited to virtually attend EACL 2026! I will be giving an oral presentation on our work on reference-level feedback. I’ll also serve as a session chair for Tuning & LLM Behaviour!
Feb 13, 2026 Excited to give a talk at Google Research on user-centered conversational agents! I will cover (1) LLMs that reliably simulate users during multi-turn conversations, and (2) agents that continuously learn user preferences & improve collaboration across multiple sessions.
Dec 11, 2025 Came full circle with a visit to the UBC NLP Group (where my research journey began!) and gave a talk on goal alignment for LLM-based user simulators.
Jan 08, 2024 I was awarded the Mitacs Accelerate Fellowship for Master’s and PhD Students as an undergrad. Really excited to start working with iClinic Systems Inc.!

selected publications

  1. Preprint
    Learning User Representations to Improve Simulation Fidelity
    Shuhaib Mehri, Philippe Laban, Michel Galley, Dilek Hakkani-Tür, Jennifer Neville, and Jianfeng Gao
    Preprint, 2026
  2. NeurIPS
    Measuring and Mitigating the Distributional Gap Between Real and Simulated User Behaviors
    Shuhaib Mehri, Philippe Laban, Sumuk Shashidhar, Marwa Abdulhai, Sergey Levine, Michel Galley, and Dilek Hakkani-Tür
    NeurIPS, 2026
  3. EMNLP
    MultiSessionCollab: Learning User Preferences with Memory to Improve Long-Term Collaboration
    Shuhaib Mehri, Priyanka Kargupta, Tal August, and Dilek Hakkani-Tür
    EMNLP, 2026
  4. TACL oral
    Goal Alignment in LLM-Based User Simulators for Conversational AI
    Shuhaib Mehri, Xiaocheng Yang, Takyoung Kim, Gokhan Tur, Shikib Mehri, and Dilek Hakkani-Tür
    TACL, 2026
  5. EACL oral
    Beyond Sample-Level Feedback: Using Reference-Level Feedback to Guide Data Synthesis
    Shuhaib Mehri, Xiusi Chen, Heng Ji, and Dilek Hakkani-Tür
    EACL, 2026