Somjit Nath

Machine Learning Researcher, RBC Borealis · PhD Candidate, McGill University and Mila · Montréal, Canada

I am a Machine Learning Researcher at RBC Borealis in Montréal, where I work on applying machine learning techniques for commercial credit.

I am also a PhD candidate at McGill University and Mila, advised by Derek Nowrouzezahrai and Samira Ebrahimi Kahou. My PhD research focuses on reinforcement learning, representation learning, and world models: how agents can learn structured, predictive representations of their environment to enable efficient learning, long horizon reasoning, and generalization. Recently, this has led me to study what video diffusion models implicitly learn about physics.

Before joining RBC Borealis full time, I was a Research Intern at Microsoft Research Cambridge, working on sample efficient imitation learning from video in games, and a Scientist in Residence at 4Division and Mila, working on scalable Robotics Transformer models. Earlier, I was a Machine Learning Research Intern at RBC Borealis and a Researcher at TCS Research, working on reinforcement learning for continuous time event data and supply chain optimization.

Somjit Nath profile photo

Latest News

  • Joined RBC Borealis as a Machine Learning Researcher in Montréal (September 2026).
  • Our paper The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show was accepted as a Spotlight at NeurIPS 2026 (arXiv).
  • Our paper When Does Predictive Inverse Dynamics Outperform Behavior Cloning? was accepted at ICML 2026.
  • Our paper Augmentations for Robust and Efficient Imitation Learning in Streamed Video Games was accepted as an Oral at IEEE CoG 2026.
  • Our paper Structured Representation Learning with Locally Linear Embeddings and Adaptive Feature Fusion was accepted at TMLR 2026.
  • Completed a Research Internship at Microsoft Research Cambridge on sample efficient imitation learning.
  • Received Outstanding Reviewer Awards at ICML 2025 and ICCV 2023.

Research Interests

At RBC Borealis, I work on applying machine learning techniques for commercial credit.

Beyond RBC, my research focuses on reinforcement learning, representation learning, and world models. I am particularly interested in how agents can learn predictive and structured representations that support efficient learning, exploration, planning, and generalization, and in connecting reinforcement learning with video diffusion models, self supervised learning, and imitation learning.

Reinforcement Learning Representation Learning World Models Video Diffusion Models Imitation Learning Commercial Credit

Experience

Machine Learning Researcher
Sep 2026 – present
RBC Borealis, Montréal, Canada
Applying machine learning techniques for commercial credit.
Research Intern
May 2025 – Aug 2025
Microsoft Research Cambridge, United Kingdom
Worked on improving representation learning approaches for sample efficient imitation learning in video game environments.
Scientist in Residence
Jun 2024 – Sep 2024
4Division and Mila, Montréal, Canada
Worked on scalable Robotics Transformer models trained on diverse robotic data for strong real world generalization.
Machine Learning Research Intern
May 2023 – Aug 2023
RBC Borealis, Montréal, Canada
Developed an unsupervised outlier detection framework in continuous time event sequences using reinforcement learning.
Researcher, Data and Decision Sciences
Nov 2019 – Jan 2022
Tata Consultancy Services Research and Innovation, Mumbai, India
Applied reinforcement learning to multi product, multi node inventory management, improving performance over existing industry approaches, and developed RL methods for delayed actions and observations.
Research Intern
May 2015 – Jul 2015
Indian Statistical Institute, Kolkata, India
Worked on OCR and character segmentation methods for Bengali and English text.

Selected Publications

* denotes equal contribution

The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show
Parsa Esmati*, Somjit Nath*, Katja Hofmann, Derek Nowrouzezahrai, Samira Ebrahimi Kahou, Majid Mirmehdi · NeurIPS 2026 (Spotlight)
Augmentations for Robust and Efficient Imitation Learning in Streamed Video Games
Somjit Nath, Abdelhak Lemkhenter, Pallavi Choudhury, Chris Lovett, Katja Hofmann, Sergio Valcarcel Macua, Lukas Schäfer · IEEE CoG 2026 (Oral)
Structured Representation Learning with Locally Linear Embeddings and Adaptive Feature Fusion
Somjit Nath, Jackson J. Cone, Derek Nowrouzezahrai, Samira Ebrahimi Kahou · TMLR 2026
Behaviour Discovery and Attribution for Explainable Reinforcement Learning
Rishav Rishav, Somjit Nath, Vincent Michalski, Samira Ebrahimi Kahou · TMLR 2025
Unsupervised Event Outlier Detection in Continuous Time
Somjit Nath, Kry Yik-Chau Lui, Siqi Liu · NeurIPS Workshop 2024
Task Oriented Slot Based Cumulant Discovery in General Value Functions
Vincent Michalski, Somjit Nath, Derek Nowrouzezahrai, Doina Precup, Samira Ebrahimi Kahou · RLC Workshop 2024 (Spotlight)
Spectral Temporal Contrastive Learning
Sacha Morin*, Somjit Nath*, Samira Ebrahimi Kahou, Guy Wolf · NeurIPS Workshop 2023
Prioritizing Samples in Reinforcement Learning with Reducible Loss
Shivakanth Sujit, Somjit Nath, Pedro H. M. Braga, Samira Ebrahimi Kahou · NeurIPS 2023
Discovering Object-Centric Generalized Value Functions From Pixels
Somjit Nath, Gopeshh Raaj Subbaraj, Khimya Khetarpal, Samira Ebrahimi Kahou · ICML 2023
Follow your Nose: Using General Value Functions for Directed Exploration in Reinforcement Learning
Durgesh Kalwar, Omkar Shelke, Somjit Nath, Hardik Meisheri, Harshad Khadilkar · AAMAS 2023
Revisiting State Augmentation Methods for Reinforcement Learning with Stochastic Delays
Somjit Nath, Mayank Baranwal, Harshad Khadilkar · CIKM 2021
SIBRE: Self Improvement Based Rewards for Adaptive Feedback in Reinforcement Learning
Somjit Nath, Richa Verma, Abhik Ray, Harshad Khadilkar · AAMAS 2021
Training Recurrent Neural Networks Online by Learning Explicit State Variables
Somjit Nath, Vincent Liu, Alan Chan, Xin Li, Adam White, Martha White · ICLR 2020

Awards and Service

  • Outstanding Reviewer, ICML 2025
  • Outstanding Reviewer, ICCV 2023
  • McGill Engineering Doctoral Award
  • TCS Citation Award, 2021 and 2022
  • Scholarship for Academic Excellence, State Electrical Engineers’ Association

Education

  • McGill University and Mila
    PhD Candidate in Electrical and Computer Engineering, 2022 – present
  • University of Alberta
    MSc in Computing Science, 2017 – 2019
  • Jadavpur University
    BE in Electrical Engineering, 2013 – 2017