| 
          
            | 
                Saeid Asgari
                I am a Principal Applied Science Manager at Microsoft US (previously Principal Researcher) and an Adjunct CS Research Professor at Simon Fraser University. Our team at Microsoft pushes the boundries of LLM evaluations at scale. Previously, I worked on reliable AI at Autodesk Research and explored ML/CV problems in startups.
               I completed my PhD in Computing Science at SFU under the supervision of Prof. Ghassan Hamarneh. During my PhD I had multiple research visits/internships at different research institutions such as MILA (Montreal, Canada) and Siemens Healtheneers (Princeton, US).
                Outside of work, I have a strong passion for soccer and running track - the 100m sprint. I've had the privilege of competing and earning a few medals in inter-university competitions in these areas.
               
                 
                   
                 
                   
                 
                   
                 
                
               |   |  
  
    
      | Core Focus Areas 
          I lead research and development initiatives in reliability and evaluation of generative models like LLMs and VLMs. I am broadly intrested in:
         
          Reliability and Robustness: Designing experiments and datasets to analyze generalization, memorization, and robustness in generative models, ensuring they perform reliably across diverse scenarios.Interpretability and Explainability: Building tools to understand ML model behavior, improve transparency, and ensure models meet safety and ethical standards.Data Bias and Mitigation: Developing scalable tools to identify hidden and known biases in datasets, while enhancing datasets and designing models to better handle biases, out-of-domain samples, and improve generalization. |  
          
            |   | Explain-Query-Test: Self-Evaluating LLMs Via Explanation and Comprehension Discrepancy 
 Saeid Asgari, Joao Monteiro
 ICLR 2025, Scaling Self-Improving Foundation Models without Human Supervision
 Paper 
                Code
 |  
          
            |   | MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs 
 Saeid Asgari, Aliasgahr Khani, and Amir Khasahmadi
 NeurIPS 2024, Safe Generative AI
 Paper 
                Code
 
 |  
          
            |   | How to Determine the Preferred Image Distribution of a Black-Box Vision-Language Model? 
 Saeid Asgari, Joseph Lambourne, Alana Mongkhounsavath
 NeurIPS 2024, Safe Generative AI,
 Paper 
                Code
 
 |  
          
            |   | The Problem of Generative Parroting: Navigating Toward Responsible AI [Part 1 ,  Part 2 ,  Part 3] 
 Saeid Asgari ,
 Autodesk Research Blog, 2024
 
 |  
          
            |   | Detecting Generative Parroting through Overfitting Masked Autoencoders 
 Saeid Asgari  and Joseph Lambourne
 CVPR 2024, Responsible Generative AI
 Paper
 
 |  
          
            |   | Learned Visual Features to Textual Explanations 
 Saeid Asgari  et al.,
 ICLR 2024, Reliable and Responsible Foundation Models
 Paper
 
 |  
          
            | Selected Conference Publications |  
          
            |   | SMITE: Segment Me In Time Optimzing textual embedings for robust single-shot video segmenation.
 
 Amir Alimohammadi, Sauradip Nag, Saeid Asgari, Andrea Tagliasacchi, Ghassan Hamarneh, Ali Mahdavi-Amiri
 ICLR 2025
 Project page
 
 |  
          
            |   | SLiMe: Segment Like Me Optimzing textual embedings for robust single-shot image segmenation
 
 Aliasghar Khani, Saeid Asgari, Aditya Sanghi, Ali Mahdavi-Amiri, Ghassan Hamarneh
 ICLR 2024
 Paper 
                Code
 
 |  
          
            |   | MaskTune: Mitigating Spurious Correlations by Forcing to Explore 
 Saeid Asgari*, 
              Aliasghar Khani*, 
              Fereshte Khani*, 
              Ali Gholami*, 
              Linh Tran, 
              Ali Mahdavi-Amiri, 
              Ghassan Hamarneh,
 NeurIPS 2022
 Paper 
                Code
 |  
          
            |   | Robust Representation Learning via Perceptual Similarity Metrics 
 Saeid Asgari*, 
              Kristy Choi*, 
              Amir Khasahmadi, 
             Anirudh Goyal,
 ICML 2021 (Spotlight presentation)
 Paper
 |  
          
            |   | RobustPointSet: A Dataset for Benchmarking Robustness of Point Cloud Classifiers 
 Saeid Asgari*, 
              Jieliang Luo*, 
              Ran Zhang, 
              Ye Wang, 
              Pradeep Kumar Jayaraman, 
              Krishna Murthy Jatavallabhula,
 ICLR 2021, RobustML
 Paper
 |  
          
            |   | PointMask: Towards Interpretable and Bias-Resilient Point Cloud Processing 
 Saeid Asgari , 
              Kaveh Hassani, 
              Pradeep Kumar Jayaraman, 
              Amir Khasahmadi,
 ICML 2020, Human Interpretability in Machine Learning (Talk)
 Paper
 |  
          
            |   | A Kernelized Manifold Mapping to Diminish the Effect of Adversarial Perturbations 
 Saeid Asgari , 
              Kumar Abhishek, 
              Shekoofeh Azizi, 
              Ghassan Hamarneh,
 CVPR 2019
 Paper
 |  
          
            |   | InfoMask: Masked Variational Latent Representation to Localize Chest Disease 
 Saeid Asgari , 
              Mohammad Havaei, 
              Tess Berthier, 
              Francis Dutil, 
              Ghassan Hamarneh, 
              Yoshua Bengio,
 MICCAI 2019 (Early accept)
 Paper
 |  
          
            |   | Improved Inference via Deep Input Transfer 
 Saeid Asgari , 
               Kumar Abhishek, 
               Ghassan Hamarneh,
 MICCAI 2019 (Early accept)
 Paper
 |  
          
            |   | Select, Attend, and Transfer: Light, Learnable Skip Connections 
 Saeid Asgari , 
              Aicha Bentaieb, 
              Anmol Sharma, 
              S. Kevin Zhou, 
              Yefeng Zheng, 
              Bogdan Georgescu, 
              Puneet Sharma, 
              Dorin Comaniciu, 
              Ghassan Hamarneh,
 MICCAI 2019, MLMI (Talk)
 Paper
 |  
          
            |   | Vulnerability Analysis of Chest X-Ray Image Classification Against Adversarial Attacks 
 Saeid Asgari , 
              Arkadeep Das, 
             Ghassan Hamarneh,
 MICCAI 2018, Understanding and Interpreting Machine Learning in Medical Image Computing Applications (Talk )
 Paper
 |  
          
            | Seleted Journal Publications |  
          
            |   | Deep Semantic Segmentation of Natural and Medical Images: A Review 
 Saeid Asgari*, 
              Kumar Abhishek*, 
              Joseph Paul Cohen, 
              Julien Cohen-Adad, 
              Ghassan Hamarneh,
 Artificial Intelligence Review, 2020 (IF=12)
 Paper
 |  
          
            |   | Combo Loss: Handling Input and Output Imbalance in Multi-Organ Segmentation 
 Saeid Asgari , 
              Yefeng Zheng, 
              S. Kevin Zhou, 
              Bogdan Georgescu, 
              Puneet Sharma, 
              Daguang Xu, 
              Dorin Comaniciu, 
              Ghassan Hamarneh,
 Computerized Medical Imaging and Graphics, 2019 (IF= 7.42)
 Paper
 |  
          
            |   | Segmentation-Free Direct Tumor Volume and Metabolic Activity Estimation from PET Scans 
 Saeid Asgari , 
              Nouirin Duggan, 
              Hilgan Ma, 
              Anna Celler, 
              Francois Benard, 
             Ghassan Hamarneh,
 Computerized Medical Imaging and Graphics, 2018 (IF=7.42)
 Paper
 |  
          
            |   | Pareto-Optimal Multi-Objective Dimensionality Reduction Deep Auto-Encoder for Mammography Classification 
 Saeid Asgari , 
              Jeremy Kawahara, 
              Ghassan Hamarneh,
 Computer Methods and Programs in Biomedicine, 2017 (IF=7.10)
 Paper
 |  
          
            |   | Counterbalancing Teacher: Regularizing Batch Normalized Models for Robustness 
 Saeid Asgari , 
               Ali Gholami, 
               Fereshte Khani, 
              Kristy Choi, 
              Linh Tran, 
              Ran Zhang, 
              Aliasghar Khani,
 arXiv, 2022
 Paper
 |  
          
            |   | Jigsaw-VAE: Towards Balancing Features in Variational Autoencoders 
 Saeid Asgari , 
              Mohammad Havaei, 
              Alex Lamb, 
             Aditya Sanghi, 
              Ara Danielyan, 
              Tonya Custis,
 arXiv, 2020
 Paper
 |  
          
            |   | Signed Input Regularization 
 Saeid Asgari , 
              Kumar Abhishek, 
              Ghassan Hamarneh,
 arXiv, 2019
 Paper
 |  |