• Fast as CHITA: Neural Network Pruning with Combinatorial Optimization. Paper. Blog.
        Riade Benbaki, Wenyu Chen, Xiang Meng, Hussein Hazimeh, Natalia Ponomareva, Zhe Zhao, Rahul Mazumder. ICML (2023).
neural_network_pruning
Pruning as a best subset selection problem.
  • How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy. Paper. Blog.
        Natalia Ponomareva, Hussein Hazimeh, Alex Kurakin, Zheng Xu, Carson Denison, H. Brendan McMahan, Sergei Vassilvitskii, Steve Chien, Abhradeep Thakurta. JAIR (2023).
differential_privacy
DP-SGD for training differentially private neural nets.

Selected Publications

** The list below does not include all publications and may be outdated. Please see my Google scholar page for a full list including recent work.**

Benchmarking Robustness to Adversarial Image Obfuscations. Link.
    Florian Stimberg, Ayan Chakrabarti, Chun-Ta Lu, Hussein Hazimeh, Otilia Stretcu, Wei Qiao, Yintao Liu, Merve Kaya, Cyrus Rashtchian, Ariel Fuxman, Mehmet Tek, Sven Gowal. NeurIPS (2023).

L0learn: A scalable package for sparse learning using l0 regularization. Link.
    Hussein Hazimeh, Rahul Mazumder, and Tim Nonet. JMLR (2023).

Grouped Variable Selection with Discrete Optimization: Computational and Statistical Perspectives. Link.
    Hussein Hazimeh, Rahul Mazumder, and Peter Radchenko. Annals of Statistics (2023).

Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimization. Link. Code.
    Hussein Hazimeh, Rahul Mazumder, and Ali Saab. Mathematical Programming (2022).
    Best Student Paper Award, MIT ORC.
    Honorable Mention, INFORMS Computing Society.

Flexible Modeling and Multitask Learning using Differentiable Tree Ensembles. Link.
    Shibal Ibrahim, Hussein Hazimeh, and Rahul Mazumder. SIGKDD (2022).
    Best Student Paper Award, SIGKDD (2022).

Dselect-k: Differentiable selection in the mixture of experts with applications to multi-task learning. Link.
    Hussein Hazimeh, Zhe Zhao, Aakanksha Chowdhery, Maheswaran Sathiamoorthy, Yihua Chen, Rahul Mazumder
    Lichan Hong, and Ed Chi. NeurIPS (2021).

Learning Sparse Classifiers: Continuous and Mixed Integer Optimization Perspectives. Link. Code.
    Antoine Dedieu, Hussein Hazimeh, and Rahul Mazumder. JMLR (2021).

Fast Best Subset Selection: Coordinate Descent and Local Combinatorial Optimization Algorithms. Link. Code.
    Hussein Hazimeh and Rahul Mazumder. Operations Research (2020).
    Young Researchers Prize (for an Outstanding Paper in Optimization), INFORMS Optimization Society.

The Tree Ensemble Layer: Differentiability meets Conditional Computation. Link. Code.
    Hussein Hazimeh, Natalia Ponomareva, Petros Mol, Zhenyu Tan, and Rahul Mazumder. ICML (2020).

Learning Hierarchical Interactions at Scale: A Convex Optimization Approach. Link. Code.
    Hussein Hazimeh and Rahul Mazumder. AISTATS (2020).

Axiomatic Analysis of Smoothing Methods in Language Models for Pseudo-Relevance Feedback. Link.
    Hussein Hazimeh and ChengXiang Zhai. SIGIR ICTIR (2015).