I am a Senior Machine Learning Research Engineer at Red Hat Inc., working in the Machine Learning Research team of Red Hat AI on quantization and sparsity of Large Language Models. My goal is to make LLM inference cheap, energy-efficient and production-ready at Red Hat.
Prior to joining Red Hat, I was a Postdoctoral Researcher in the AI/ML team of Argonne Leadership Computing Facility at Argonne National Laboratory (US Department of Energy, Office of Science). I worked on optimizing Large Language Model training, finetuning and inference on GPUs and AI accelerators, AI for science applications and HPC for AI.
I finished my PhD in Computer Engineering at Iowa State University under the guidance of Professor Arun Somani. My dissertation focused on developing pruning, quantization and neural architecture search algorithms for optimizing neural network inference on hardware accelerators, CPUs and GPUs.
Iowa State University, Ames, IA, USA
Computer Engineering
Dissertation: Hardware-aware Design, Search and Optimization of Deep Neural Networks
Supervisor: Dr. Arun K. Somani
2017 – 2023University College of Engineering, Osmania University, Hyderabad, India
Electronics and Communication Engineering
2013 – 2017