Krishna Teja Chitty-Venkata

Senior Machine Learning Research Engineer

Red Hat Inc.

About Me

I am a Senior Machine Learning Research Engineer at Red Hat Inc., working in the Machine Learning Research team of Red Hat AI on quantization and sparsity of Large Language Models. My goal is to make LLM inference cheap, energy-efficient and production-ready at Red Hat.

Prior to joining Red Hat, I was a Postdoctoral Researcher in the AI/ML team of Argonne Leadership Computing Facility at Argonne National Laboratory (US Department of Energy, Office of Science). I worked on optimizing Large Language Model training, finetuning and inference on GPUs and AI accelerators, AI for science applications and HPC for AI.

I finished my PhD in Computer Engineering at Iowa State University under the guidance of Professor Arun Somani. My dissertation focused on developing pruning, quantization and neural architecture search algorithms for optimizing neural network inference on hardware accelerators, CPUs and GPUs.

Research Interests

LLM & VLM Optimization
Pruning & Quantization
Efficient Finetuning & Inference
Large Scale LLM Training
KV Cache Optimization
LLM Evaluation
AI Agents
Efficient Neural Networks on AI Accelerators
Hardware-aware Neural Architecture Search
Performance Modeling & Benchmarking
AI for Science & HPC for AI

Education

Doctor of Philosophy (PhD)

Iowa State University, Ames, IA, USA

Computer Engineering

Dissertation: Hardware-aware Design, Search and Optimization of Deep Neural Networks

Supervisor: Dr. Arun K. Somani

2017 – 2023

Bachelor of Engineering

University College of Engineering, Osmania University, Hyderabad, India

Electronics and Communication Engineering

2013 – 2017