Chongming Ni
Machine Learning Engineer at Amazon Web Services (AWS)
United States
Summary
🤩
Rockstar🎓
Top SchoolChongming Ni is a machine learning engineer at Amazon Web Services with a year of industry experience and a strong background in cloud systems and computational biology. At AWS he has worked on Hyperplane and now focuses on inference optimization for Trainium, blending low-level systems thinking with ML deployment needs. Previously he engineered cloud dataplane features at Cisco, giving him practical expertise in high-throughput, production networking and distributed systems. Trained at Carnegie Mellon (M.S. Computational Biology) and Tsinghua (dual B.S. in Economics and Biochemistry), he brings a rare cross-disciplinary perspective that informs pragmatic model-serving solutions. Colleagues describe him as an engineer who translates research-grade ideas into efficient, scalable inference pipelines.
2 years of coding experience
3 years of employment as a software developer
B.S., Economics, B.S., Economics at Tsinghua UniversityM.S., Computational Biology, M.S., Computational Biology at Carnegie Mellon University
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (14)
llm10
cuda10
llama10
pytorch10
transformer10
aws-services10
gpt10
inference10
openai10
tpu10
amd10
aws8
machine-learning6
tensorflow6
Programming languages (1)
Github contributions (5)
chongmni-aws/vllm
Sep 2024 - Oct 2024
Contributions:7 pushes, 1 branch in 10 days
aws-neuron/upstreaming-to-vllm
Nov 2024 - Mar 2025
A high-throughput and memory-efficient inference and serving engine for LLMs
Contributions:1 review, 1 push, 1 branch in 3 months
inference
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.