Software Development Engineer II at Amazon Web Services (AWS)
Seattle, Washington, United States
Join Prog.AI to see contacts
Join Prog.AI to see contacts
Summary
🤩
Rockstar
🎓
Top School
Shiv Bhosale is a Software Development Engineer II with nine years of experience building high-performance, cloud-native and ML infrastructure, currently working on EKS-optimized AMIs and scaling Kubernetes clusters for large-scale AI at AWS. He previously led Alchemist, an experimentation platform at Glance that delivered experiments to 50M+ users in under five minutes and engineered ML services in Go, Rust and C++ achieving millions of predictions per second with dramatic cost reductions. His background blends rigorous CS training from Georgia Tech (MS, 3.9 GPA) with hands-on research in VR-based cognitive assessment, reflecting a penchant for both systems engineering and human-centered experimentation. Shiv is an active contributor to awslabs/amazon-eks-ami and brings deep kernel, GPU and low-latency systems debugging experience often required for productionizing AI at extreme scale. Colleagues describe him as an engineer who pairs pragmatic optimization (1ms p99 services, <50ms p99 search) with a curiosity that surfaces in unusual side projects—like streaming anime during VR research sessions. Based in Seattle, he excels at turning obscure infrastructure problems into reliable, cost-effective production systems.
10 years of coding experience
5 years of employment as a software developer
Master's degree, Computer Science, 3.9/4, Master's degree, Computer Science, 3.9/4 at Georgia Institute of Technology
Bachelor of Technology - BTech, Computer Engineering, CGPA 8.31/10 (First Class with Distinction), Bachelor of Technology - BTech, Computer Engineering, CGPA 8.31/10 (First Class with Distinction) at Vishwakarma Institute Of Technology
Profiler for ML Training jobs in pure Rust. See straggler ranks and idle GPUs.
Contributions:19 reviews, 25 PRs, 91 pushes in 8 months
machine-learningrustk8skubernetescluster
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.