Yanchao Lu is a senior compute architecture leader at NVIDIA, specializing in TensorRT core libraries, LLM inference infrastructure, and backend performance optimization. With a PhD in Computer Science from Shanghai Jiao Tong University and a dual technical and business undergraduate background, he blends deep research rigor with product-minded system design. He progressed through roles from Compute Architect to Senior Compute Arch Manager, driving TensorRT release engineering and inference performance across multiple generations. Early experience as a startup co-founder and research stints at Microsoft Research Asia and Nanyang Technological University give him a rare mix of entrepreneurial initiative and academic depth. Based in Pudong, Shanghai, he focuses on turning cutting-edge model capabilities into production-grade, high-performance inference systems.
2 years of coding experience
4 years of employment as a software developer
Bachelor of Engineering - BE Computer Science and Technology, Bachelor of Engineering - BE Computer Science and Technology at Beijing Institute of Technology
Doctor of Philosophy - PhD Computer Science and Technology, Doctor of Philosophy - PhD Computer Science and Technology at Shanghai Jiao Tong University
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
Contributions:1 PR, 134 pushes, 79 branches in 1 year 4 months
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Contributions:3 releases, 524 reviews, 208 PRs in 2 years 4 months
cppinferencelarge-language-modelsllmnvidia
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.