Wei Tan
Data Scientist
Berkeley, California, United States
Summary
🤩
Rockstar🎓
Top SchoolWei Tan is a data scientist based in Berkeley with nine years of experience bridging backend engineering and analytics, currently applying data-driven methods at Evidation Health. With an MEng from UC Berkeley and a BEng in Chemical Engineering from the University of Michigan, he blends rigorous engineering instincts with applied machine learning and product-focused analytics. Wei is an active open-source contributor to high-profile projects like Apache DataFusion and Databend, where he improved SQL array functions and backend authentication and cluster management. Comfortable rewriting and refactoring core systems for performance and maintainability, he favors shipping practical code—"talk is cheap, show me the code"—and has a background that spans consulting, research, and industry engineering roles.
9 years of coding experience
1 year of employment as a software developer
Bachelor of Engineering (BEng), Chemical Engineering, Bachelor of Engineering (BEng), Chemical Engineering at University of MichiganMaster of Engineering - MEng, Industrial Engineering and Operations Research, Master of Engineering - MEng, Industrial Engineering and Operations Research at UC Berkeley College of Engineering
Chinese, English
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (17)
back-end-development10
databases10
authentication10
user-authentication10
arrow-keys10
fusion10
sql10
query-engine10
database-management10
rust10
backend10
arrows10
arrow-js10
database10
mysql9
Programming languages (8)
Github contributions (5)
databendlabs/databend
Oct 2021 - Jul 2022
Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:117 reviews, 208 commits, 62 PRs in 9 months
Contributions summary:Wei contributed to the backend logic of the Databend project, focusing on features related to authentication and database management. The commits show work on the MySQL and ClickHouse servers, including implementing socket address authentication and handling user authentication within the system. The user also added commands and configurations for managing clusters.
aipythonrustdatabaseserverless
apache/datafusion
Feb 2022 - Jan 2024
Apache DataFusion SQL Query Engine
Role in this project:Back-end Developer
Back-end DeveloperContributions:35 reviews, 12 PRs, 85 comments in 1 year 10 months
Contributions summary:Wei primarily contributed to implementing and improving array-related SQL functions within the Apache DataFusion query engine. Their work included rewriting existing functions like `array_append` and `array_prepend` to remove duplicate code and improve performance. They also implemented new functionalities such as `array_intersect`, `array_pop_front`, `array_pop_back`, and `range`, enhancing the engine's array processing capabilities. Furthermore, the user refactored code to remove duplicate logic and make it more maintainable.
sql-queryarrowbig-datadataframedatafusion
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.