Fully open reproduction of DeepSeek-R1
Role in this project:
ML Engineer Contributions:133 reviews, 130 PRs, 322 pushes in 6 months
Contributions summary:Lewis primarily focused on setting up and refining data loading and processing functionalities within the `open-r1` repository, likely for the DeepSeek-R1 model. They added core components like the `data.py` file, implemented dataset mixing logic, and integrated chat template application, which suggests work on data preparation for supervised fine-tuning (SFT) tasks. The contributions include refactoring the evaluation procedures and adding custom evaluation tasks using LightEval for model performance assessment. Furthermore, the commits also show updates to training scripts and configurations, indicating the user's involvement in the model's training and evaluation pipeline.
The Hugging Face course on Transformers
Role in this project:
Technical Writer & Localization Specialist Contributions:399 reviews, 266 commits, 413 PRs in 11 months
Contributions summary:Lewis primarily contributed to the course by translating and adapting content for different languages. Their commits include fixing formatting errors, correcting translation issues, and completing the translation of chapters. Furthermore, the user's work involved adding missing sections and adapting the course structure for multilingual support, demonstrating a focus on expanding the course's accessibility. They also focused on content organization and adapting the course structure for multilingual support.
huggingfacedeep-learningnlptransformers