Empower Sequence Labeling with Task-Aware Language Model
Role in this project:
ML Engineer Contributions:2 releases, 88 commits, 31 PRs in 4 years 10 months
Contributions summary:Liyuan primarily contributed to improving and debugging the sequence labeling model. They fixed bugs in the evaluator, addressed issues related to embedding loading and shrinking the embedding dictionary, and debugged the model. They also added a predict function and support for multi-document input, enhancing the model's usability.
language-modelsequence-labelingnercrfpytorch
On the Variance of the Adaptive Learning Rate and Beyond
Role in this project:
ML Engineer Contributions:57 commits, 20 PRs, 46 pushes in 2 years
Contributions summary:Liyuan contributed to the development of a machine learning library, RAdam, and its related functionalities. Their work involved modifying the core optimization algorithm, including bug fixes, performance improvements, and the addition of new features such as the RAdam_4step variant. The user also made changes to training scripts, potentially for testing or integrating RAdam into existing projects, demonstrating practical application. Furthermore, they made adjustments to the documentation and setup files.
learning-rateoptimizeradamadam-optimizerwarmup