Role in this project:
Data Scientist Contributions:3 reviews, 13 commits, 2 PRs in 1 month
Contributions summary:Sharon focused on improving metrics and calibration within the `big-bench` project, a benchmark for language models. Their contributions primarily involved modifications to the `task_metrics.py` file, implementing and refining Brier score calculations for evaluating model performance. The user added tests, fixed bugs, and improved the documentation related to the scoring functions. They also ordered and normalized target scores to improve calibration metrics accuracy.