Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
Role in this project:
Data Scientist Contributions:27 commits, 6 PRs, 14 comments in 11 months
Contributions summary:Sayan primarily contributed to the `abstract_narrative_understanding` task, focusing on utility functions. Their work involved checking and asserting the consistency of proverb lists used in the task examples, ensuring that the lists are the same, and adding assertions for ASCII characters. They also added a print to note the specific task run for 99 distractors to avoid running it for the other cases.
language-model
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
Contributions:46 pushes in 3 years 9 months
templategithub-pages-templatemmistakesmistakesjekyll