We welcome all item-level data contributions

Sharing your evaluation data takes just a few steps. We are actively developing a converter agent to further streamline the process, so stay tuned!

1

Format your data

Convert your evaluation data into the OpenEval schema. You may refer to the schema, guidelines, and example converters in our GitHub repository.

2

Validate your submission

Run the provided validator to confirm all required fields are present and correctly formatted before submission.

3

Open a pull request

Open a pull request in our Hugging Face repository. under submissions/ with your JSON files.

4

See your data go live

After a brief review, your data are shown in OpenEval and made immediately available to the broader research community.

5

We are here to help

Still have questions? Reach out to the team — we are happy to assist you through the contribution process.

Data contributors

OpenEval grows through community data contributions. Thank you to everyone who has shared data with us!

    Team members

    Meet the team building and maintaining OpenEval.

      Acknowledgements

      We are also grateful to everyone who has supported OpenEval through feedback and suggestions.