Skip to content

GSOC 2021 PROJECT

Static code upload challenge evaluation and enhancements in GitHub based challenge creation

EvalAI is a platform to host and participate in AI challenges around the globe. To a challenge host, reproducibility of submission results and...

Contributor
Savish Bedi
Mentors
Khalid Riyaz, Ram Ramrakhya, Kartik Verma, rishabhjain
Organization
CloudCVWeb
Program
GSoC 2021Completed

About this project

Description from the program archive

<p>EvalAI is a platform to host and participate in AI challenges around the globe. To a challenge host, reproducibility of submission results and privacy of the test data are the main concerns. Towards this, the idea is to allow users to submit a docker image for their models and evaluate them on static datasets.</p> <p>Moreover, Github-based challenge creation allows challenge hosts to use a private GitHub repository to create and manage updates in a challenge. The idea is to support bi-directional updates for challenges created using Github. This feature will allow hosts to sync changes from EvalAI UI to their challenge Github repository.</p>

Tags

From the people who did it

No proposal or progress posts shared yet

Worked on this project? Share the proposal that got you selected and the posts you wrote.

Claim this project
  1. Improvements in EvalAI frontend

    Gautam JajooMentored by Ram Ramrakhya, Kajol Kumari, rishabhjain

  2. Monitoring setup for EvalAI

    Aviral JainMentored by Ram Ramrakhya, rishabhjain

Data: Google Summer of Code public archive. This project in the official archive