Each participant can submit at utmost three runs. For each run, a short description of the system and the list of data and resources used must be submitted by filling out the form at (You have to log in with a Gmail account):
The form requires to provide the following information:
- Name of the team
- Name of the run
- Zipped file containing at least two files (description.txt, binary.jsonl or/and ranking.jsonl or/and binary_eng.jsonl or/and ranking_eng.jsonl).
The binary.jsonl is a JSON Lines text file containing for each row a Json line with the example ID and the predicted label.
The binary_eng.jsonl is a JSON Lines text file containing for each row a JSON with the example ID and the predicted label.
The ranking.jsonl is a JSON Lines text file containing for each row a JSON with the example ID and the predicted score.
The ranking_eng.jsonl is a JSON Lines text file containing for each row a JSON with the example ID and the predicted score.
The description.txt file contains information about the submission, such as the model used, the parameters, and other relevant stuff. Please, be sure to properly include in the description all the information necessary to track the submitted system.
An example of submission is available at:
Please, contact us if you experience any issues with the submission at wicita.evalita@gmail.com.