How to transition from CodaLab to Codabench?

Adrien Pavao
3 min readJul 12, 2024

--

Codabench serves as a modern, faster, and more reliable upgrade to CodaLab, designed to supersede it. This quick guide is meant for CodaLab users wondering how to successfully adopt this new challenge platform.

What’s new in Codabench?

Codabench includes all features from CodaLab Competitions, and proposes a faster and more intuitive interface. It also has new features such as live logs during submission processes, storage quotas, and computation servers management for all users. It also emphases on benchmarking, allowing dataset submissions and multiple leaderboard rows per user. Finally, future project development and maintenance will be focused on Codabench.

Do I need to create a new account?

✔ Yes, even if you previously had a CodaLab account, you need to create a new account on Codabench. Sign up is quick and free. From there, as a competition participant, you are all set. The next questions concern competition organizers.

Can I upload my old competition bundles to Codabench?

✔ Yes! That is the good news: competition bundles are back-compatible. This means that you can upload your CodaLab competition bundles into Codabench without any modifications and have them working just fine.

Simply go to “Benchmarks > Management”, then click on “Upload” and select your competition bundle.

Go to “Benchmarks > Management”.
Click on “Upload” and select your competition bundle.

👍 That’s it! Your competition is ready to receive submissions.

How to move a competition from CodaLab to Codabench?

If you competitition is already live on CodaLab, that is fine too. You simply need to create a dump, download it and re-upload it on Codabench.

Go to “Dumps” organizer interface.
Click on “Create Dump” then “Download”. You’ll obtain a competition bundle that you’ll be able to re-upload on Codabench, following the instructions of the previous section.

💡 Note that leaderboard results won’t be transferred. For that you’ll need to re-submit the submissions.

How to create a competition from scratch on Codabench?

If you don’t have any previous competition, and want to learn how to create one from scratch, please refer to the Getting started guide.

Concluding remarks

Codabench, the new version of the competition and benchmark platform CodaLab, was launched on August 2023 and is already receiving a great attention. For users accustomed to CodaLab, the transition to Codabench is quick and easy. Indeed, competition bundles are back-compatible, and all that is required is to create an account on Codabench. To go further, you can refer to Codabench’s Wiki.

--

--

Adrien Pavao
Adrien Pavao

Written by Adrien Pavao

Research engineer and PhD student in Machine Learning @ Université Paris-Saclay

No responses yet