May 3How to Create your First Benchmark on CodabenchIt’s free and easy — The progress in the field of machine learning mostly relies on benchmarks, which are fair comparisons between multiple models on the same problem. Platforms such as Kaggle, CodaLab Competitions or EvalAI let the community crowd-source the resolution of scientific and industrial tasks through public benchmarks, in the form of challenges…Tutorial5 min readTutorial5 min read
Published inTowards Data Science·Apr 27Beyond Accuracy: Exploring Exotic Metrics for Holistic Evaluation of Machine Learning ModelsMachine learning has undoubtedly become a powerful tool in today’s data-driven world, but are we truly tapping into its full potential? Traditional evaluation metrics like accuracy, precision, and recall have long held the spotlight, but there’s so much more to consider when measuring a model’s real-world impact. In this article…Machine Learning12 min readMachine Learning12 min read
Mar 28Chess-Based Roguelike: the Joy of Game DesignRecently, I have developed a rogue-like game with chess mechanics. In this game, you explore randomly generated dungeons, fight enemies with moves from the game of chess, and discover hundreds of items, spells and units. …Game Design7 min readGame Design7 min read
Mar 28Learning to Run a Power Network with Renewable Energies: a Challenge Design and AnalysisAs the climate is rapidly changing, it is crucial that we change the way we produce and consume energy to reduce the amount of carbon and other greenhouse gases being produced. In this context, we propose a challenge that will test the viability of such scenarios. …Machine Learning9 min readMachine Learning9 min read
Nov 22, 2022ML Challenges: Result Submission VS Code SubmissionMany competitions are organized each year on platforms such as Kaggle, CodaLab Competitions or EvalAI. Some allow you to upload your model’s predictions, while others allow you to upload directly your model’s code to have it trained and tested on the platform. Which one is better? What should you do…Challenge3 min readChallenge3 min read
Published inTowards Data Science·Nov 12, 2020How to Create your First Competition on CodaLabIt’s free and easy! — Organizing a challenge allows you to crowd-source the most difficult machine learning problems. It is also an excellent way to learn data science. This short hands-on tutorial will give you everything you need to create your first competition — as early as today! Why Codalab? Codalab is an open-source web platform hosting…Competition5 min readCompetition5 min read
Published inTowards Data Science·Nov 10, 2020Designing a Data Science Competition is an Excellent Way to LearnWe got students to create ML challenges and this is what they learned — Over the past few years, we have explored the benefits of involving students both in organizing and in participating in challenges as a pedagogical tool, as part of an international collaboration. Engaging in the design and resolution of a competition can be seen as a hands-on means of learning proper…Machine Learning6 min readMachine Learning6 min read
