• Reinforcement Learning Trading Agent for Electricity Markets

    Reinforcement Learning Trading Agent for Electricity Markets

    In this project, I designed an AI trading agent for electricity markets using deep reinforcement learning, trained with curriculum learning. The agent showcases strong performance in day-ahead power markets by taking in price and grid forecasts (that I developed myself using transformer models) and outputting optimal bids for the next 24 hours in a half-hourly… Read more

  • Developing my Own Chess AI

    Developing my Own Chess AI

    While many chess computers display impressive superhuman performance, they often require massive computational ressources and/or extensive expert level knowledge and finetuning during their development. In this project, I wanted to challenged this supposition and developed a personal chess AI on my own using reinforcement learning together with a Monte Carlo tree search planning algorithm. The… Read more

  • Power Grid Automation with Machine Learning and Optimal Control

    Power Grid Automation with Machine Learning and Optimal Control

    The operation of modern power grids has become increasingly challenging with the transition to renewable energy sources. As a consequence, the transmission system operator of France has launched a series of competitions, called L2RPN, to explore novel methods to operate power grids. Together with Hitachi Energy, I explored a novel control strategy based on optimal… Read more

  • Fatigue Detection with Wearable Devices using Transformer Machine Learning Models

    Fatigue Detection with Wearable Devices using Transformer Machine Learning Models

    Fatigue is a common symptom in many chronic diseases, such as multiple sclerosis and psychiatric disorders. Currently, the progress of a patient’s fatigue needs to be monitored manually and is time consuming. Together with the ETH AI Center, I explored the feasibility of automated fatigue monitoring with machine learning using non-intrusive wearable devices. The fully… Read more

  • Automated Machine Learning Using Genetic Algorithm

    Automated Machine Learning Using Genetic Algorithm

    A typical machine learning application often involves a challenging procedure composed of data preprocessing, feature extraction, architecture selection, and hyperparameter tuning. Automated machine learning, or AutoML, aims to simplify this complex process. In this project, I designed an AutoML algorithm using a cascaded architecture comprised of a Nelder-Mead method and a genetic algorithm. The resulting algorithm… Read more

  • Implementation of a Blackjack Playing Agent: Combining Reinforcement Learning and Card-Counting

    Implementation of a Blackjack Playing Agent: Combining Reinforcement Learning and Card-Counting

    Blackjack is one of the most popular casino games in the world even though it is inherently unfair towards the player and strongly favors the “house”. In order to still make a profit, professional Blackjack players resort to a strategy called card counting. In this project, I combined card counting with reinforcement learning and developed… Read more

  • Coding an Artificial Neural Network from Scratch

    Coding an Artificial Neural Network from Scratch

    In my second year of my bachelor’s studies, I encountered the field of machine learning and was immediately captivated by it. Eager to learn more, I taught myself more about neural networks and decided to build one from scratch in Java, without the help of any libraries. The result was a multilayer perceptron, or MLP,… Read more

Contact