AI Competition Champions!
Defence Science and Technology Agency - Today I Learnt AI Competition, Advanced Category Champions
Thrilled to be crowned the Champions at DSTA’s BrainHack: Today I Learnt - Artificial Intelligence (Advanced Track) competition!
After two years serving in the army, our team, Team Anti Heroes, was excited to finally get our hands dirty and train some machine learning models! Over 4 weeks from May-June, we managed to develop resilient models to solve 3 different tasks (Vision Language Models, Natural Language Processing and Automatic Speech Recognition), which culminated in a final robotics segment, where we controlled a DJI Robomaster turret to identify targets based on audio instructions.
Due to work commitments while serving in the army, I haven’t had the opportunity to learn about the latest developments in AI, and this competition really accelerated my learning in the fields of computer vision, natural language processing and automatic speech recognition. Gone are the days where training simple LSTMs, or CNN-based architectures were sufficient in winning these AI competitions, which is really testament to how fast this field is evolving.
I especially enjoyed working on the vision language model tasks, where I developed a two-step object detection and captioning model for our team, which significantly outperformed many of the end-to-end models such as OwlViT and Grounding Dino on the test set.
One of the challenges I faced was our limited compute power. We soley relied on the Tesla T4 GPU provided to us on the Google Cloud Platform, which resulted in our slow training times, while other teams were training on their local GPUs or more powerful cloud-based GPUs. However, this also proved to be our team’s advantage, as we had to use smaller and more suitable models, which improved our inference times during our robotics evaluation, and allowed our model to generalize better.
I also gained valuable exposure into how machine learning models can be deployed, via Google’s Artifact Registry and Docker containers, which I found pretty interesting.
Will definitely be keeping myself updated on exciting developments in machine learning in the years to come!
Github Repository: https://github.com/jzh001/til-ai-2024
References
- Images from AngelHack LinkedIn Post