ADUA

Out-of-distribution autonomous navigation

Research Lead Ivan TorrianiTerm 2025–2026Research Team Ceyanna Badyal, Saurish Suman, Vinayak Kohli, Zach Goldwyn

On December 20th, 2025, San Francisco’s power outage shut off traffic and street lights, causing the city’s Waymo’s to stall more than 1,500 times in one night; the normal daily rate was reported by SF officials at 4, making this abnormal Saturday night 375 times worse. Autonomous vehicles struggle when they are put in unfamiliar and rare situations they haven’t been trained on, in this case, a city without traffic lights. The biggest gap between modern deprecated autonomy and full autonomy is the ability for a model, like a self-driving model, to be able to make logical decisions even in situations it hasn’t been trained on.

ADUA developed two main methods to address autonomy in unknown domains. Firstly, a bi-model consensus that used a low-confidence threshold alongside open-world model detectors to recognise unknown objects. Secondly, an original use of colour blocks and frame-palette tracking to check unknown objects cheaply, without a heavy meta-learning model. Together these resulted in a 93%-accurate pipeline.

ADUA set out to experiment with three main methods that could address autonomy in unknown domains using modern meta-learning models. Firstly, a bi-model consensus between an open-set model, which can detect almost all objects in the normal driving scenario, and an object-agnostic model, which can detect any object in general, to detect unknown objects. Secondly, a stripped-down version of the initial pipeline which, instead of leveraging the heavy object-agnostic model, replaces it with a lighter and unique method that uses sudden colour-palette shifts in frames to indicate unknown objects. Finally, a bi-model consensus between an open-set model and a conceptual scene-understanding model, which can add logical context to whatever situation a model is in.

This research has the potential to:

  • Explore and promote the field of meta-learning, which remains one of the most important logical leaps of artificial intelligence that haven’t been made yet.
  • Expand autonomous machines to edge devices and cheaper hardware, promoting accessibility within self-driving use cases like humanitarian aid and precision agriculture.
  • Explore the age-old question of how a model actually operates beyond the black box, which researchers at Anthropic, Google, and elsewhere are currently working on.

Literature Review

Works Cited

  • Chan, Robin, et al. “SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation.” Advances in Neural Information Processing Systems 35, Datasets and Benchmarks Track, 2021. PDF.
  • Joseph, K. J., et al. “Towards Open World Object Detection.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, 2021. PDF.
  • Kirillov, Alexander, et al. “Segment Anything.” arXiv, 2023. arxiv.org/abs/2304.02643.