Aayam Shrestha

I build intelligent agents. 🧠💻🌳


Clean Code - Precise Writeup - Powerful Abstractions



2018 -
Ph.D. Candidate, Oregon State University
I am currently a Graduate Research Assistant at OSU advised by Dr. Alan Fern. My research aims to combine the reasoning abilities of symbolic AI planners / RL Agents with the rich representations learned by deep neural networks. This lets an AI Agent ground their abstract plans into the real sensory world - enabling optimal execution. I am interested applying my research to enable spatial computing agents to reason and act in virtual and real 3D environments.
2022
SWE Intern (AI Specialist), Meta Reality Labs.
Designed and implemented Upselling module for Oculus Store. The Averagers recommendation module extends support for items, consummables as well as bundles for upselling. Offline evaluation demonstrated 150% improvement on suggested purchase conversion over KNN baseline. Also constructed User Journey Dataset for modelling in-app purchases over time across the oculus store.
2021
Applied Scientist Intern, Amazon Search.
Designed and Implemented Page Level Reward for Cross-Slot Widget Ranking. This tackles the fundamental problem of defining reward which is aligned with different business metrics while factoring for page level interactions of users. Also built a prediction model that increases the modelling accuracy by 300% for rewards (over baselines) and 50% improvement for overall business metric predictions - across different world regions.
2018 - 2016
Business Intelligence Engineer , Logic Info.
Developed and maintained large-scale enterprise Data Warehousing and Business Intelligence solutions for Off-shore clients; Alex & Ani, Holland and Barett, Gander Mountain, and Makro. I was also invovled in Customer Experience Analytics over in-house data lake sourced from customer call audio, text reviews and curated twitter feeds.
2016 - 2012

B.S. in Computer Engineering, Tribhuvan University.
Discovered that a well written code teaches you how to think. Never looked back.

Publications

CORL 2024
[Webpage]
Bikram Pandit, Ashutosh Gupta, Mhoitvishnu S. Gadde, Addison Johnson, Aayam Shrestha, Helei Duan, Jeremey Dao, Alan Fern

(Under Submission)
[Webpage]
Pranay Dugar, Aayam Shrestha, Fangzxhou Yu, Bart Vanm Marum, Alan Fern

ECCV 2024
[Webpage]
Aayam Shrestha*, Pan Liu*, German Ros, Kai Yuan, Alan Fern

IROS 2024
[Webpage]
Bart Vanm Marum, Aayam Shrestha, Helei Duan, Pranay Dugar, Jermey Dao, Alan Fern

AMLC 2021 Workshop
Aayam Shrestha, Kai Yuan

ICLR 2021 (Spotlight Top-2%)   [Webpage]
Aayam Shrestha, Stefan Lee, Prasad Tadepalli, Alan Fern

SIGMOD 2021
Yodsawalai Chodpathumwan, Aayam Shrestha, Stephen Ramsey, Arash Termehchy
Projects
DAC-MDP is able to solve Atari games using Tabular MDPs. It acheives this by building a Non-Parametric MDP over the learned deep representations. Ut then leverages GPU optimized VI solver from BIGMDP. It serves as a strong yet inexpensive baseline for small to medium offline Reinforcement learning Tasks.
BigMDP: A simple library for creating and solving large MDPs with million of states. easy to use APIs for MDP building and comes with GPU optimized VI solver. Able to solve MDPs with a millions of states in less than 30 seconds.