URAP

Doseok Austin Jang

Integrated Activation Maximization

Despite their popularity as predictive models, interpreting deep neural networks is still an open problem in machine learning. While local attribution techniques such as Integrated Gradients provide an importance map for individual input vectors, these techniques are unable to efficiently provide a global importance score over the entire input space. We introduce Integrated Activation Maximization (IAM), an iterative algorithm to jointly extract the activation maximizing pattern and a global attribution map for any node in a neural network faster than competing global attribution methods. IAM conducts a regularized gradient ascent to find the activation maximizing pattern for each node, while iteratively guiding the gradient ascent with on-the-fly feature importance estimates. IAM thus produces (1) a localized and focused optimal input pattern which emphasizes the features the model is most sensitive to, and (2) an attribution map that quantifies the importance of patterns in the optimal input.

Message to Sponsor

This opportunity lifts a large financial burden on me over the summer, and allows me to focus on my research a lot more easily. I am sincerely grateful to my donor for giving me this chance to do research without having to worry about living expenses.
  • Major: Electrical Engineering & Computer Science
  • Mentor: Reza Abbasi-Asl, UCSF