Machine Learning

Learning Rapid-Temporal Adaptations

Tagged: , ,

This topic contains 0 replies, has 1 voice, and was last updated by  arXiv 1 year, 3 months ago.

  • arXiv
    5 pts

    Learning Rapid-Temporal Adaptations

    A hallmark of human intelligence and cognition is its flexibility. One of the long-standing goals in AI research is to replicate this flexibility in a learning machine. In this work we describe a mechanism by which artificial neural networks can learn rapid-temporal adaptation – the ability to adapt quickly to new environments or tasks – that we call adaptive neurons. Adaptive neurons modify their activations with task-specific values retrieved from a working memory. On standard metalearning and few-shot learning benchmarks in both vision and language domains, models augmented with adaptive neurons achieve state-of-the-art results.

    Learning Rapid-Temporal Adaptations
    by Tsendsuren Munkhdalai, Xingdi Yuan, Soroush Mehri, Tong Wang, Adam Trischler

You must be logged in to reply to this topic.