Machine Learning

What is the Role of Recurrent Neural Networks (RNNs) in an Image Caption Generator?

This topic contains 0 replies, has 1 voice, and was last updated by  arXiv 1 year, 6 months ago.


  • arXiv
    5 pts

    What is the Role of Recurrent Neural Networks (RNNs) in an Image Caption Generator?

    In neural image captioning systems, a recurrent neural network (RNN) is typically viewed as the primary generation' component. This view suggests that the image features should beinjected’ into the RNN. This is in fact the dominant view in the literature. Alternatively, the RNN can instead be viewed as only encoding the previously generated words. This view suggests that the RNN should only be used to encode linguistic features and that only the final representation should be `merged’ with the image features at a later stage. This paper compares these two architectures. We find that, in general, late merging outperforms injection, suggesting that RNNs are better viewed as encoders, rather than generators.

    What is the Role of Recurrent Neural Networks (RNNs) in an Image Caption Generator?
    by Marc Tanti, Albert Gatt, Kenneth P. Camilleri
    https://arxiv.org/pdf/1708.02043v2.pdf

    • This topic was modified 1 year, 6 months ago by  admin.

You must be logged in to reply to this topic.