Multi-modality helps in crisis management: An attention-based deep learning approach of leveraging text for image classification

作者：

Highlights：

• A multi-modal deep learning model for image classification in disaster domain.

• Devising an attention mechanism for combination of the two modalities.

• Showing how adding text can help in image classification.

摘要

•A multi-modal deep learning model for image classification in disaster domain.•Devising an attention mechanism for combination of the two modalities.•Showing how adding text can help in image classification.

论文关键词：Multi-modal classification,Deep learning,Attention,Disaster Domain

论文评审过程：Received 18 November 2019, Revised 25 January 2022, Accepted 29 January 2022, Available online 12 February 2022, Version of Record 15 February 2022.

论文官网地址：https://doi.org/10.1016/j.eswa.2022.116626