Hierarchical deep multi-modal network for medical visual question answering

作者：

Highlights：

• Question Segregation (QS) technique helps the task of VQA in the medical domain.

• Proposed VQA model with QS to generate answer to question related to medical image.

• Extensive experiments and analysis of the generated answer in the medical domain.

• A thorough error analysis of the system generated answer.

摘要

•Question Segregation (QS) technique helps the task of VQA in the medical domain.•Proposed VQA model with QS to generate answer to question related to medical image.•Extensive experiments and analysis of the generated answer in the medical domain.•A thorough error analysis of the system generated answer.

论文关键词：Visual Question Answering,Neural Networks,Medical Domain,Support Vector Machine,Gated Recurrent Units

论文评审过程：Received 7 October 2019, Revised 21 August 2020, Accepted 9 September 2020, Available online 1 October 2020, Version of Record 1 October 2020.

论文官网地址：https://doi.org/10.1016/j.eswa.2020.113993