The current state of automatic medical image captioning using deep learning

Document Type : Survey

Authors

1 PhD.Student of Computer Engineering, Islamic Azad University, Science and Research, Tehran

2 Department,of Computer Engineering, Islamic Azad University, Saveh, Iran

3 Department of Systems and Control, Toosi University of Technology (KNTU), Tehran

4 Department of Electrical and Computer Engineering, Azad University, Science and Research Branch, Tehran

5 Radiology Department of Birjand University of Medical Sciences Birjand, Iran

Abstract

Image captioning is a new field of artificial intelligence which uses both natural language processing and machine learning methods. Recently, several researches conducted on Image captioning have led to the acceptable results in this field. Moreover, the need of the medical community for automatic interpretation of medical images, prompted researchers to apply this approach in the field of automatic interpretation of medical images. The medical images captioning is more challenging than the problem of image description because medical images are mostly gray and accompanied by noise, the existing data sets have significantly few samples; On the other hand, the provided interpretations are not structured and have variable lengths. In order to achieve the desired results, many algorithms have been proposed, among which methods based on deep learning have achieved proper results. This article introduces datasets, evaluation criteria and methods developed based on deep learning in the field of automatic interpretation of medical images in order to help understand the existing literature and highlight future directions in this field.

Keywords

Journal of Machine Vision and Image Processing
Volume 10, Issue 3
September 2023
Pages 1-29

Files

Share

How to cite

Statistics