Impact of activation functions and number of layers on detection of exudates using circular Hough transform and convolutional neural networks


Adem K.

Expert Systems with Applications, cilt.203, 2022 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 203
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1016/j.eswa.2022.117583
  • Dergi Adı: Expert Systems with Applications
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Aerospace Database, Applied Science & Technology Source, Communication Abstracts, Computer & Applied Sciences, INSPEC, Metadex, Public Affairs Index, Civil Engineering Abstracts
  • Anahtar Kelimeler: Activation functions, CNN, Exudate, Image processing, ReLU, Swish
  • Sivas Cumhuriyet Üniversitesi Adresli: Hayır

Özet

Convolutional neural networks (CNN), which are used for object detection, are widely used in image recognition and segmentation fields due to their good performance. In this study, a method is proposed for the detection of exudate from DR lesions based on image processing and CNN model with different activation functions and layer numbers. Activation functions are one of the main reasons why the CNN model is complicated in hierarchical structure. CNN models have real artificial intelligence capabilities, especially thanks to non-linear activation functions. Although ReLU is the most commonly used activation function in CNN models, it has some shortcomings in practice. The most important shortcoming is that if the input value is negative, the learning process will slow down due to the inability to take the derivative. In order to solve this problem, the effect of the activation function in the CNN model on a real world problem and its image was investigated in this study. By applying circular Hough transform, one of the image processing methods, the OD region, which has a similar structure to the exuding regions, was determined and removed from the image, and then the detection of the exuding regions was carried out using the CNN model. Exudate detection was performed using ReLU, ELU, Leaky ReLU, Softplus and Swish activation functions in the CNN model and the results were compared. Experimental results in DiaretDB0 and DiaretDB1 databases show that the Swish activation function has a better performance than the others.