Saliency Contour Extraction Based on Multi-level Feature Channel Optimization Coding

Linling Fang, Yingle Fan

Abstract


A biomimetic vision computing model based on multi-level feature channel optimization coding is proposed and applied to image contour detection, combining the end-to-end detection method of full convolutional neural network and the traditional contour detection method based on biological vision mechanism. Considering the effectiveness of the Gabor filter in perceiving the scale and direction of the image target, the Gabor filter is introduced to simulate the multi-level feature response on the visual path. The optimal scale and direction of the Gabor filter are obtained based on the similarity index, and they are used as the frequency separation parameter of the NSCT transform. The contour sub-image obtained by the NSCT transform is combined with the original image for feature enhancement and fusion to realize the primary contour response. The low-dimensional and low-redundancy primary contour response is used as the input sample of the network model to relieve network pressure and reduce computational complexity. A fully improved convolutional neural network model is constructed for multi-scale training, through feature encoder to feature decoder, to achieve end-to-end pixel prediction, and obtain a complete and continuous detection image of the subject contour. Using the BSDS500 atlas as the experimental sample, the average accuracy index is 0.85, which runs on the device CPU at a detection rate of 20+ FPS to achieve a good balance between training efficiency and detection effect.


Keywords


Contour Detection; Convolutional Neural Network; Multi-level Features; Biological Vision Mechanism

Full Text:

PDF

Included Database


References


Mouelhi A, Sayadi M, Fnaiech F, et al. Automatic image segmentation of nuclear stained breast tissue sections using color active contour model and an improved watershed method. Biomedical Signal Processing and Control 2013; 8(5): 421–436.

Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2015 Jun 7–12; Boston. IEEE; 2015.

Chen LC, Papandreou G, Kokkinos I, et al. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence 2017; 40(4): 834–848.

Wu T, Bartlett MS, Movellan JR. Facial expression recognition using Gabor motion energy filters. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops; 2010 Jun 13–18; San Francisco. IEEE; 2010.

Chen CY, Sonnenberg L, Weller S, et al. Spatial frequency sensitivity in macaque midbrain. Nature Communications 2018; 9(1): 2852.

Da Cunha AL, Zhou J, Do MN. The nonsubsampled contourlet transform: Theory, design, and applications. IEEE Transactions on Image Processing 2006; 15(10): 3089–3101.

Dagher I, Mikhael S, Al-Khalil O. Gabor face clustering using affinity propagation and structural similarity index. Multimedia Tools and Applications 2020.

Dollár P, Zitnick CL. Structured forests for fast edge detection. 2013 IEEE International Conference on Computer Vision; 2013 Dec 1–8; Sydney. IEEE; 2014.

Martin D, Fowlkes C, Tal D, et al. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Proceedings Eighth IEEE International Conference on Computer Vision; 2001 Jul 7–14; Vancouver. IEEE 2002.

Liu Y, Cheng MM, Hu X, et al. Richer convolutional features for edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 2019; 41(8): 1939–1946.

Liu Y, Cheng M M, Hu X, et al. Richer convolutional features for edge detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017; 3000–3009.

Maninis K K, Pont-Tuset J, Arbeláez P, et al. Convolutional oriented boundaries. European Conference on Computer Vision. Springer, Cham 2016; 580–596.

Xie S, Tu Z. Holistically-nested edge detection. Proceedings of the IEEE International Conference on Computer Vision 2015; 1395–1403.

Bertasius G, Shi J, Torresani L. High-for-low and low-for-high: Efficient boundary detection from deep object features and its applications to high-level vision. Proceedings of the IEEE International Conference on Computer Vision 2015; 504–512.

Shen W, Wang X, Wang Y, et al. Deepcontour: A deep convolutional feature learned by positive-sharing loss for contour detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2015; 3982–3991.

Bertasius G, Shi J, Torresani L. Deepedge: A multi-scale bifurcated deep network for top-down contour detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015: 4380–4389.

Hallman, Sam, Fowlkes, Charless C. Oriented edge forests for boundary detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2015: 1732–1740.

Gong XY, Su H, Xu D, et al. An overview of contour detection approaches. International Journal of Automation and Computing 2018; 15(6): 656–672.

Lu Z, Wang X, Shang J, et al. A multimedia image edge extraction algorithm based on flexible representation of quantum. Multimedia Tools and Applications 2019; 78(17): 24067–24082.




DOI: https://doi.org/10.18686/esta.v7i4.168

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 Yingle Fan, Linling Fang

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.