Face parsing via recurrent propagation

Sifei Liu, Jianping Shi, Ji Liang, Ming Hsuan Yang

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    19 Citations (Scopus)


    Face parsing is an important problem in computer vision that finds numerous applications including recognition and editing. Recently, deep convolutional neural networks (CNNs) have been applied to image parsing and segmentation with the state-of-the-art performance. In this paper, we propose a face parsing algorithm that combines hierarchical representations learned by a CNN, and accurate label propagations achieved by a spatially variant recurrent neural network (RNN). The RNN-based propagation approach enables efficient inference over a global space with the guidance of semantic edges generated by a local convolutional model. Since the convolutional architecture can be shallow and the spatial RNN can have few parameters, the framework is much faster and more light-weighted than the state-of-the-art CNNs for the same task. We apply the proposed model to coarse-grained and fine-grained face parsing. For fine-grained face parsing, we develop a two-stage approach by first identifying the main regions and then segmenting the detail components, which achieves better performance in terms of accuracy and efficiency. With a single GPU, the proposed algorithm parses face images accurately at 300 frames per second, which facilitates real-time applications.

    Original languageEnglish
    Title of host publicationBritish Machine Vision Conference 2017, BMVC 2017
    PublisherBMVA Press
    ISBN (Electronic)190172560X, 9781901725605
    Publication statusPublished - 2017 Jan 1
    Event28th British Machine Vision Conference, BMVC 2017 - London, United Kingdom
    Duration: 2017 Sept 42017 Sept 7

    Publication series

    NameBritish Machine Vision Conference 2017, BMVC 2017


    Conference28th British Machine Vision Conference, BMVC 2017
    Country/TerritoryUnited Kingdom

    All Science Journal Classification (ASJC) codes

    • Computer Vision and Pattern Recognition


    Dive into the research topics of 'Face parsing via recurrent propagation'. Together they form a unique fingerprint.

    Cite this