Monday, December 07, 2020

Learning Spatial Attention for Face Super-Resolution

This seems to be a promising computer vision research area with lots of practical applications!

Perhaps, this will e.g. help to identify the criminals who committed massive voter fraud in the Fulton county vote counting center in Georgia.

"General image super-resolution techniques have difficulties in recovering detailed face structures when applying to low resolution face images. Recent deep learning based methods tailored for face images have achieved improved performance by jointly trained with additional task such as face parsing and landmark prediction. ... In this paper, we introduce a novel SPatial Attention Residual Network (SPARNet) built on our newly proposed Face Attention Units (FAUs) for face super-resolution. Specifically, we introduce a spatial attention mechanism to the vanilla residual blocks. This enables the convolutional layers to adaptively bootstrap features related to the key face structures and pay less attention to those less feature-rich regions. This makes the training more effective and efficient as the key face structures only account for a very small portion of the face image. Visualization of the attention maps shows that our spatial attention network can capture the key face structures well even for very low resolution faces (e.g., 16×16). ..."

Learning Spatial Attention for Face Super-Resolution | DeepAI

No comments: