are primarily targeting only one goal — high quantitative results measured by mean square error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), mean opinion score (MOS) and other similar metrics. As a result, the general recipe for achieving top results in these competitions is quite similar: more layers/filters, deeper architectures and longer training on dozens of GPUs. However, one question that might arise here is whether often marginal improvements in these scores are actually worth the tremendous computational complexity increase. Maybe it is possible to achieve very similar perceptual results by using much smaller and resource-efficient networks that can run on common portable hardware like smartphones or tablets. This question becomes of special interest due to the uprise of many machine learning and computer vision problems directly related to these devices, such as image classification[31, 10], image enhancement [13, 14], image super-resolution [8, 34], object tracking [38, 11]
, visual scene understanding[21, 7]
, face detection and recognition[20, 26], etc.
The PIRM 2018 challenge on perceptual image enhancement on smartphones is the first step towards benchmarking resource-efficient architectures for computer vision and deep learning problems targeted at high perceptual results and deployment on mobile devices . It considers two classical computer vision problems — image super-resolution and enhancement, and introduces target performance metrics that are taking into account both networks’ runtime, their quantitative and qualitative visual results. In the next sections we describe the challenge and the corresponding datasets, present and discuss the results and describe the proposed methods.
2 PIRM 2018 challenge
The PIRM 2018 challenge on perceptual image enhancement on smartphones has the following phases:
development: the participants get access to the data;
validation: the participants have the opportunity to validate their solutions on the server and compare the results on the validation leaderboard;
test: the participants submit their final results, models, and factsheets.
The PIRM 2018 challenge on perceptual image enhancement on smartphones consists of two different tracks described below.
2.1 Track A: Image super-resolution
The first track is targeting a conventional super-resolution problem, where the goal is to reconstruct the original image based on its bicubically downscaled version. To make the task more practical, we consider a downscaling factor of 4, some sample results for which obtained with SRGAN network  are shown in the figure 1. To train deep learning models, the participants used DIV2K dataset  with 800 diverse high-resolution train images crawled from the Internet.
2.2 Track B: Image enhancement
The goal of the second track is to automatically improve the quality of photos captured with smartphones. In this task, we used DPED  dataset consisting of several thousands of images captured simultaneously with three smartphones and one high-end DSLR camera. Here we consider only a subtask of mapping photos from a very old iPhone 3GS device into the photos from Canon 70D DSLR. An example of the original and enhanced DPED test images are shown in the figure 2.
3 Scoring and validation
The participants were required to submit their models as TensorFlow.pb files that were later run on the test images and validated based on three metrics:
Though MS-SSIM scores are known to correlate better with human image quality perception than PSNR, they are still often not reflecting many aspects of real image quality. Therefore, during the final test phase we conducted a user study involving more than 2000 participants (using MTurk platform 111https://www.mturk.com/
) that were asked to rate the visual results of all submitted solutions, and the resulting Mean Opinion Scores (MOS) then replaced MS-SSIM results. For Track B methods, the participants in the user study were invited to select one of four quality levels (probably worse, probably better, definitely better, excellent) for each method result in comparison with the original input image. The expressed preferences were averaged per each test image and then per each method to obtain the final MOS.
The final score of each submission was calculated as a weighted sum of the previous scores:
To cover a broader range of possible targets, we have additionally introduced three validation tracks with different weight coefficients: the first one (score A) was favoring solutions with high quantitative results, the second one (score B) — with high perceptual results, and the third one (score C) was aimed at the best balance between the speed, visual and quantitative scores. Below are the exact coefficients for all tracks:
= 26.5, = 0.94,
: score A - , score B - ,
score C - .
= 21.0, = 0.90,
: score A - , score B - ,
score C - .
The implementation of the scoring scripts, pre-trained baseline models and submission requirements are also available in the challenge github repository 222https://github.com/aiff22/ai-challenge.
|Team||PSNR||MS-SSIM||CPU,||GPU,||Razer Phone,||Huawei P20,||RAM||Score A||Score B||Score C|
During the validation phase, we have obtained more than 100 submissions from more than 20 different teams. 12 teams entered in the final test phase and submitted their models, codes and factsheets; tables 1 and 2 summarize their results.
4.1 Image Super-Resolution
First of all, we would like to note that all submitted solutions demonstrated high efficiency: they were generally three to eight times faster than SRCNN, and at the same time were providing radically better visual and quantitative results. Another interesting aspect is that according to the results of the user study, its participants were not able to distinguish between the visual results produced by different solutions, and MOS scores in all cases except for the baseline SRCNN model were almost identical. The reason for this is that neither of the submitted models were trained with a strong adversarial loss component: they were mainly optimizing Euclidean, MS-SSIM and VGG-based losses. In this track, however, we still have two winners: the first one is the solution proposed by TEAM_ALEX that achieved the best scores in all three validation tracks, while the second winning solution from KAIST-VICLAB has demonstrated the best runtime on all platforms, including two Android smartphones (Razer Phone and Huawei P20) on which it was able to process HD-resolution images under 1 second.
|Team||PSNR||MS-SSIM||MOS||CPU,||GPU,||Razer Phone,||Huawei P20,||RAM||Score A||Score B||Score C|
|EdS||21.65||0.9048||2.6523||3241||253||5153||Out of memory||2.3GB||7.18||12.94||9.36|
|DPED (Baseline)||21.38||0.9034||2.4411||20462||1517||37003||Out of memory||3.7GB||2.89||4.90||3.32|
4.2 Image enhancement.
Similarly to the previous task, all submissions here were able to significantly improve the runtime and PSNR scores of the baseline SRCNN [8, 13] and DPED  approaches. Regarding the perceptual quality, in this case there is no clear story, mainly high PSNR scores did not guarantee the best visual results, and vice versa. Also, MS-SSIM does not predict well the perceptual quality captured by MOS. The winner of this track is Mt.Phoenix team that achieved top MOS scores, as well as the best A, B and C scores and the fastest runtime on CPU and GPU. On smartphones, this solution required around 1.5 and 2 seconds for enhancing one HD-resolution photo on the Razer Phone and Huawei P20, respectively.
The PIRM 2018 challenge on perceptual image enhancement on smartphones promotes the efficiency in terms of runtime and memory as a critical measure for successful deployment of solutions on real applications and mobile devices. For both considered tasks (super resolution and enhancement) a diversity of proposed solutions surpassed the provided baseline methods and greatly improved the efficiency. We conclude that the challenge through the proposed solutions define the state-of-the-art for image enhancement on smartphones.
5 Proposed methods
This section describes solutions submitted by all teams participating in the final stage of the PIRM 2018 challenge on perceptual image enhancement on smartphones.
For track A, TEAM_ALEX proposed a residual neural network with 20 residual blocks, though all computations in this CNN were mainly done on the images downscaled by a factor of 4 with two desubpixel blocks; in the last two layers they were upscaled back to their original resolution with two subpixel modules. The main idea of desubpixel downsampling is shown on the figure 3 — this is a reversible downsampling done via rearranging the spatial features into several channels to reduce spatial dimensions without losing information. The whole network was trained with a combination of MSE and VGG-based loses on patches of size 196196px (image super-resolution) and 100100px (image enhancement) for 210 and 210 iterations, respectively. The authors used Adam optimizer with set to 0.9 and a batch size of 8; training data was additionally augmented with random flips and rotations. The learning rate was initialized at and halved when the network was 60 percent trained.
In track A, KAIST-VICLAB proposed a similar approach of using 4 image downscaling and residual learning, however their CNN (fig. 4) consisted of only 8 convolutional layers. High visual and quantitative results were still obtained by using a slightly different training scheme: the authors applied a small amount of Gaussian blur to degrade the downscaled low-resolution training patches, while they improved construct and sharpness of the target high-resolution images. Furthermore, residual units, pixel shuffle , error feedback scheme  and xUnit 
were integrated into network for faster learning and higher performance. The authors used 2,800 additional images from the BSDS300, Flickr500 and Flickr2K datasets for training, and augmented data with random flips and rotations. The network was trained for 2000 epochs on 128128px patches with L1 loss only; the batch size was set to 4, the learning rate was .
For track B, KAIST-VICLAB presented an encode-decoder based architecture (fig. 4
), where spatial sizes are reduced with a space-to-batch technique: instead of using stride-2 convolutions, the feature maps obtained after each layer are divided into 4 smaller feature maps that are then concatenated along the batch dimension. The authors used an additional adversarial component, and for the discriminator they proposed relativistic RGAN with twice as many parameters as in the generator. The network was trained similarly to track A, but with a combination of color and adversarial losses from .
For image super-resolution, the Mt.Phoenix authors used a deep residual CNN with two downsampling blocks performing image downscaling and two deconvolution blocks for its upscaling to the original size. Besides the standard residual blocks, additional skip connections between the input and middle layers were added to improve the performance of the network. CNN was trained on 500500px patches using Adam optimizer with an initial learning rate of and a decay of . The network was trained with L1 loss, no data augmentation was used.
In the second track, Mt.Phoenix proposed a U-net style architecture  (fig. 5) and augmented it with global features calculated by applying average pooling to features from its bottleneck layer. Additionally, a global transform layer performing element-wise multiplication of the outputs from the second and last convolutional layers was proposed. The network was trained with a combination of L1, MS-SSIM, VGG, total variation and GAN losses using Adam optimizer with a constant learning rate of .
For image super-resolution, CARN_CVL proposed the convolutional anchored regression network (CARN)  (see Fig. 6) which has the capability to efficiently trade-off between speed and accuracy. Inspired by A+ [34, 33] and ARN 
, CARN is formulated as a regression problem. The features are extracted from input raw images by convolutional layers. The regressors map features from low dimension to high dimension. Every regressor is uniquely associated with an anchor point so that by taking into account the similarity between the anchors and the extracted features, CARN can assemble the different regression results to form output features or the original image. In order to overcome the limitations of patch-based SR, all of the regressions and similarity comparisons between anchors and features are implemented by convolutional layers and encapsulated by a regression block. Furthermore, by stacking the regression block, the performance of the network increases steadily. CARN_CVL starts with the basic assumption of locally linear regression, derives the insights from it, and points out how to convert the architecture to convolutional layers in the proposed CARN.
The challenge entry uses CARN with 5 regression blocks, 16 anchors / regressors per block, and a number of feature layers reduced to 2. In the two feature layers, the stride of the convolution operation is set to 2 because the bicubic interpolated image contains no high frequency information compared to the LR image but slows down the executation of the network. The number of inner channels is set as 8 for the upscaling factor 4.
EdS proposed a modification  of the original DPED ResNet architecture used for image enhancement (fig. 7). The main difference in their network was the use of two 44 convolutional layers with stride 2 for going into lower dimensional space, and additional skip connections for faster training. The network was trained for 33K iterations using the same losses and setup as in .
5.6 Iv Sr+
. The proposed FCCN consists of feature extraction, fast clique block (FCB) and two deconvolution layers (fig.8). For feature extraction, two convolutional layers with 32 and 20 kernels are utilized. Then, to accelerate the FCCN architecture, these features are fed to FCB layers for extracting more informative convolutional features. The FCB layer consists of one input convolutional layer and four bidirectional densely connected convolutional layers with both depthwise and pointwise convolution. The network was trained using Adam optimizer and a batch size of 16 for 3M iterations with an initial learning rate of halved after 2 million iterations.
The architecture of the network used for image super-resolution is presented in the figure 9 and is based on the Laplacian pyramid framework with a denseblock inspired by . The parameters of denseblocks, strided and transposed convolutional layers are shared among different network levels to improve the performance. For image enhancement problem, the authors proposed a different architecture  (fig. 9). First of all, it featured several Mux and Demux layers performing image up- and downscaling without information loss and that are basically a variant of (de)subpixel layers used in other approaches. This network was additionally trained with an extensive combination of various losses, including L1 loss for each image color channel, contextual, VGG, color, total variation and adversarial losses.
The CNN architecture used in the first track is shown in the figure 10. The network consists of two convolutional layers with stride 2, three convolutional layers with stride 1, cascaded residual blocks and a subpixel layer. The network was trained to minimize L1 and SSIM losses on 384384px patches augmented with random flips and rotations. The learning rate was set to and decreased by a factor of 5 every 1000 epochs.
A different approach  was used for image enhancement: the authors first trained a larger teacher generator and then used it to guide the training of the smaller student network (see fig. 10). The latter was done by imposing additional knowledge distillation loss calculated as Euclidian distance between the corresponding normalized student’s and teacher’s feature maps. Besides this loss, the networks were trained with a combination of SSIM, VGG, L1, context, color and total variation losses using Adam optimizer with an initial learning rate of decreased by a factor 10 for every iterations.
MENet team proposed a -inception Network depicted in the figure 11 for image enhancement problem. This CNN has a -inception block where the image is processed in parallel by convolutional and deconvolutional layers with strides 2 and 4 for multi-scale learning. Besides that, the size of the convolutional filters is different too: 3 and 5 in the first and the second case, respectively. At the end of this block, the corresponding two outputs are concatenated together with the output from the first convolutional layer and are passed to the last CNN layer. The network is trained using the same setup as in 
with the following two differences: 1) two additional texture loss functions (local contrast normalization and gradient) are used and 2) after pre-training the network is additionally fine-tuned on the same dataset with Adam minimizer and a learning rate of.
Figure 12 presents the CNN architecture used for image super-resolution problem. The network consists of one space-to-depth 4
downsampling layer followed by convolutional and residual layers with PReLU activation functions and one deconvolutional layer for image upscaling. The model was trained on 192192px patches augmented with flips and rotations. Adam optimizer with a mini-batch size of 32 and a learning rate of decayed by 10 every 1000 epochs was used for CNN training. After the initial pre-training with L2 loss, the training process was restarted with the same settings, while the loss function was replaced by a mixture of Charbonnier  loss and MS-SSIM losses.
For image enhancement, SNPR derives three network architectures corresponding to different operating points. The generator networks (, , and ) corresponding to the three different approaches and the common discriminator network are shown in Fig. 13. Conv(f, k, s) refers to a convolution layer with filters performing convolution by a stride factor ofPixel-Shuffler X2 refers to the pixel shuffler layer  which increases resolution by a factor of 2. The first three layers are meant to extract the features that are relevant for image enhancement. Feature extraction at low-image-dimension has the advantages of larger receptive field and much lower computational complexity . To compensate for detrimental effects of spatial dimension reduction in features, the input image (which have full-resolution spatial features) is concatenated with the features extracted at low-dimensional space and then combined by the succeeding convolutional layers. Overall achieves the best speed-up-ratio but with a lower performance as compared to DPED baseline , whereas achieves the lowest speed-up-ratio while having comparable quality to that of DPED.
The overall structure of the network  presented by Geometry team is shown in the figure. 14. Each convolutional layer has 16 filters, and the network itself produces two outputs: one based on the features from the middle CNN layer, and one from the last layer. The intermediate output (Output OC) is used to compute SSIM loss, while the final one (Output OE) is used to compute the loss function consisting of adversarial, smooth, and style losses. During the training all losses are summed, and the network is trained as a whole using Adam optimizer with a learning rate of decreased by a factor of 10 every 8000 iterations.
We thank the PIRM2018 sponsors: ETH Zurich (Computer Vision Lab), Huawei Inc., MediaTek Inc., and Israel Institute of Technology.
Appendix 1: Teams and affiliations
PIRM 2018 Team
PIRM Challenge on Perceptual Image Enhancement
Andrey Ignatov – email@example.com,
Radu Timofte – firstname.lastname@example.org
Computer Vision Lab, ETH Zurich, Switzerland
Fast and Efficient Image Quality Enhancement using
Desubpixel Down-sampling 
Thang Vu – email@example.com,
Tung Luu, Trung Pham, Cao Nguyen
Dept. of Electrical Engineering KAIST,
Republic of Korea
A Low-Complexity Convolutional Neural Network for
A Low-Complexity Convolutional Neural Network for
Perceptual Super-Resolution using Randomly-Selected
Degraded LR and Enhanced HR
A Convolutional Neural Network for Detail Enhancement
with the Relativistic Discriminator
Yongwoo Kim – firstname.lastname@example.org,
Jae-Seok Choi, Munchurl Kim
Video and Image Computing Lab, KAIST,
Republic of Korea
Multi Level Super Resolution Net 
Range Scaling Global U-Net for Perceptual Image
Enhancement on Mobile Devices
Pengfei Zhu – email@example.com,
Chen Xing, Xingguang Zhou, Jie Huang,
Mingrui Geng, Jiewen Ran
Meitu Imaging & Vision Lab, China
Convolutional Anchored Regression Network 
Yawei Li – firstname.lastname@example.org,
Eirikur Agustsson, Shuhang Gu,
Radu Timofte, Luc Van Gool
Computer Vision Lab, ETH Zurich, Switzerland
An Efficient and Compact Mobile Image Super-resolution
with Fast Clique Convolutional Network
Kehui Nie – email@example.com,
Yan Zhao , Gen Li , Tong Tong , Qinquan Gao
– Fuzhou University, China
– Imperial Vision, China
Perception-Preserving Convolutional Networks for Image
Enhancement on Smartphones 
Zheng Hui – firstname.lastname@example.org,
Xiumei Wang , Lirui Deng , Rang Meng
– Xidian University, China
– Tsinghua University, China
– Zhejiang University, China
Enhanced FSRCNN for Image Super-Resolution
Ruicheng Feng – email@example.com,
Shixiang Wu, Chao Dong, Yu Qiao
Shenzhen Institute of Advanced Technology, China
Deep Laplacian Pyramid Networks with Denseblock for
Deep Networks for Image-to-image Translation with
Deep Networks for Image-to-image Translation with
Mux and Demux Layers 
Liu Hanwen – firstname.lastname@example.org,
Pablo Navarrete Michelini, Zhu Dan, Hu Fengshuo
BOE Technology Group Co., Ltd, China
Fast Perceptual Image Enhancement 
Etienne de Stoutz – email@example.com
ETH Zurich, Switzerland
Fast and Accurate DSLR-Quality Photo Enhancement
Using -inception Network
Jinghui Qin – firstname.lastname@example.org,
Yukai Shi, Wushao Wen, Liang Lin
Sun Yat-sen University, China
Efficient Perceptual Image Enhancement Network
Subeesh Vasu – email@example.com,
Nimisha Thekke Madam, Praveen Kandula,
A. N. Rajagopalan
Indian Institute of Technology Madras, India
Multiple Connected Residual Network for Image
Enhancement on Smartphones 
Jie Liu – firstname.lastname@example.org,
School of Electronic Engineering,
Xidian University, China
Agustsson, E., Timofte, R.: Ntire 2017 challenge on single image super-resolution: Dataset and study. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. vol. 3, p. 2 (2017)
Agustsson, E., Timofte, R., Van Gool, L.: Anchored regression networks applied to age estimation and super resolution. In: The IEEE International Conference on Computer Vision (ICCV) (Oct 2017)
-  Ancuti, C., Ancuti, C.O., Timofte, R.: Ntire 2018 challenge on image dehazing: Methods and results. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (June 2018)
-  Arad, B., Ben-Shahar, O., Timofte, R.: Ntire 2018 challenge on spectral reconstruction from rgb images. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (June 2018)
-  Barron, J.T.: A more general robust loss function. arXiv preprint arXiv:1701.03077 (2017)
-  Blau, Y., Mechrez, R., Timofte, R., Michaeli, T., Zelnik-Manor, L.: 2018 pirm challenge on perceptual image super-resolution. In: European Conference on Computer Vision Workshops (2018)
-  Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 3213–3223 (2016)
-  Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE transactions on pattern analysis and machine intelligence 38(2), 295–307 (2016)
-  Haris, M., Shakhnarovich, G., Ukita, N.: Deep backprojection networks for super-resolution. In: Conference on Computer Vision and Pattern Recognition (2018)
-  Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., Adam, H.: Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)
-  Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al.: Speed/accuracy trade-offs for modern convolutional object detectors. In: IEEE CVPR. vol. 4 (2017)
-  Hui, Z., Wang, X., Deng, L., Gao, X.: Perception-preserving convolutional networks for image enhancement on smartphones. In: European Conference on Computer Vision Workshops (2018)
-  Ignatov, A., Kobyshev, N., Timofte, R., Vanhoey, K., Van Gool, L.: Dslr-quality photos on mobile devices with deep convolutional networks. In: the IEEE Int. Conf. on Computer Vision (ICCV) (2017)
-  Ignatov, A., Kobyshev, N., Timofte, R., Vanhoey, K., Van Gool, L.: Wespe: weakly supervised photo enhancer for digital cameras. arXiv preprint arXiv:1709.01118 (2017)
-  Ignatov, A., Timofte, R., Szczepaniak, P., Chou, W., Wang, K., Wu, M., Hartley, T., Van Gool, L.: Ai benchmark: Running deep neural networks on android smartphones. In: European Conference on Computer Vision Workshops (2018)
-  Jolicoeur-Martineau, A.: The relativistic discriminator: a key element missing from standard gan. arXiv preprint arXiv:1807.00734 (2018)
-  Kligvasser, I., Shaham, T.R., Michaeli, T.: xunit: Learning a spatial activation function for efficient image restoration. arXiv preprint arXiv:1711.06445 (2017)
-  Lai, W.S., Huang, J.B., Ahuja, N., Yang, M.H.: Deep laplacian pyramid networks for fast and accurate superresolution. In: IEEE Conference on Computer Vision and Pattern Recognition. vol. 2, p. 5 (2017)
-  Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A.P., Tejani, A., Totz, J., Wang, Z., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: CVPR. vol. 2, p. 4 (2017)
-  Li, H., Lin, Z., Shen, X., Brandt, J., Hua, G.: A convolutional neural network cascade for face detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 5325–5334 (2015)
-  Li, L.J., Socher, R., Fei-Fei, L.: Towards total scene understanding: Classification, annotation and segmentation in an automatic framework. In: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. pp. 2036–2043. IEEE (2009)
-  Li, Y., Eirikur Agustsson, E., Gu, S., Timofte, R., Van Gool, L.: Carn: Convolutional anchored regression network for fast and accurate single image super-resolution. In: European Conference on Computer Vision Workshops (2018)
-  Liu, H., Navarrete Michelini, P., Zhu, D.: Deep networks for image to image translation with mux and demux layers. In: European Conference on Computer Vision Workshops (2018)
-  Liu, J., Jung, C.: Multiple connected residual network for image enhancement on smartphones. In: European Conference on Computer Vision Workshops (2018)
-  Pengfei, Z., Jie, H., Mingrui, G., Jiewen, R., Xingguang, Z., Chen, X., Pengfei, W., Xiangyang, J.: Range scaling global u-net for perceptual image enhancement on mobile devices. In: European Conference on Computer Vision Workshops (2018)
-  Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: A unified embedding for face recognition and clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 815–823 (2015)
-  Shi, W., Caballero, J., Huszár, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., Wang, Z.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1874–1883 (2016)
-  Shoeiby, M., Robles-Kelly, A., Timofte, R., et al.: Pirm2018 challenge on spectral image super-resolution: Methods and results. In: European Conference on Computer Vision Workshops (2018)
-  Sim, H., Ki, S., Choi, J.S., Seo, S., Kim, S., Kim, M.: High-resolution image dehazing with respect to training losses and receptive field sizes. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (June 2018)
-  de Stoutz, E., Ignatov, A., Kobyshev, N., Timofte, R., Van Gool, L.: Fast perceptual image enhancement. In: European Conference on Computer Vision Workshops (2018)
-  Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 2818–2826 (2016)
-  Timofte, R., Agustsson, E., Gool, L.V., Yang, M., Zhang, L., Lim, B., Son, S., Kim, H., Nah, S., Lee, K.M., Wang, X., Tian, Y., Yu, K., Zhang, Y., Wu, S., Dong, C., Lin, L., Qiao, Y., Loy, C.C., Bae, W., Yoo, J., Han, Y., Ye, J.C., Choi, J., Kim, M., Fan, Y., Yu, J., Han, W., Liu, D., Yu, H., Wang, Z., Shi, H., Wang, X., Huang, T.S., Chen, Y., Zhang, K., Zuo, W., Tang, Z., Luo, L., Li, S., Fu, M., Cao, L., Heng, W., Bui, G., Le, T., Duan, Y., Tao, D., Wang, R., Lin, X., Pang, J., Xu, J., Zhao, Y., Xu, X., Pan, J., Sun, D., Zhang, Y., Song, X., Dai, Y., Qin, X., Huynh, X., Guo, T., Mousavi, H.S., Vu, T.H., Monga, V., Cruz, C., Egiazarian, K., Katkovnik, V., Mehta, R., Jain, A.K., Agarwalla, A., Praveen, C.V.S., Zhou, R., Wen, H., Zhu, C., Xia, Z., Wang, Z., Guo, Q.: Ntire 2017 challenge on single image super-resolution: Methods and results. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). pp. 1110–1121 (July 2017). https://doi.org/10.1109/CVPRW.2017.149
-  Timofte, R., De Smet, V., Van Gool, L.: Anchored neighborhood regression for fast example-based super-resolution. In: The IEEE International Conference on Computer Vision (ICCV) (December 2013)
-  Timofte, R., De Smet, V., Van Gool, L.: A+: Adjusted anchored neighborhood regression for fast super-resolution. In: Asian Conference on Computer Vision. pp. 111–126. Springer (2014)
-  Timofte, R., Gu, S., Wu, J., Van Gool, L.: Ntire 2018 challenge on single image super-resolution: Methods and results. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (June 2018)
-  Van Vu, T., Van Nguyen, C., Pham, T.X., Liu, T.M., Youu, C.D.: Fast and efficient image quality enhancement via desubpixel convolutional neural networks. In: European Conference on Computer Vision Workshops (2018)
-  Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: The Thrity-Seventh Asilomar Conference on Signals, Systems Computers, 2003. vol. 2, pp. 1398–1402 Vol.2 (Nov 2003). https://doi.org/10.1109/ACSSC.2003.1292216
-  Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. IEEE Transactions on Pattern Analysis and Machine Intelligence 37(9), 1834–1848 (2015)
-  Yang, Y., Zhong, Z., Shen, T., Lin, Z.: Convolutional neural networks with alternately updated clique. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2413–2422 (2018)