Brain MRT image super resolution using discrete cosine transform and convolutional neural network

High Resolution (HR) images have numerous applications, such as video conferencing, remote sensing, medical imaging, etc. Furthermore, a few challenges with the super resolution algorithms of magnetic resonance brain images are now obtainable, namely, low sensitivity, signifcant frequency noise as well as poor resolution. To fx these problems, a Convolutional Neural Network (CNN) based Discrete Cosine Transform (DCT) singular frame quality improvement method is described. There are two stages in this proposed method, involving training and testing. During the training stage, the HR, and Low Resolution (LR) pictures are employed as input, and they are preprocessed to create blocks of images. The histogram and DCT are used for extracting the features from the LR and HR blocks, and these extracted features are assigned with class id. The CNN, which extracts the features and allocates class id, receives its feature extractor as its fnal input. An LR input image is once more divided into [2 × 2] blocks during the testing stage, so each block histogram and DCT feature are estimated. Each feature vector is fed into the neural network as well as the results are contrasted with a set of feature vectors that have been recorded, in addition to the class id that has been allocated to a certain vector. In order to generate a Super resolution image with an LR image, a relevant HR block is then swapped out for this LR block. These results indicated that the initial dataset can achieve 22.4 and 19.5 Peak Signal to Noise Ratio (PSNR) and Root Mean Square Error (RMSE) values while measuring the effectiveness of this proposed method using RMSE and PSNR. Then, the second dataset illustrates that the PSNR and RMSE values are 20.1 and 25.5. For the third dataset, the values are 45.7 and 12.3, respectively. However, the presented method works better than the neural method of Super Resolution Channel Spatial Modulation Network and resolution enhancement technique.

1. Chen Q., Huang J., Feris R., Brown L.M., Dong J., Yan S. Deep domain adaptation for describing people based on fne-grained clothing attributes. Proc. of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 5315–5324. https://doi.org/10.1109/cvpr.2015.7299169

2. Denton E.L., Chintala S., Fergus R. Deep generative image models using a Laplacian pyramid of adversarial networks. Advances in Neural Information Processing Systems, 2015, vol. 28.

3. Cui Z., Chang H., Shan S., Zhong B., Chen X. Deep network cascade for image super-resolution. Lecture Notes in Computer Science, 2014, vol. 8693, pp. 49–64. https://doi.org/10.1007/978-3-319-10602-1_4

4. Farhadifard F., Abar E., Nazzal M., Ozkaramanh H. Single image super resolution based on sparse representation via directionally structured dictionaries. Proc. of the 22nd Signal Processing and Communications Applications Conference (SIU), IEEE, 2014, pp. 1718–1721. https://doi.org/10.1109/siu.2014.6830580

5. Ahmed J., Memon R.A., Waqas M., Mangrio M.I., Ali S. Selective sparse coding based coupled dictionary learning algorithm for single image super-resolution. Proc. of the 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET), 2018, pp. 1–5. https://doi.org/10.1109/icomet.2018.8346357

6. Choi J.H., Kim J.H., Cheon M., Lee J.S. Deep learning-based image super-resolution considering quantitative and perceptual quality. Neurocomputing, 2020, vol. 398, pp. 347–59. https://doi.org/10.1016/j.neucom.2019.06.103

7. Dong C., Loy C.C., He K., Tang X. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, vol. 38, no. 2, pp. 295–307. https://doi.org/10.1109/TPAMI.2015.2439281

8. Dong C., Loy C.C., Tang X. Accelerating the super-resolution convolutional neural network. Lecture Notes in Computer Science, 2016, vol. 9906, pp. 391–407. https://doi.org/10.1007/978-3-319-46475-6_25

9. Ayas S., Ekinci M. Single image super resolution using dictionary learning and sparse coding with multi-scale and multi-directional Gabor feature representation. Information Sciences, 2020, vol. 512, pp. 1264–1278. https://doi.org/10.1016/j.ins.2019.10.040

10. Gu S., Zuo W., Xie Q., Meng D., Feng X., Zhang L. Convolutional sparse coding for image super-resolution. Proc. of the IEEE International Conference on Computer Vision (ICCV), 2015, pp. 1823–1831. https://doi.org/10.1109/iccv.2015.212

11. Dosovitskiy A., Springenberg J.T., Brox T. Learning to generate chairs with convolutional neural networks. Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 1538–1546. https://doi.org/10.1109/cvpr.2015.7298761

12. Mathieu M., Couprie C., LeCun Y. Deep multi-scale video prediction beyond mean square error. Proc. of the 4th International Conference on Learning Representations (ICLR), 2016.

13. Alec R., Luke M., Soumith C. Unsupervised representation learning with deep convolutional generative adversarial networks. Proc. of the International Conference on Learning Representations (ICLR), 2015, pp. 1–16.

14. Dong C., Loy C.C., He K., Tang X. Learning a deep convolutional network for image super-resolution. Lecture Notes in Computer Science, 2014, vol. 8692, pp. 184–199. https://doi.org/10.1007/978-3-319-10593-2_13

15. Aharon M., Elad M., Bruckstein A. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing, 2006, vol. 54, no. 11, pp. 4311– 4322. https://doi.org/10.1109/tsp.2006.881199

16. Rueda A., Malpica N., Romero E. Single-image super-resolution of brain MR images using overcomplete dictionaries. Medical Image Analysis, 2013, vol. 17, no. 1, pp. 113–132. https://doi.org/10.1016/j.media.2012.09.003

17. Wang H., Jiang K. Research on image super-resolution reconstruction based on transformer. Proc. of the 2021 IEEE International Conference on Artifcial Intelligence and Industrial Design (AIID), 2021, pp. 226–230. https://doi.org/10.1109/aiid51893.2021.9456580

18. Liu H., Guo Q., Wang G., Gupta B.B., Zhang C. Medical image resolution enhancement for healthcare using nonlocal self-similarity and low-rank prior. Multimedia Tools and Applications, 2019, vol. 78, no. 7, pp. 9033–9050. https://doi.org/10.1007/s11042-017-5277-6

19. Liu J., Malekzadeh M., Mirian N., Song T.A., Liu C., Dutta J. Artifcial intelligence-based image enhancement in PET imaging: Noise reduction and resolution enhancement. PET Clinics, 2021, vol. 16, no. 4, pp. 553–576. https://doi.org/10.1016/j.cpet.2021.06.005

20. Dabbaghchian S., Ghaemmaghami M.P., Aghagolzadeh A. Feature extraction using discrete cosine transform and discrimination power analysis with a face recognition technology. Pattern Recognition, 2010, vol. 43, no. 4, pp. 1431–1440. https://doi.org/10.1016/j.patcog.2009.11.001

21. Liew W.S., Tang T.B., Lin C.H., Lu C.K. Automatic colonic polyp detection using integration of modifed deep residual convolutional neural network and ensemble learning approaches. Computer Methods and Programs in Biomedicine, 2021, vol. 206, pp. 106114. https://doi.org/10.1016/j.cmpb.2021.106114

22. Timofte R., De V., Van Gool L. Anchored neighborhood regression for fast example-based super-resolution. Proc. of the IEEE International Conference on Computer Vision, 2013, pp. 1920–1927. https://doi.org/10.1109/iccv.2013.241

23. Haris M., Shakhnarovich G., Ukita N. Deep back-projectinetworks for single image super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, vol. 43, no. 12, pp. 4323– 4337. https://doi.org/10.1109/tpami.2020.3002836

24. Niu B., Wen W., Ren W., Zhang X., Yang L., Wang S., Zhang K., Cao X., Shen H. Single image super-resolution via a holistic attention network. Lecture Notes in Computer Science, 2020, vol. 12357, pp. 191–207. https://doi.org/10.1007/978-3-030-58610-2_12

25. Lan R., Sun L., Liu Z., Lu H., Pang C., Luo X. MADNet: a fast and lightweight network for single-image super resolution. IEEE Transactions on Cybernetics, 2021, vol. 51, no. 3, pp. 1443–1453. https://doi.org/10.1109/tcyb.2020.2970104