super_resolution

中文 | English

This sample provides reference for you to learn the Ascend AI Software Stack and cannot be used for commercial purposes.

This README file provides only guidance for running the sample in command line (CLI) mode. For details about how to run the sample in MindStudio, see Running Image Samples in MindStudio.

Sample of Super Resolution Processing on Images

Function: Uses one of the SRCNN, FSRCNN, VDSR, and ESPCN models to perform super-resolution processing on input images.
Input: Source BMP image.
Output: PNG image with inference results.

Prerequisites

Check whether the following requirements are met. If not, perform operations according to the remarks. If the CANN version is upgraded, check whether the third-party dependencies need to be reinstalled. (The third-party dependencies for 5.0.4 and later versions are different from those for earlier versions.)

Item	Requirement	Remarks
CANN version	>=5.0.4	Install the CANN by referring to Installation in the About Ascend Samples Repository. If the CANN version is earlier than the required version, switch to the samples repository specific to the CANN version. See Release Notes.
Hardware	Atlas 200 DK/Atlas 300 (ai1s)	Currently, the Atlas 200 DK and Atlas 300 have passed the test. For details about the product description, see Hardware Platform. For other products, adaptation may be required.
Third-party dependency	opencv	For details, see Third-Party Dependency Installation Guide (C++ Sample).

Sample Preparation

1. Obtain the source package.
   You can download the source code in either of the following ways:

   • Command line (The download takes a long time, but the procedure is simple.)

     # In the development environment, run the following commands as a non-root user to download the source repository:   
     cd ${HOME}     
     git clone https://github.com/Ascend/samples.git
     

     Note: To switch to another tag (for example, v0.5.0), run the following command:

     git checkout v0.5.0
     

   • Compressed package (The download takes a short time, but the procedure is complex.)
     Note: If you want to download the code of another version, switch the branch of the samples repository according to the prerequisites.

      # 1. Click "Clone or Download" in the upper right corner of the samples repository and click "Download ZIP".   
      # 2. Upload the ZIP package to the home directory of a common user in the development environment, for example, "${HOME}/ascend-samples-master.zip".    
      # 3. In the development environment, run the following commands to unzip the package:    
      cd ${HOME}    
      unzip ascend-samples-master.zip
     

2. Convert the model.

   Model	Description	How to Obtain
   SRCNN	Super resolution inference model.	Download the model by referring to the links in README.md in the ATC_FSRCNN_caffe_AE directory of the ModelZoo repository.
   FSRCNN	Super resolution inference model.	Download the model by referring to the links in README.md in the ATC_FSRCNN_caffe_AE directory of the ModelZoo repository.
   VDSR	Super resolution inference model.	Download the model by referring to the links in README.md in the ATC_FSRCNN_caffe_AE directory of the ModelZoo repository.
   ESPCN	Super resolution inference model.	Download the model by referring to the links in README.md in the ATC_FSRCNN_caffe_AE directory of the ModelZoo repository.

   # To facilitate download, the commands for downloading the original model and converting the model are provided here. You can directly copy and run the commands. You can also refer to the above table to download the model from ModelZoo and manually convert it.  
   #The SRCNN model is used as an example.
   cd $HOME/samples/cplusplus/contrib/super_resolution/model     
   wget https://obs-9be7.obs.cn-east-2.myhuaweicloud.com/003_Atc_Models/AE/ATC%20Model/super_resolution/SRCNN/SRCNN.caffemodel
   wget https://obs-9be7.obs.cn-east-2.myhuaweicloud.com/003_Atc_Models/AE/ATC%20Model/super_resolution/SRCNN/SRCNN.prototxt
   #SRCNN model:
   atc --model=./SRCNN.prototxt --weight=./SRCNN.caffemodel --framework=0 --input_format=NCHW --input_shape="data: 1, 1, 768, 768" --output=./SRCNN_768_768 --soc_version=Ascend310 --output_type=FP32
   #FSRCNN model:
   atc --model=./FSRCNN.prototxt --weight=./FSRCNN.caffemodel --framework=0 --input_format=NCHW --input_shape="data: 1, 1, 256, 256" --output=./FSRCNN_256_256 --soc_version=Ascend310 --output_type=FP32
   #ESPCN model:
   atc --model=./ESPCN.prototxt --weight=./ESPCN.caffemodel --framework=0 --input_format=NCHW --input_shape="data: 1, 1, 256, 256" --output=./ESPCN_256_256 --soc_version=Ascend310 --output_type=FP32
   #VDSR model:
   atc --model=./VDSR.prototxt --weight=./VDSR.caffemodel --framework=0 --input_format=NCHW --input_shape="data: 1, 1, 768, 768" --output=./VDSR_768_768 --soc_version=Ascend310 --output_type=FP32
   **Ps: if the chip is 310B,please set the argument soc_version to --soc_version=Ascend310B1**
   

Sample Deployment

Run the following commands to execute the compilation script to start sample compilation:

cd $HOME/samples/cplusplus/contrib/super_resolution/scripts    
bash sample_build.sh

Sample Running

Note: If the development environment and operating environment are set up on the same server, skip step 1 and go to step 2 directly.

1. Run the following commands to upload the super_resolution directory in the development environment to any directory in the operating environment, for example, /home/HwHiAiUser, and log in to the operating environment (host) as the running user (HwHiAiUser):

   # In the following information, <xxx.xxx.xxx.xxx> is the IP address of the operating environment. The IP address of Atlas 200 DK is 192.168.1.2 when it is connected over the USB port, and that of Atlas 300 (AI1s) is the corresponding public IP address.
   scp -r $HOME/samples/cplusplus/contrib/super_resolution [email protected]:/home/HwHiAiUser   
   ssh [email protected]     
   cd $HOME/samples/cplusplus/contrib/super_resolution/scripts
   

2. Execute the script to run the sample.

   bash sample_run.sh
   

Result Viewing

After the running is complete, an inferred image is generated in the out/output directory of the sample project. The comparison is as follows:

Common Errors

For details about how to rectify the errors, see Troubleshooting. If an error is not included in Wiki, submit an issue to the samples repository.