SupportDocumentationAscend ComputingSolutions and SoftwareAscend Inference SolutionInstallation & UpgradeSoftware Deployment Guide

Atlas 800 Inference Server (Model 3000) 23.0.0 Ascend Software Installation Guide 01

Ascend Deployer Installation and Software Package Preparation

Ascend Deployer Installation and Software Package Preparation

Before installing the Ascend software, install related system dependencies on the training server. Select the following installation mode based on whether the onsite training server can connect to the external network.

  • Offline Installation: If the onsite server is not connected to the external network, download Ascend Deployer on the PC and use the tool to download and install dependencies.
  • Online Installation: Install Ascend Deployer on the training server that can connect to the external network and use the tool to pull and install dependencies online.

Offline Installation

  1. Decompress Ascend Deployer obtained in Software Download to a local folder and obtain the ascend-deployer-5.0.0 directory.
  2. Download Python since Python 3 is required in the Windows environment. Python 3.7 or later is recommended. If it has been installed, skip this step.

    Download link (example): Python3.7.5. Complete the installation as prompted.

    1. Double-click the .exe installation package. The installation page is displayed.
      Select Add Python3.7 to PATH to add Python environment variables and click Customize installation, as shown in Figure 2-4.
      Figure 2-4 Python installation page
    2. In the custom installation window shown in Figure 2-5, click Next.
      Figure 2-5 Custom installation
    3. The Advanced Options window is displayed, as shown in Figure 2-6.
      Select Add Python to environment variables, customize the installation path, and click Install.
      Figure 2-6 Custom installation path
    4. After the installation is successful, click Disable path length limit to disable the path length limit, and then click Close, as shown in Figure 2-7.
      Figure 2-7 Successful installation
    5. Check whether the Python installation is successful.
      1. Go to the Python installation path. See Figure 2-8.
        Figure 2-8 Python installation path
      2. Enter cmd in the installation path and press Enter to display the CLI screen. See Figure 2-9.
        Figure 2-9 Run cmd.
      3. On the CLI shown in Figure 2-10, run the python -V command. If the Python version is displayed, the installation is successful.
        Figure 2-10 Viewing the Python version

  3. Double-click start_download_ui.bat in the ascend-deployer-5.0.0 directory.

    On the pop-up simple UI, select only the OS (for example, CentOS 7.6) of the target device to download system dependencies. Do not select software (PKG_LIST) on the right pane and directly click Start Download. See Figure 2-11.

    For Kylin V10SP1, set this parameter to Kylin_V10Tercel_aarch64.

    Specify Kylin_V10Sword_aarch64 as the system dependency for the Kylin V10 SP2 system.

    Figure 2-11 Downloading the Docker software and system dependencies

    If information similar to the following is displayed, the download is complete.

  4. Save the NPU driver and firmware and CANN packages downloaded from Software Download to the ascend-deployer-5.0.0/ascend_deployer/resources directory.

    The content of the resources folder is as follows (CentOS 7.6 is used as an example):
    resources 
├─ Ascend-hdk-xxx-npu-driver_23.0.1_linux-aarch64.run
├─ Ascend-hdk-xxx-npu-firmware_7.1.0.4.220.run
├─ Ascend-cann-toolkit_7.0.1_linux-aarch64.run
├─ Ascend-cann-kernels-xxx_7.0.1_linux.run
├─ CentOS_7.6_aarch64
├─ nexus
├─ pylibs
└─ sources

    The installation packages are verified during software deployment. Therefore, do not add other software installation packages to the resources folder.

  5. Compress the ascend-deployer-5.0.0 directory into a .zip package, upload the package to any directory (for example, /home) on the server. Run the unzip ascend-deployer-5.0.0.zip command to decompress the package to obtain the ascend-deployer-5.0.0 directory.

Online Installation

  1. Log in to the server as the root user and ensure that the server can connect to external networks so that Ascend Deployer can download the system dependencies.
  2. Upload Ascend Deployer obtained in Software Download to any directory (for example, /home) on the server and run the unzip ascend-deployer-5.0.0.zip command to decompress the package to obtain the ascend-deployer-5.0.0 directory.
  3. Ensure that Python3 has been installed on the server. You can run the python3 -V command to query the installation. If Python3 has not been installed, run the following commands to install it (Ubuntu and CentOS are used as examples).

    • Ubuntu
      apt-get install -y python3
    • CentOS
      yum install -y python3

  4. Go to the /home/ascend-deployer-5.0.0/ascend_deployer directory and run the following command to download the system dependency:

    bash start_download.sh --os-list=<OS>

    You can run the bash start_download.sh --help command to check the value range of <OS>. For details about the parameters, see Table 2-22.

    Example:
    bash start_download.sh --os-list=CentOS_7.6_aarch64
    Table 2-22 Parameters

    Parameter

    Description

    --os-list=<OS>

    --os-list specifies the OS of the target device. You can configure one or more OSs as required. Example:

    --os-list=Ubuntu_20.04_aarch64,CentOS_7.6_aarch64

    For Kylin V10SP1, set this parameter to Kylin_V10Tercel_aarch64.

    Specify Kylin_V10Sword_aarch64 as the system dependency for the Kylin V10 SP2 system.

  5. Upload the NPU driver and firmware and CANN packages downloaded from Software Download to the ascend-deployer-5.0.0/ascend_deployer/resources directory on the server.

    The content of the resources folder is as follows (CentOS 7.6 is used as an example):
    resources 
├─ Ascend-hdk-xxx-npu-driver_23.0.1_linux-aarch64.run
├─ Ascend-hdk-xxx-npu-firmware_7.1.0.4.220.run
├─ Ascend-cann-toolkit_7.0.1_linux-aarch64.run
├─ Ascend-cann-kernels-xxx_7.0.1_linux.run
├─ CentOS_7.6_aarch64
├─ nexus
├─ pylibs
└─ sources

    The installation packages are verified during software deployment. Therefore, do not add other software installation packages to the resources folder.