Infiniband Switch upgrades

Upgrade the Switch Firmware (CLI)

1. 1. Consider your first step:
      • If you are upgrading or downgrading from firmware version 2.0 or newer, go to Step 2.
      • If you are upgrading or downgrading from a firmware version earlier than 2.0, go to Step 5.

1. 1. Open an SSH session as user ilom-admin and connect to the management controller by specifying the controller’s host name.For example:

      % ssh -l ilom-admin switch_name
      ilom-admin@switch_name's password: password
      ->

      where switch_name is the host name of the management controller. Initially, the password is ilom-admin.

1. 1. If the Subnet Manager is running on the management controller, disable the Subnet Manager.

      -> show /SYS/Fabric_Mgmt
      NOTE: show on Fabric_Mgmt will launch a restricted Linux shell.
           User can execute switch diagnosis, SM Configuration and IB
           monitoring commands in the shell. To view the list of commands,
           use "help" at rsh prompt.
      
           Use exit command at rsh prompt to revert back to
           ILOM shell.
      
      FabMan@switch_name->disablesm
      Stopping partitiond-daemon.                                [  OK  ]
      Stopping IB Subnet Manager..                               [  OK  ]
      FabMan@switch_name->exit
      exit
      ->

1. 1. Go to Step 11.

1. 1. Open an SSH session as user root and connect to the management controller by specifying the controller’s host name.

      % ssh -l root switch_name
      root@switch_name's password: password
      #

      where switch_name is the host name of the management controller. Initially, the password is changeme.

1. 1. If the Subnet Manager is running on the management controller, disable the Subnet Manager.

      # disablesm
      Stopping partitiond daemon.                                [  OK  ]
      Stopping IB Subnet Manager..                               [  OK  ]
      #

1. 1. Verify that there is at least 80 MB available in the / filesystem.

      # df -h /
      Filesystem            Size   Used   Avail  Use%  Mounted on
      /dev/hda2             471M   276M   172M   62%   /
      #

      In this example, there are 172 MB available. If not enough space is available, you must delete or move files from the / filesystem.

1. 1. Verify that there is at least 120 MB available in the /tmp directory.

      # df -h /tmp
      Filesystem            Size   Used  Avail  Use%  Mounted on
      tmpfs                 250M   240K  249M   1%    /tmp
      #

      In this example, there are 249 MB available. If not enough space is available, you must delete files from the /tmp directory.

1. 1. Verify that there is at least 120 MB free memory available.

      # free -m
                               total      used       free     shared    buffers    cached
      Mem:                     498        104        393      0         12         47
      -/+ buffers/cache:       45         453
      Swap:                    0          0          0
      #

      In the -/+ buffers/cache: row of the free column, there should be at least 120 MB free memory. In this example, there are 453 MB available. If not enough memory is available, you must exit nonessential applications that are running.

1. 1. Start the Oracle ILOM shell.

      # spsh
      Oracle(R) Integrated Lights Out Manager
      Version ILOM 3.0 r47111
      Copyright (c) 2010, Oracle and/or its affiliates. All rights reserved.
      ->

      You are now in the Oracle ILOM shell.

      You can use the exit command to return to the Linux shell.

1. 1. Begin the upgrade process.

      -> load -source URI/pkgname

      where:

      • URI is the uniform resource indicator for the host where the switch firmware package is located. The FTP and HTTP protocols are supported. If you are upgrading from firmware 2.1.2-2 or newer, the TFTP protocol is also supported.
      • pkgname is the name of the firmware package in the transfer directory.

      For example, using the HTTP protocol:

      -> load -source http://123.45.67.89/tmp/sundcs_36p_repository_2.1.9_1.pkg
      Downloading firmware image. This will take a few minutes.

      ---

      Note –  If you are experiencing version number contention, you can use the –force option to disable version number checking, and force the upgrade.

      ---

      The firmware is downloaded. The upgrade begins. A caution is displayed and you are asked to commit to the upgrade.

      NOTE: Firmware upgrade will upgrade the SUN DCS 36p firmware. ILOM will enter a special mode to load
      new firmware. No other tasks should be performed in ILOM until the firmware upgrade is complete.
      
      Subnet manager is running on the switch. Proceeding with installation will stop it.
      Are you sure you want to load the specified file (y/n)?

1. 1. Answer y to the prompt to commit to the upgrade.The upgrade begins.

      Setting up environment for firmware upgrade. This will take few minutes.
      Subnet manager has been temporarily disabled on this switch so that firmware upgrade can go on. After the
      upgrade is done, please make sure that the SM is running again, using commands sminfo and enablesm.
      Starting SUN DCS 36p FW update
      ========================== 
      Performing operation: I4 A 
      ========================== 
      I4 A: I4 is already at the given version. 
      =========================== 
      Summary of Firmware update 
      =========================== 
      I4 status                :  FW UPDATE - SUCCESS 
      I4 update succeeded on   :  none 
      I4 already up-to-date on :  A 
      I4 update failed on      :  none 
      ========================================= 
      Performing operation: SUN DCS 36p firmware update 
      ========================================= 
      SUN DCS 36p fw upgrade from 2.1.6-2 to 2.1.9-1: 
      Upgrade started... 
      Upgrade completed. 
      INFO: SUN DCS 36p fw upgrade from 2.1.6-2 to 2.1.9-1 succeeded 
       
      Post-install checks started... 
      Post-install checks completed. 
      Firmware update is complete. 
      ILOM will be restarted and will take 2 minutes to come up. 
      You will need to reconnect to Integrated Lights Out Manager. 
       
      Stopping any already executing ILOM daemons 
      Starting event manager 
      Starting log manager 
      Starting ILOM IPMI stack 
      Started ILOM IPMI stack 
      Starting lumain 
      Starting luproxy 
      Starting ealertd 
      Starting web server 
      Starting SNMP 
      Terminated 
      #

1. 1. Exit the Oracle ILOM CLI shell.

      -> exit
      exit
      #

1. 1. Restart the switch to enable the new firmware.

      -> reset /SP
      Are you sure you want to reset /SP (y/n)? y
      Performing reset on /SP
      Broadcast message from root (Thu Mar 16 14:00:34 2017):
      The system is going down for reboot NOW! 
      -> Connection to switch_name closed by remote host.
      Connection to switch_name closed.

      ---

      Note –  The restart process takes between 4 to 5 minutes to complete. The Oracle ILOM stack requires at least 2 minutes to become operational after a reboot.

      ---

1. 1. If the Subnet Manager was previously disabled, log in as the root user and enable the Subnet Manager.

      % ssh -l root switch_name
      root@switch_name's password: password
      # enablesm
      Starting IB Subnet Manager.                                [  OK  ]
      Starting partitiond daemon.                                [  OK  ]
      #

1. 1. Verify the firmware version.

      # version
      SUN DCS 36p version: 2.1.9-1 
      Build time: Jan 12 2017 09:16:51
      SP board info:
      Manufacturing Date: 2013.08.13 
      Serial Number: "NCDA00732" 
      Hardware Revision: 0x0007 
      Firmware Revision: 0x0102
      BIOS version: SUN0R100 
      BIOS date: 06/22/2010#

      In the first line of the output is SUN DCS 36p version x.y.z-w, where x.y.z–w is the version of the firmware upgraded (or downgraded). For example, 2.1.9-1.

1. Verify the firmware integrity.

   # fwverify
   Checking all present packages:
   ........................................................................... OK
   Checking if any packages are missing:
   ........................................................................... OK
   Verifying installed files:
   ........................................................................... OK
   Checking FW Coreswitch:
    FW Version: 7.4.3002 OK 
    PSID: SUN_NM2-36p_004 OK 
    Verifying image integrity OK#