Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[chassis] Converting a replaced wolverine linecard does not enable macsec #107

Closed
arlakshm opened this issue Nov 6, 2024 · 3 comments
Closed

[chassis] Converting a replaced wolverine linecard does not enable macsec #107

arlakshm opened this issue Nov 6, 2024 · 3 comments
Assignees
@patrickmacarthur

Comments

@arlakshm
Copy link

arlakshm commented Nov 6, 2024

I used the script chassis-eos2sonic.py I followed the following steps

  • power-off the linecard

  • copy the image, minigraph and firmware packages in the /tmp/provision-artifacts on the suprrvisor

admin@str3-7808-sup-1:~$ ls /tmp/provision-artifacts/
arista-fwpkg-dpe-good-7800R3AK-36DM2-LC.tar.gz  minigraph-lc04.xml  sonic.swi
  • I start the script to convert lc4 with this command.

sudo /host/chassis-eos2sonic.py install-local -l 4

  • I can see that the firmware packages are getting downloaded`
 
Shell> fs0:
FS0:\> Aboot-k.efi initrd=\Aboot-i.nsh console=ttyS0,9600
POSTCODE=<A6>
POSTCODE=<A7>
[    4.415459] Running e2fsck on: /mnt/flash
[    5.031363] e2fsck on /mnt/flash took 0s

Aboot 10.0.2-26144132
Loading AUF data

Provision mode is 1, attempting static provisionning...
Configuring management network...
ma1.42 IP = 127.100.4.1/16, GW = 127.100.1.1, MAC = cc:1a:a3:f2:2b:2f
Downloading Manifest file (http://127.100.1.1:12321/provision/manifest?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f)...
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
tmp.fMMreM           100% |********************************|  1078  0:00:00 ETA
Wiping /mnt/flash...
Dowloading http://127.100.1.1:12321/provision/minigraph.xml?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/minigraph.xml
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
minigraph.xml        100% |********************************|  187k  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/sonic.swi?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/sonic.swi
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
sonic.swi            100% |********************************|  996M  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC.tar.gz?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC.tar.gz
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
arista-fwpkg-dpe-goo 100% |********************************|  394k  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/.provision?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/.provision
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
Dowloading http://127.100.1.1:12321/provision/do-not-clean?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/do-not-clean
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
Dowloading http://127.100.1.1:12321/provision/boot-config?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/boot-config
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
boot-config          100% |********************************|    20  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC/wolverine_scd_02_06_dpe.abit?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC/wolverine_scd_02_06_dpe.abit
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
wolverine_scd_02_06_ 100% |********************************| 1313k  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC/platform_components.json?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC/platform_components.json
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
platform_components. 100% |********************************|   459  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC/metadata.json?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/arista-fwpkg-dpe-good-7800R3AK-36DM2-LC/metadata.json
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
metadata.json        100% |********************************|    86  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/firmware-update/manifest.json?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/firmware-update/manifest.json
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
manifest.json        100% |********************************|   143  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/firmware-update/clearwater2_scd_10_15.abit?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/firmware-update/clearwater2_scd_10_15.abit
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
clearwater2_scd_10_1 100% |********************************| 2133k  0:00:00 ETA
Dowloading http://127.100.1.1:12321/provision/firmware-update/wolverine_scd_02_06_dpe.abit?slotId=4&serial=SGD232207JY&mac=cc:1a:a3:f2:2b:2f to /mnt/flash/firmware-update/wolverine_scd_02_06_dpe.abit
Connecting to 127.100.1.1:12321 (127.100.1.1:12321)
wolverine_scd_02_06_ 100% |********************************| 1313k  0:00:00 ETA
Provisionning completed with success
Press Control-C now to enter Aboot shell
Booting flash:sonic.swi
Secure Boot disabled, skipping check
Enabling SPI flash write protection
31.74: Generating boot-config, machine.conf and cmdline
31.82: Installing image under /mnt/flash/image-20240531.10
31.82: Moving swi to a tmpfs
35.33: Extracting swi content
36.47: Extracting platform.tar.gz
36.52: Extracting dockerfs.tar.gz from swi
70.95: Remove installer
74.67: Next reboot will use flash:image-20240531.10/.sonic-boot.swi
75.02: Kexecing...
[   75.516695] kexec_core: Starting new kernel
tune2fs 1.47.0 (5-Feb-2023)
Setting reserved blocks percentage to 0% (0 blocks)
Setting reserved blocks count to 0
[    7.471395] ccp 0000:11:00.2: firmware: failed to load amd/amd_sev_fam17h_model01h.sbin (-2)
[    7.497687] firmware_class: See https://wiki.debian.org/Firmware for information about missing firmware
[    7.550262] ccp 0000:11:00.2: firmware: failed to load amd/amd_sev_fam17h_model01h.sbin (-2)
[    7.629907] snd_hda_intel 0000:12:00.3: no codecs found!
[    8.986458] ccp 0000:11:00.2: SEV: failed to INIT error 0x13, rc -5
[    9.021643] kvm: support for 'kvm_amd' disabled by bios
[    9.145741] kdump-tools[762]: Starting kdump-tools:
[    9.215846] kdump-tools[766]: no crashkernel= parameter in the kernel cmdline ... failed!
[    9.328398] rc.local[800]: + cat /etc/sonic/sonic_version.yml
[    9.408512] rc.local[801]: + grep build_version
[    9.472810] rc.local[802]: + sed -e s/build_version: //g;s/'//g
[    9.565758] rc.local[796]: + SONIC_VERSION=20240531.10
[    9.640126] rc.local[796]: + FIRST_BOOT_FILE=/host/image-20240531.10/platform/firsttime
[    9.748151] rc.local[796]: + SONIC_CONFIG_DIR=/host/image-20240531.10/sonic-config
[    9.844176] rc.local[796]: + SONIC_ENV_FILE=/host/image-20240531.10/sonic-config/sonic-environment
[    9.960124] rc.local[796]: + [ -d /host/image-20240531.10/sonic-config -a -f /host/image-20240531.10/sonic-config/sonic-environment ]
[   10.112128] rc.local[796]: + logger SONiC version 20240531.10 starting up...
[   10.208095] rc.local[796]: + grub_installation_needed=
[   10.276114] rc.local[796]: + [ ! -e /host/machine.conf ]
[   10.352088] rc.local[796]: + . /host/machine.conf
[   10.416068] rc.local[796]: + aboot_version=Aboot-norcal10-10.0.2-26144132
[   10.504133] rc.local[796]: + aboot_vendor=arista
[   10.568243] rc.local[796]: + aboot_platform=x86_64-arista_7800r3ak_36dm2_lc
[   10.660163] rc.local[796]: + aboot_machine=arista_7800r3ak_36dm2_lc
[   10.744133] rc.local[796]: + aboot_arch=x86_64
[   10.804118] rc.local[796]: + aboot_build_date=1970-01-01T00:00:00.000000000
[   10.896119] rc.local[796]: + program_console_speed
[   10.964197] rc.local[812]: + grep -Eo console=tty(S|AMA)[0-9]+,[0-9]+
[   11.049406] rc.local[811]: + cat /proc/cmdline
[   11.109061] rc.local[816]: + cut -d , -f2
[   11.165548] rc.local[796]: + speed=9600
[   11.220107] rc.local[796]: + [ -z 9600 ]
[   11.276127] rc.local[796]: + CONSOLE_SPEED=9600
[   11.373273] rc.local[818]: + grep agetty /lib/systemd/system/[email protected]
[   11.472513] rc.local[819]: + grep keep-baud
[   11.528112] rc.local[819]: ExecStart=-/sbin/agetty -o '-p -- \\u' --keep-baud 115200,57600,38400,9600 - $TERM
[   11.656972] rc.local[796]: + [ 0 = 0 ]
[   11.708114] rc.local[796]: + sed -i s|\-\-keep\-baud .* %I| 9600 %I|g /lib/systemd/system/[email protected]
[   11.836124] rc.local[796]: + systemctl daemon-reload
[   11.904121] rc.local[796]: + [ -f /host/image-20240531.10/platform/firsttime ]
[   11.996115] rc.local[796]: + echo First boot detected. Performing first boot tasks...
[   12.096113] rc.local[796]: First boot detected. Performing first boot tasks...
[   12.188150] rc.local[796]: + [ -n x86_64-arista_7800r3ak_36dm2_lc ]
[   12.272116] rc.local[796]: + platform=x86_64-arista_7800r3ak_36dm2_lc
[   12.356110] rc.local[796]: + [ -d /host/old_config ]
[   12.418315] arista: waiting for switch chip
[   12.468111] rc.local[796]: + [ -f /host/minigraph.xml ]
[   12.536111] rc.local[796]: + mkdir -p /etc/sonic/old_config
[   12.608111] rc.local[796]: + mv /host/minigraph.xml /etc/sonic/old_config/
[   12.696255] rc.local[796]: + [ -f /host/acl.json ]
[   12.760096] rc.local[796]: + [ -f /host/port_config.json ]
[   12.832095] rc.local[796]: + [ -f /host/snmp.yml ]
[   12.896111] rc.local[796]: + [ -f /host/golden_config_db.json ]
[   12.976108] rc.local[796]: + touch /tmp/pending_config_migration
[   13.056109] rc.local[796]: + touch /tmp/notify_firstboot_to_platform
[   13.140104] rc.local[796]: + [ ! -d /host/reboot-cause/platform ]
[   13.220106] rc.local[796]: + mkdir -p /host/reboot-cause/platform
[   13.300105] rc.local[796]: + [ -d /host/image-20240531.10/platform/x86_64-arista_7800r3ak_36dm2_lc ]
[   13.416113] rc.local[796]: + sync
[   13.464124] rc.local[796]: + [ -n  ]
[   13.512105] rc.local[796]: + mkdir -p /var/platform
[   13.576105] rc.local[796]: + [ -f /etc/default/kdump-tools ]
[   13.652151] rc.local[796]: + sed -i -e s/__PLATFORM__/x86_64-arista_7800r3ak_36dm2_lc/g /etc/default/kdump-tools
[   13.780262] rc.local[796]: + firsttime_exit[   13.809071] arista: switch chip is ready
[   13.884115] rc.local[796]: + rm -rf /host/image-20240531.10/platform/firsttime
[   13.976108] rc.local[796]: + exit 0
Debian GNU/Linux 12 sonic ttyS0
sonic login: [   15.854848] arista: yielding...
[   15.881368] arista: waiting for switch chip
[   15.917973] arista: switch chip is ready
[   17.967903] arista: yielding...
str3-7800-lc4-1 login: admin
  • but I still see the macsec is not enabled
2024 Nov  6 00:09:47.284650 str3-7800-lc4-1 INFO swss0#supervisord 2024-11-06 00:09:47,284 INFO exited: swssconfig (exit status 0; expected)
2024 Nov  6 00:09:47.558036 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:_soc_cmicx_schan_err_handle:   block timeout: ERRBIT received in CMIC_SCHAN_ERR.#015
2024 Nov  6 00:09:47.558036 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:_soc_cmicx_schan_err_handle: CMIC_SCHAN_ERR data dump: err_code=0, data_len=4, src_port=32, dst_port=3,op_code=12 Full reg value=0x30380240#015
2024 Nov  6 00:09:47.558104 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:soc_schan_timeout_check: soc_schan_op: operation attempt timed out#015
2024 Nov  6 00:09:47.558104 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:_soc_cmicx_schan_wait: soc_cmicx_schan_op operation timed out#015
2024 Nov  6 00:09:47.558123 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:soc_schan_dump:   HDR[NACK=0 BANK=0 DMA=0 ECODE=0 ERR=0 DLEN=4 ACC=0 DPORT=93 BLOCKID=1488 OPC=11=READ_REG_CMD]#015
2024 Nov  6 00:09:47.558136 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:soc_schan_dump:   DW[ 0]=0x2ee80200 DW[ 1]=0x02220700#015
2024 Nov  6 00:09:47.558155 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:_soc_cmicx_schan_op: operation (0xb) timed out channel=0#015
2024 Nov  6 00:09:47.558155 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:soc_reg_get: soc_reg_get failed for MACSEC_MACSEC_HW_RESET_CONTROL#015
2024 Nov  6 00:09:47.558173 str3-7800-lc4-1 INFO syncd1#supervisord: syncd #015#015
2024 Nov  6 00:09:47.558296 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:dbal_hl_register_read_per_access:  Error: Operation timed out ; Failed reading register MACSEC_MACSEC_HW_RESET_CONTROL port=0 arr_ind=0#015#015
2024 Nov  6 00:09:47.558393 str3-7800-lc4-1 INFO syncd1#supervisord: syncd 0:dbal_hl_register_set:  Error 'Operation timed out' indicated ; #015#015

I see this on the wolverine LC

admin@str3-7800-lc4-1:~$ cat /host/firmware-update/manifest.json

{

    "Scd(addr=0000:08:00.0)": {

        "firmware": "/host/firmware-update/wolverine_scd_02_06_dpe.abit",

        "status": "pending"

    }

}admin@str3-7800-lc4-1:~$

admin@str3-7800-lc4-1:~$ ls /host/firmware-update/
clearwater2_scd_10_15.abit  manifest.json  wolverine_scd_02_06_dpe.abit
admin@str3-7800-lc4-1:~$
@arlakshm
Copy link
Author

arlakshm commented Nov 6, 2024 •
edited
Loading

After installing the packages manually using arista-fwutil the macsec engine is enabled and LC comes up.

admin@str3-7800-lc4-1:~$ sudo arista-fwutil update
INFO: Scd(addr=0000:08:00.0): current version 0x20001
INFO: Scd(addr=0000:08:00.0): upgrading to version 0x20106
[1] Sanitizing
[1] Sanitizing done
[1] Chip Identification: mfr=0x000000c8, memType=00000040, memCapacity=00000015
[1] Chip info: numSectors=32,numPagesPerSector=256,numBytesPerPage=256
[1] FileSize=1344894 bytes
[1] Reading: startSector:0, opSectors:32
[2] Value read from address 0x1ffff8 is : 0xde
[2] Value read from address 0x1ffff9 is : 0xad
[2] Value read from address 0x1ffffa is : 0xbe
[2] Value read from address 0x1ffffb is : 0xef
[2] Value read from address 0x1ffffc is : 0x0
[2] Value read from address 0x1ffffd is : 0x0
[2] Value read from address 0x1ffffe is : 0x0
[2] Value read from address 0x1fffff is : 0x15
[1] MagicNumber: 0xdeadbeef
[1] NumSectorsToErase: 0x00000015
[1] Erasing 21 sectors
[1] Starting Page Programming
[1] Writing 21 in last four bytes
[1] startSector:0, opSectors:32
[1] Programming done.
INFO: Scd(addr=0000:08:00.0): upgraded to version 0x20106
INFO: Upgrade requires a powercycle, doing it now

@patrickmacarthur
Copy link
Contributor

The arista-fwutil package is required to be present in order to install firmware updates, but if the arista-fwutil package and the firmware images are present then the firmware update should be automatically scheduled to happen on the next reboot.

@kenneth-arista
Copy link

Closing since we understand arista-fwutil is needed for this workflow to succeed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@patrickmacarthur patrickmacarthur

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@patrickmacarthur @arlakshm @kenneth-arista