Broadcom
Jump to navigation
Jump to search
Problems arise with Proxmox 8.2 and Broadcom NICs because of a buggy kernel module for RoCE.
Symptoms
Delayed boot
Networking needs to be restarted after boot
Delayed shutdown/reboot
Example of boot messages:
Job ifupdown2-pre.service start running (3min)
infiniband bnxt_re1: Failed to modify HW QP
infiniband bnxt_re1: Couldn't change QP1 state to INIT
infiniband bnxt_re1: Couldn't start port
Solution(s)
Update firmware on all interfaces with NICCLI (downloadable from Broadcom website):
./niccli -i 1 install -online
Blacklist the offending module:
echo "blacklist bnxt_re" >> /etc/modprobe.d/blacklist-bnxt_re.conf
update-initramfs -u