Calico node CrashLoopBackOff after I added a node to the cluster in Kubespray release-2.28

[PhirakbotDiff]

What happened?

After I added a node to the cluster successfully. The new calico node of the node is CrashLoopBackOff.

kube describe calico node:
Back-off restarting failed container calico-node in pod calico-node-mxlr5_kube-system

kube logs calico node:

Defaulted container "calico-node" out of: calico-node, upgrade-ipam (init), install-cni (init), mount-bpffs (init)
Error from server: Get "https://ip-xxx:10250/containerLogs/kube-system/calico-node-mxlr5/calico-node": dial tcp ip-xxx:10250: i/o timeout

What did you expect to happen?

Calico Node is running as usual

How can we reproduce it (as minimally and precisely as possible)?

Add a new node to the cluster

OS

Ubuntu 24

Version of Ansible

ansible [core 2.16.14]

Version of Python

3.12.6

Version of Kubespray (commit)

release-2.28

Network plugin used

calico

Full inventory with variables

[all]
master ansible_host=xx.xx.xx.xx ip=xx.xx.xx.xx
node1 ansible_host=xx.xx.xx.xx ip=xx.xx.xx.xx
node2 ansible_host=xx.xx.xx.xx ip=xx.xx.xx.xx
ndoe3 ansible_host=xx.xx.xx.xx ip=xx.xx.xx.xx

[kube-master]
master

[kube-node]
node1
node2
node3

[etcd]
masrer

[calico-rr]

[k8s_cluster:children]
kube-node
kube-master
calico-rr

Command used to invoke ansible

ansible-playbook -b -v -i inventory/uat/hosts.ini --become --become-user=root scale.yml

Output of ansible run

===============================================================================
download : Download_container | Download image if required ----------------------------------------------------------------------------------------------------------------------------------------------------- 35.30s
download : Download_container | Download image if required ----------------------------------------------------------------------------------------------------------------------------------------------------- 21.91s
download : Download_container | Download image if required ----------------------------------------------------------------------------------------------------------------------------------------------------- 20.64s
network_plugin/calico : Wait for calico kubeconfig to be created ----------------------------------------------------------------------------------------------------------------------------------------------- 18.37s
download : Download_container | Download image if required ----------------------------------------------------------------------------------------------------------------------------------------------------- 16.33s
system_packages : Update package management cache (APT) -------------------------------------------------------------------------------------------------------------------------------------------------------- 12.24s
download : Download_file | Download item ----------------------------------------------------------------------------------------------------------------------------------------------------------------------- 11.34s
system_packages : Manage packages ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 10.79s
download : Download_container | Download image if required ----------------------------------------------------------------------------------------------------------------------------------------------------- 10.19s
download : Download_file | Download item ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 9.76s
download : Download_file | Download item ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 8.94s
container-engine/containerd : Download_file | Download item ----------------------------------------------------------------------------------------------------------------------------------------------------- 7.71s
download : Download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------------------------------------ 7.66s
download : Download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------------------------------------ 7.39s
download : Download_file | Download item ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 7.31s
download : Download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------------------------------------ 7.18s
download : Download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------------------------------------ 6.61s
download : Download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------------------------------------ 6.21s
container-engine/crictl : Download_file | Download item --------------------------------------------------------------------------------------------------------------------------------------------------------- 5.67s
container-engine/runc : Download_file | Download item ----------------------------------------------------------------------------------------------------------------------------------------------------------- 5.30s

Anything else we need to know

No response

[tico88612]

Do you have full ansible run log?

[PhirakbotDiff]

Do you have full ansible run log?

I am a little bit confused. Do you want the log output of the Ansible run?
If you want Ansible run log, I don't have a full log, however I can give you some.