Almost all similar answers like like this one say to disbale Wake on LAN option in the BIOS, but I went through all the options in the BIOS and didn't find any similar at all. I even disabled secure boot, but it didn't work. Edit I updated to 23.04 and that seems to have solved the problem
upgrading to 23.04 solved the issue for me