I had the same problem, but I found a solution.
In the footer, I also had a "social media links"-block (but you can add it anywhere on your page, even just temporarily, to solve this). In that social media links block, you can edit and delete the Squarespace links, which will delete them everywhere on your page, including those in the header.