Sorry to post on an old post, but I had this issue.
I think I figured it out. Our site has www and http redirect all to https. If you have the same thing as us, you will find google will have an issue to use https when submitting sitemaps. So instead just use http instead of https. It seem to work for us for now.
Kind regards,
Patrick