I had this same issue. Thankfully it doesn't happen in the live version of the site, but it cost me about an hour until I found this forum post which made me realize that it's only an issue in the non-live version! Definitely a bug with the editing experience / misleading!