@ecubbage I am just off the chat with support and if you have not already resolved this, the answer is there has to be a published video associated to the course in order to activate the editing functionality of the Course Overview page. They are hopefully going to pass this to the development team to streamline workflow in setting up courses in the future. I just used a "stand-in video" to enable the editing function knowing it's not on the public facing end of the site, and will replace when it's ready to go live to our community.
From support: (the lesson has to be published and then you have to refresh the page)