Thankfully after days trying to figure this out, I managed to find the answer several minutes after posting about it on the forum. Funny how that works
To anyone else with the same issue. Create a video page and upload the video you want to it. Next, go to the all section on the page and find your video. Click the 3 dots and scroll down to find the video url. It's going to be a bit tricky because the url is slippery for some reason but copy the video url in its entirety. Next go back to the pages sidebar and add a new page. When it asks you what kind of page you want to make, select URL and paste the video url there. Now just make sure the video page is hidden from view and you'll have a direct link to a video!