Issues publishing a Fluent UI Blazor project from Visual Studio to Azure Web App

I have a basic Fluent UI Blazor app in Visual Studio and I am trying to publish it to an Azure Web App (Windows). I am using the downloaded publishing profile from Azure.

It says it is successful in the publish, but I get A call to warmup your site failed with response code: ‘Forbidden’. in studio.

The website says You do not have permission to view this directory or page.

And when I view the files through the app settings on Azure I don’t see the actual razor or any web files. I see a bunch of components and other files there though.