Hoiw can i remove all ip addresses from Azure SQL Server Firewall Rules , but still login via SSMS?

So, is there a way to allow the user to login let’s say via Microsoft Entra Id and have no IP addresses in that section ?

NO, you can’t allow user to connect the server without whitelisting the IP

When setting up a new server in Azure SQL Database, a server-level firewall is automatically implemented to block access to the public endpoint. These firewall rules are designed to allow clients to connect to the entire server, granting access to all the databases hosted on that server.

To be able to create and manage IP firewall rules for the Azure SQL Server, you will need to either be:

• SQL Server Contributor role
• SQL Security Manager role
• The owner of the resource that contains the Azure SQL Server

Without these roles Users can’t add their IP to server and If IP is not whitelisted, they can’t Connect to the server.

For more information check this document