Hi,
First confirm that the users were added as an Azure SQL Administrator - you can do this in the portal
navigate to the Azure SQL logical Server -> in the left menu select Azure Active Directory
-> confirm your users are registered there or add them using Set admin
Make sure that you are using the right authentication type when you try to connect the SQL Server