I know that you can technically see which user apps have access to it in the settings, but they don't include hidden system apps, which is why I'm asking this question, and if possible is there a tool to disable those perms?

Search for Permission Manager

You get a list of permissions, and can check apps that are approved or not.
In each permission list the 3dots icon in the upper right will toggle system apps visible or not.

click on the 3 dots in top right corner where you see the apps using that permission and click show system apps

Don't forget about the cellular baseband modem, with low level access to those things you can neither detect or control from within your operating system!

i <3 tech