Firewall to use when server has docker app hosted?

I use ubuntu 20.04 with portainer and nginxproxymanager to host my apps. Some are still being hosted bare metal but I am planning to transfer all to docker soon enough.

But the problem is ufw, which I have been using does not integrate with docker apps. The set up is:

portainer - docker compose/stacks - nginxproxymanager - Gateway IP with its web UI port - subdomain name and ssl.

1. once ufw is up, docker apps running on ports that is not explicitly allowed is not accessible with the domain (reverse proxied). But once the firewall is down it is okay, or I can also open the ports but I don't want to do that.
2. ufw denied ports are still accessible
3. ufw enabled does not block ports that is not explicitly denied either

What is a way to solve it? Or even better, a firewall app that will work with docker?