Head to the Prometheus server's /rules page at http://<machine-ip>:9090/rules. It should look like this, after clicking on the configured rule to expand its definition:

This page shows each rule's definition, last evaluation time, evaluation duration, and health state. When a rule fails to evaluate for whatever reason, this page will also show you the exact error that caused the failure.