Add setting the show/hide test alerts

Add setting the show/hide test alerts.

The application should be set to hide test alerts by default.