With that setting, messages will still come in witout alerting you. You need to manually check messages.
Before invoking that feature, I think you need to ask yourself a few questions. How frequent do alerts pop up? How disruptive are alerts? How important are incoming messages? Nice to know, must know or immediate action required? How disciplined are you to check message at a regular interval?