No, those that have declined the event will not be alerted. Those that have confirmed their attendance or not yet responded to the invitation will receive a push notification, SMS or e-mail.
Those that have declined will not receive any alerts, but will be able to view new comments if they enter the event after they have declined.