You may be experiencing any of these issues:
Follow these steps to change your Mail notifications:
If you wish to turn off a notification from appearing entirely, press and hold the notification in the Notification bar, tap App info, and then uncheck Show notifications.
If you drag the Notification bar down, and tap Settings > Personalize you will be greeted with the settings for your display and sound. Changing the Notification or Ringtone sound from here will change the default behavior for your phones notifications. However, these defaults may not apply to all applications.
If you find notifications coming in that don't match your settings, check the application which is sending them. Follow these steps to change your Messaging or SMS notifications: