If you stop following a case:
1) It will remove the case from your MyCases page
2) You will stop receiving email alerts on this case
DISTRIBUTION LIST: If you have set up a distribution list, it will NOT cut off alerts or remove the case from your colleagues' MyCases page. To turn off other people's alerts, you will need to un-subscribe them from the distribution list.