As I commented, you are going to have to tell us how you find the mode, particularly for a sample from a continuous distribution where all the values are different
There are estimators for the mode which are sensitive to outliers, and others which are usually more robust such as the half sample mode, which is relatively easy to explain recursively (at least before ties are considered) with an algorithm like:
The half sample mode of $n$ sample observations is the half sample mode of those observations which lie in the narrowest interval which contains at least $n/2$ of the observations. When this reduces to $n=2$ observations, take the mean of these two.
It should be obvious that this particular estimator will be relatively resistant to extreme outliers which are not close to each other and indeed it will be more resistant even than the media in such cases. What is it less resistant to is spurious observations which are close to each other or close to genuine observations which are away from the mode.
You can read more about this and other robust estimators of the mode in a 2005 paper by David R. Bickel and Rudolf Fruehwirth, On a Fast, Robust Estimator of the Mode: Comparisons to Other Robust Estimators with Applications