$\mathbb{R}^n\not\cong\mathbb{R}^n\setminus\{0\}$ are not homeomorphic is a triviality from Algebraic Topology. On the other hand, if $X$ is an infinite dimensional Banach space, then $X \cong X\setminus\{0\}$.
Question. In the $\infty$-dimensional spaces, which sets are "removable" like $\{0\}$ in $X$? Can you give an explicit homeomorphic map in such a case?
Henderson, David W. Infinite-dimensional manifolds are open subsets of Hilbert space. Topology 9 1970 25–33. – Bill Johnson Feb 03 '17 at 22:56