See my post about this here. The gist is that potential outcomes are pretreatment variables that exist prior to treatment assignment. Receiving the treatment reveals one of the potential outcomes and leaves the other hidden. It is true that after assigning treatment and measuring the outcome, the outcome conditional on the treatment is equal to the potential outcome corresponding to the received treatment level, but you can talk about potential outcomes without even considering the treatment as a realized random variable, such as in defining the causal effect $E[Y(1)] - E[Y(0)]$, for which the treatment does not need to be realized or measured.
It is true that $[Y|X=x] = [Y(x)|X=x]$ for treatment $X$ (under consistency). This fact is used in the critical proofs for identifying causal effects under strong ignorability, i.e., the proof that $E_W[E[Y|X=1, W]] = E[Y(1)]$ for a sufficient adjustment set $W$ relies on the first step
$$
E_W[E[Y|X=1, W]] = E_W[E[Y(1)|X=1, W]]
$$
which is a direct result of consistency. But we can also talk about potential outcomes without considering them as the outcome conditional on treatment, like in the statement of strong ignorability,
$$
Y(x) \perp X|W
$$
which does not involve the outcomes at all and is a statement about the assignment mechanism. To say instead $Y \perp X|W,X$, that is, replacing $Y(x)$ with $Y|X$, makes the statement trivial when in fact it is a very strong assumption.