The conclusion does not follow. The family of distributions described at How is the kurtosis of a distribution related to the geometry of the density function? gives a counterexample. These are densities $f_{k,s}$ all of which have identical moments. If we were, then, to shift one of them by some positive amount, all its moments would (strictly) increase. Here is a plot of their distribution functions $F_{k,s}$ (evaluated numerically):

Clearly neither dominates the other, even though all the moments of the red distribution exceed those of the black distribution.
For those who would like to experiment with this family, here is the R code used to create these plots.
f <- function(x, k=0, s=0) {
ifelse(x <= 0, 0, dnorm(log(x)) * (1 + s * sin(2 * k * pi * log(x))) / x)
}
ff <- Vectorize(function(x, k=0, s=0, ...) {
integrate(\(y) f(y, k, s), 0, x, ...)$value
})
curve(ff(x), 0, 4, lwd = 2, ylim = 0:1,
ylab = "Probability", xlab = expression(italic(x)), cex.lab = 1.25)
curve(ff(x - 0.01, 1, 3/4), add = TRUE, lwd = 2, col = "Red")