This is a situation I see my self first hand very often as someone who works in an IT related role. I also see it in other areas and experienced by seemingly everyone, but I don't know if there is a word for it. If not, I think we should make one!
For example: Your car is making a weird abnormal noise when you start it, and it predictably does this every single time you start it. However when you take it to a Mechanic and you start the car like any other time, and the noise is gone.
Maybe there's an idiom or proverb that describes this. I feel this is a common experience that should have more eloquent explaining what happened than saying "I swear I'm not crazy, it was just doing it before you came!"