Simple answer: no. Some translations say that it is white not yellow but the basic meaning is the same, this verse is clearly a reference to harmful skin diseases typically translated leprosy but actually describing a broad category of skin diseases, and would never have been applied to persons simply born blonde, with albinism, or turning white with age. For example:
The white spots, upon which so much diagnostic stress was laid, were
in all likelihood those of vitiligo, a disease quite common in
tropical countries, and characterized by bright white spots, the hairs
on which also become white.
Incidentally, if plucked out before examination, the hair does not make one unclean so even if it did refer to blonde people, as long as they plucked themselves bald, they would not be unclean.