The Touch of the Void isn't meant to be a particularly deadly flaw, but one that makes spending void in combat quite a gamble - resulting in a good chance that your next round will be spent dazed:
TOUCH OF THE VOID [SPIRITUAL] (3 POINTS)
[...] Whenever you draw upon the Void, the effect is powerful, but can overwhelm you. When you spend a Void Point to augment a roll, you gain a bonus of +2k1 instead of +1k1. Every time you spend a Void Point, however, you must succeed at a Willpower Trait Roll (TN 30) or be Dazed for one Round.1
However, there's a problem: The potential of lacking a Round only endangers you really in combat. In situations where rounds - measured in seconds, and typically less than 102 - are indifferent because the action for the roll itself is measured in minutes, hours, or days, being dazed for one round becomes a non-factor: When you track a runaway, 10 seconds don't matter and the character plays over the dazed moment in which you get -3k0 3 as "I had to find my focus". When in court, you hide your short fainting with the fan... In fact, in many more social situations, there's little to no downside to calling upon the void to augment the pool!
Do I miss something or does nothing rein in the use of Void with Touch of the Void on rolls that represent things out of combat, where being dazed does not complicate things usually?
1 - Legends of the 5 Rings core rulebook, 4th Edition, p.162.
2 - Legends of the 5 Rings core rulebook, 4th Edition, p.81.
3 - Legends of the 5 Rings core rulebook, 4th Edition, p.89.