Grasping Hand deals magical bludgeoning damage.
The Sage Advice Compendium clarifies this for us:
Determining whether a game feature is magical is straightforward. Ask yourself these questions about the feature:
- Is it a magic item?
- Is it a spell? Or does it let you create the effects of a spell that’s mentioned in its description?
- Is it a spell attack?
- Is it fueled by the use of spell slots?
- Does its description say it’s magical?
If your answer to any of those questions is yes, the feature is magical.
In particular, Bigby's hand is a spell, and it is fueled by spell slots. Ergo, it is magical, so the damage it deals is magical. We can compare this to the question about summoned creatures attacking. Quoting from MivaScott's answer, concerning an owl summoned via conjure animals:
- Is it a magic item? No, it's a fey in the shape of an owl
- Is it a spell? Or does it let you create the effects of a spell that’s mentioned in its description? No, it's a fey in the shape on an owl
- Is it a spell attack? No, it's a fey in the shape on an owl
- Is it fueled by the use of spell slots? No, it's a fey in the shape on an owl
- Does its description say it’s magical? No, it's a fey in the shape on an owl
Repeating this exercise for Bigby's hand, we have:
- Is it a magic item? No, it is not a magic item.
- Is it a spell? Or does it let you create the effects of a spell that’s mentioned in its description? Yes it is a spell. Bigby's hand. It is also the effects of spell. Again, Bigby's hand.
- Is it a spell attack? Clenched Fist is explicitly a spell attack. The other options for Bigby's hand are not attacks, but they are the effects of a spell.
- Is it fueled by the use of spell slots? Yes.
- Does its description say it’s magical? Well, no, but they didn't have to. It is a spell.
What is the difference here? The owl's attack is not the effect of the spell conjure animals. Conjure animals just summons an animal. Anything that animal does is not an effect of the spell. However, the damage from Bigby's hand is explicitly spelled out in the description of the spell. It is explicitly an effect of a spell, so it is magical damage.
Resistance to bludgeoning and resistance to non-magical bludgeoning are different things.
In case there is some confusion related to magical versus non-magical damage, I'll spell it out here. Some features and creatures have resistance to all sources of bludgeoning damage, and some have resistance only to non-magical sources of bludgeoning damage.
For example, the barbarian's Rage feature states:
You have resistance to bludgeoning, piercing, and slashing damage.
This gives resistance to all sources of bludgeoning damage, magical and non-magical alike. In contrast, the stoneskin spell:
This spell turns the flesh of a willing creature you touch as hard as stone. Until the spell ends, the target has resistance to nonmagical bludgeoning, piercing, and slashing damage.
The stoneskin spell gives resistance only to non-magical bludgeoning. So a barbarian would have resistance against the bludgeoning damage from Grasping Hand, but someone under the effect of stoneskin would not, since Grasping Hand deals magical bludgeoning damage.
When someone says "magical for the purpose of overcoming resistance", they are specifically referring to this second type - resistance to non-magical sources of damage. Unfortunately, Christopher Perkins' response refers to this first type - resistance that does not care if it is magical or not.