why not just get rid of God from the picture?
Exactly. Why introduce God in the picture in the first place?
To cover the philosophal aspect (i.e., logic): your question implies that a God of whatever kind does in fact exist, a priori (you spell it out as "either you believe that God is physical or your believe that God is not physical" - but in both cases you start with "God exists"). You are starting with "God exists" as axiom. You can try to use proof by contradiction to disprove that axiom, but you can never use this as the basis to prove the positive statement "God exists" outside of your logic building.
So yes, any argument which starts with the axiom "God exists" can be solved by just getting rid of God in the first place.
That said, to take the quoted question more seriously:
Obviously there is some mechanic underway in our brains that leads to people believing in supernatural beings. While we have no proof for the truth of any religion, we have abundant proof that people do indeed believe in them - in fact, in the past you would be very unlikely to find any society which did not believe, for the most part. From early elemental gods (i.e. the Titans from greek mythology), over more human-like gods still being associated with individual features of humanity (i.e., war, peace, love, etc. - again in ancient Greek or Roman religion), to what we had today.
One basic explanation would be that the mind, especially before the advent of science, just needs some kind of explanation for everything - this also would motivate why we obviously have so many people who go into the sciences for no good reason than to enlarge our knowledge. This is obviously an awesome evolutionary trait, being mostly reponsible for where we, as humanity, are today.
Eventually, it is perfectly fine to accept that we are past that stage of believing in made-up, orally transported beings. We don't believe in Poseidon or Thor anymore, and are off no worse for it.
If believing in God (of whatever kind) is beneficial to you (which it absolutely can be, especially if you focus on the value system of one of the more peaceful religions and not so much in the specifics of the deity!), there is nothing bad about it. But it becomes stressful whenever you try to look for objective proof for your beliefs; or if you want to force other people to join your belief; or if you do bad things to humans not part of your belief; or if doubt creeps in and you find no way to solve the discrepancies. If you are a believer and have no reason to get out, then it's probably better not to try too hard for proofs, as you will find that they all have been dismembered many times over in the past.