I have heard, that fundamentally past level 30+ an un-upgraded weapon is useless.
"But, In Verruckt you can't upgrade! I went to lvl. 56543!
Yes, But On Der riese the damage of the guns/ health of the zombies fall and rise drastically, and thus forcing you to upgrade.