next time find a wood log or 2x4 and bang on the starter, will probably work then. sounds like you need to have it rebuilt or replaced. fairly common for starters to fail when thier hot.
its only going to get worse.
as a quick check make sure all the wire connections are clean and tight.