I feel like you can't talk about a budget "performance" car without mentioning several generations of the VW golf.
You can get a bunch of them for well under $5000 which leaves a lot of room for improvement
The MK5 is a good example.
Whether you get the GTI or base model with the 2.5 (which is...