Oh, well, I've never used aluminum ones, just steel, so that explains why I haven't had the problem.
On the other subject (drill-taps, aka draps), Greenlee makes sets of them that are on ebay for less than $30 (for the set!). I just bought one each metric and inch.
Another good thing to use...