Yes, MSN's crawler really is that dumb
So it isn't just me, who has noticed that MSN's crawler seems to be going a bit nuts on the downloading front. Chris Siebenmann from the University of Toronto has also got problems.
Given that the mirror in question is intended to be benefiting Linux Australia members and Australian Linux users in general, and not some half-baked wannabe search engine that doesn't know when to stop downloading, I might need to take the step of banning MSNBot as well.