ASK: Robots.txt pitfalls: what I learned the hard way (by pyeri)

#browsers #web