User-agent: AhrefsBot Disallow: / User-agent: msnbot Disallow: / User-agent: * Disallow: /admin/ Disallow: /core/ Disallow: /custom/ Disallow: /in-auction/ Disallow: /in-bulletin/ Disallow: /in-commerce/ Disallow: /in-link/ Disallow: /in-news/ Disallow: /system/ Disallow: /themes/ Disallow: /tools/