Paste Search Dynamic
wordpress robots.txt
  1. User-agent: *
  2. Disallow: /wp-admin/
  3. Allow: /wp-admin/admin-ajax.php
  4. Disallow: /wp-login.php
  5. Disallow: /wp-signup.php
  6. Disallow: /press-this.php
  7. Disallow: /remote-login.php
  8. Disallow: /activate/
  9. Disallow: /cgi-bin/
  10. Disallow: /mshots/v1/
  11. Disallow: /next/
  12. Disallow: /public.api/
Parsed in 0.001 seconds