User-agent: AhrefsBot User-agent: DataForSeoBot User-agent: FacebookBot User-agent: SemrushBot Disallow: / User-agent: * Crawl-delay: 10 Disallow: /wp-admin/ Disallow: /wp-json/ Disallow: /?rest_route=/ Disallow: /*.log Disallow: /*.ini Allow: /wp-admin/admin-ajax.php