# If you want to learn about why my robots.txt looks like this, read this post: https://yoa.st/robots-txt Thanks Yoast! :) # Global rules # ----------------- User-agent: * Disallow: /wp-json/ # We're experimenting with blocking search results to prevent search result spam Disallow: /?s=* Disallow: /search/* # Prevent crawling CF challenge URLs Disallow: /cdn-cgi/bm/cv/ Disallow: /cdn-cgi/challenge-platform/ # Sitemap # ----------------- Sitemap: https://mikezielonka.com/sitemap_index.xml