rich1.0phorkiehttps://p.cweiske.de/Christian Weiske86400900900<!-- embedding all files of https://p.cweiske.de/712 --> <link rel="stylesheet" href="https://p.cweiske.de/css/embed.css"/> <div class="phork" id="712"> <div class="phork-file"> <div class="phork-content"> <div class="document"> <p><a class="reference external" href="https://support.google.com/webmasters/answer/9689846?hl=en">https://support.google.com/webmasters/answer/9689846?hl=en</a> &gt; Do not use robots.txt as a blocking mechanism.</p> <p><a class="reference external" href="https://developers.google.com/search/blog/2020/09/new-open-source-robotstxt-projects">https://developers.google.com/search/blog/2020/09/new-open-source-robotstxt-projects</a></p> <p><a class="reference external" href="https://support.google.com/webmasters/answer/7489871">https://support.google.com/webmasters/answer/7489871</a></p> <p><a class="reference external" href="https://developers.google.com/search/blog/2019/07/a-note-on-unsupported-rules-in-robotstxt">https://developers.google.com/search/blog/2019/07/a-note-on-unsupported-rules-in-robotstxt</a></p> </div> </div> <div class="phork-meta"> <a href="https://p.cweiske.de/712/rev-raw/3138437a974e9eae7108691c1f440626d893a822/README.rst" style="float: right">view raw source</a> <a href="https://p.cweiske.de/712#README.rst">README.rst</a> </div> </div> </div>