In order to avoid undesirable information in the research indexes, webmasters can instruct spiders to not crawl certain documents or directories through the typical robots.txt file in the root Listing of the domain. On top of that, a web page might be explicitly excluded from the internet search engine's databases https://www.theepochtimes.com/entertainment/the-firing-squad-new-must-watch-movie-that-will-inspire-and-uplift-you-5681479