✅ Learn how to stop search engines to show your page in the search results using HTML robots meta tag where content attribute equal to noindex.
💡 When using HTML robots meta tag, if the value of the name attribute equal to robots, it specifies that this will apply all the search engines. To address a specific search engine, replace the robots value of the name attribute with the name of the user agent of the search engine that you are using.
💡 If the value of the content attribute is noindex, then it instructs search engines not to show the page in search results.
💡 HTML robots meta tag is used to control how a page should be indexed and served to users.
💡 The HTML Robots meta tag is normally created inside the head element.
👉 Here is the list of 10 most popular search engines and their user agent name:
https://www.keycdn.com/blog/web-crawlers