{"id":662,"date":"2018-12-28T12:26:20","date_gmt":"2018-12-28T08:26:20","guid":{"rendered":"https:\/\/blog.keitaro.io\/en\/?p=662"},"modified":"2025-09-17T18:06:58","modified_gmt":"2025-09-17T16:06:58","slug":"malicious-bots-protect","status":"publish","type":"post","link":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/","title":{"rendered":"How to Protect your Website from Malicious Bots"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-663\" src=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/pexels-photo-106344.jpeg\" alt=\"\" width=\"920\" height=\"460\" \/><\/p>\n<p>Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots.<\/p>\n<p><!--more--><\/p>\n<div class=\"fx-toc fx-toc-id-662\"><h2 class=\"fx-toc-title\">Content<\/h2><ul class='fx-toc-list level-1'>\n\t<li>\n\t\t<a href=\"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#search-bots\">Search Bots<\/a>\n\t<\/li>\n\t<li>\n\t\t<a href=\"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#malicious-bots-how-to-ban-them-on-a-server\">Malicious Bots: How to Ban them on a Server<\/a>\n\t<\/li>\n\t<li>\n\t\t<a href=\"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#read-more\">Read More<\/a>\n\t<\/li>\n<\/ul>\n<\/ul>\n<\/div>\n\n<h2><span id=\"search-bots\">Search Bots<\/span><\/h2>\n<p>We will work with robots.txt file in this case.<\/p>\n<p>We need to set up an indexing limitation which means we will allow Google, Bing, Baidu or other bots to index your website in a certain time period.<\/p>\n<p>Create robots.txt in a root directory of your website with the following content:<\/p>\n<pre class=\"lang:default decode:true \">User-agent: *\nCrawl-delay: 5<\/pre>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-665\" src=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/1.png\" alt=\"\" width=\"941\" height=\"142\" \/><\/p>\n<p>The file should be located in a root directory:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-666\" src=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/2.png\" alt=\"\" width=\"941\" height=\"148\" \/><\/p>\n<p>Done! We&#8217;ve allowed bots from search engines to index our website once in 5 seconds.<\/p>\n<p>But sometimes bots may ignore a crawl delay, then there\u2019s a solution in webmaster tools <a href=\"https:\/\/webmasters.stackexchange.com\/a\/56773\">https:\/\/webmasters.stackexchange.com\/a\/56773<\/a>.<\/p>\n<p>Such settings can be found in every search\u00a0engine.<\/p>\n<h2><span id=\"malicious-bots-how-to-ban-them-on-a-server\">Malicious Bots: How to Ban them on a Server<\/span><\/h2>\n<p>First, you need to check if this really is bots who load your website and make it unavailable.<\/p>\n<p>To learn which bots visit your website, check the server\u2019s logs where your website is hosted. Check if there are many requests with the same user agent, e.g. MauiBot, MJ12bot, SEMrushBot, AhrefsBot.<\/p>\n<p>Just google \u201cblocking bad bots\u201d and you\u2019ll find thousands of such bots.<\/p>\n<p>The block of such bots will be done in a <strong>Nginx\u00a0configuration file<\/strong>.<\/p>\n<p><em><strong>Important! This solution will only work in case the tracker is installed with our <a href=\"https:\/\/help.keitaro.io\/en\/auto-installation\">auto-installation script.<\/a><\/strong><\/em><\/p>\n<p>Add to\u00a0<strong>\/etc\/nginx\/conf.d\/vhosts.conf:<\/strong><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-667\" src=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/3.png\" alt=\"\" width=\"941\" height=\"173\" \/><\/p>\n<p>to a <strong>server<\/strong> section the following code:<\/p>\n<pre class=\"lang:default decode:true \">if ($http_user_agent ~* (MauiBot|MJ12bot|SEMrushBot|AhrefsBot)){\n \n    return 403;\n \n}<\/pre>\n<p>Also, if there are SSL certificates, the changes should be done for every domain, e.g. for <em>domain.com<\/em>, you need to change <strong>\/etc\/nginx\/conf.d\/domain.com.conf<\/strong> file.<\/p>\n<p>The easiest solution in case you added SSL is to run a command in your server\u2019s terminal:<\/p>\n<pre class=\"lang:default decode:true \">find \/etc\/nginx\/conf.d\/ -type f | \\\n \u00a0xargs sed -i '\/^server {\/a if ($http_user_agent ~* (MauiBot|MJ12bot|SEMrushBot|AhrefsBot)) { return 403; }'<\/pre>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-668\" src=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/3-0.png\" alt=\"\" width=\"941\" height=\"96\" \/><\/p>\n<p>Next, reload Nginx with the command:<\/p>\n<pre class=\"lang:default decode:true \">systemctl reload nginx<\/pre>\n<p>To check that everything is done correctly, run a command:<\/p>\n<pre class=\"lang:default decode:true \">curl http:\/\/localhost -H 'User-Agent: MauiBot' -I<\/pre>\n<p>The reply should be:<\/p>\n<pre class=\"lang:default decode:true \">HTTP\/1.1 403 Forbidden<\/pre>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-669\" src=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/4.png\" alt=\"\" width=\"941\" height=\"192\" \/><\/p>\n<p>Thus, the bot\u2019s won\u2019t be able to visit the website.<\/p>\n<h2><span id=\"read-more\">Read More<\/span><\/h2>\n<p><a href=\"https:\/\/help.keitaro.io\/en\/\">Knowledge Database<\/a><br \/><a href=\"https:\/\/help.keitaro.io\/en\/auto-installation\">Auto-Installation Tutorial<\/a><br \/><a href=\"https:\/\/www.youtube.com\/channel\/UCtL1YEGv3EolfAor-vFiYaw\">YouTube Channel<\/a><\/p>\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today we will tell how to downgrade your website load. This solution will help to protect &hellip; <\/p>\n","protected":false},"author":19,"featured_media":1206,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[24],"tags":[],"class_list":["post-662","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-legacy"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO Pro 4.9.6.2 - aioseo.com -->\n\t<meta name=\"description\" content=\"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Marketing Team\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO Pro (AIOSEO) 4.9.6.2\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"Keitaro Blog \u00bb Top Trends in Digital Marketing and Ad Tracking\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"How to Protect your Website from Malicious Bots\" \/>\n\t\t<meta property=\"og:description\" content=\"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2024\/08\/Screenshot-2024-08-02-at-12.18.52\u202fPM.png\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2024\/08\/Screenshot-2024-08-02-at-12.18.52\u202fPM.png\" \/>\n\t\t<meta property=\"og:image:width\" content=\"1860\" \/>\n\t\t<meta property=\"og:image:height\" content=\"948\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2018-12-28T08:26:20+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2025-09-17T16:06:58+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/keitaro.tracker\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary\" \/>\n\t\t<meta name=\"twitter:site\" content=\"@keitaro_tracker\" \/>\n\t\t<meta name=\"twitter:title\" content=\"How to Protect your Website from Malicious Bots\" \/>\n\t\t<meta name=\"twitter:description\" content=\"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing\" \/>\n\t\t<meta name=\"twitter:creator\" content=\"@keitaro_tracker\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2024\/08\/Screenshot-2024-08-02-at-12.18.52\u202fPM.png\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"BlogPosting\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#aioseo-article-65d3a81400bbd\",\"name\":\"How to Protect your Website from Malicious Bots\",\"headline\":\"How to Protect your Website from Malicious Bots\",\"description\":\"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing\",\"author\":{\"@type\":\"Person\",\"name\":\"Marketing Team\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/author\\\/marketing-team\\\/\"},\"publisher\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/#organization\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/wp-content\\\/uploads\\\/2018\\\/12\\\/pexels-photo-106344-1.jpeg\",\"width\":920,\"height\":460},\"datePublished\":\"2018-12-28T12:26:20+02:00\",\"dateModified\":\"2025-09-17T18:06:58+02:00\",\"inLanguage\":\"en-US\",\"articleSection\":\"Legacy\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blog.keitaro.io\\\/en\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/category\\\/legacy\\\/#listItem\",\"name\":\"Legacy\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/category\\\/legacy\\\/#listItem\",\"position\":2,\"name\":\"Legacy\",\"item\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/category\\\/legacy\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#listItem\",\"name\":\"How to Protect your Website from Malicious Bots\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#listItem\",\"position\":3,\"name\":\"How to Protect your Website from Malicious Bots\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/category\\\/legacy\\\/#listItem\",\"name\":\"Legacy\"}}]},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/#organization\",\"name\":\"Keitaro Tracker\",\"description\":\"Keitaro Tracker is a self-hosted ad tracker that gives you complete control over your traffic. Designed specifically for media buying, affiliate marketing, traffic arbitrage, and internet marketing, it ensures privacy, handles large volumes of clicks, and offers extensive customization options.\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/\",\"telephone\":\"+16562184636\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/Logo-Keitaro-green.png\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#organizationLogo\",\"width\":1000,\"height\":442},\"image\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#organizationLogo\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/keitaro.tracker\",\"https:\\\/\\\/twitter.com\\\/keitaro_tracker?lang=en\",\"https:\\\/\\\/www.instagram.com\\\/keitaro_tracker\",\"https:\\\/\\\/www.tiktok.com\\\/@keitaro_tracker\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCtL1YEGv3EolfAor-vFiYaw\",\"https:\\\/\\\/www.linkedin.com\\\/showcase\\\/keitaro-tracker-apliteni\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/author\\\/marketing-team\\\/#author\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/author\\\/marketing-team\\\/\",\"name\":\"Marketing Team\",\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/cde99b1f5f99357d4f5f72c02149c9903057bdae61b102b2f71e3d631f1fa1c3?s=96&d=mm&r=g\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#webpage\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/\",\"name\":\"How to Protect your Website from Malicious Bots\",\"description\":\"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#breadcrumblist\"},\"author\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/author\\\/marketing-team\\\/#author\"},\"creator\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/author\\\/marketing-team\\\/#author\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/wp-content\\\/uploads\\\/2018\\\/12\\\/pexels-photo-106344-1.jpeg\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#mainImage\",\"width\":920,\"height\":460},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/malicious-bots-protect\\\/#mainImage\"},\"datePublished\":\"2018-12-28T12:26:20+02:00\",\"dateModified\":\"2025-09-17T18:06:58+02:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/\",\"name\":\"Keitaro Tracker Blog\",\"alternateName\":\"Keitaro Tracker Blog\",\"description\":\"Top Trends in Digital Marketing and Ad Tracking\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/blog.keitaro.io\\\/en\\\/#organization\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO Pro -->\r\n\t\t<title>How to Protect your Website from Malicious Bots<\/title>\n\n","aioseo_head_json":{"title":"How to Protect your Website from Malicious Bots","description":"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing","canonical_url":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"BlogPosting","@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#aioseo-article-65d3a81400bbd","name":"How to Protect your Website from Malicious Bots","headline":"How to Protect your Website from Malicious Bots","description":"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing","author":{"@type":"Person","name":"Marketing Team","url":"https:\/\/blog.keitaro.io\/en\/author\/marketing-team\/"},"publisher":{"@id":"https:\/\/blog.keitaro.io\/en\/#organization"},"image":{"@type":"ImageObject","url":"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/pexels-photo-106344-1.jpeg","width":920,"height":460},"datePublished":"2018-12-28T12:26:20+02:00","dateModified":"2025-09-17T18:06:58+02:00","inLanguage":"en-US","articleSection":"Legacy"},{"@type":"BreadcrumbList","@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/blog.keitaro.io\/en#listItem","position":1,"name":"Home","item":"https:\/\/blog.keitaro.io\/en","nextItem":{"@type":"ListItem","@id":"https:\/\/blog.keitaro.io\/en\/category\/legacy\/#listItem","name":"Legacy"}},{"@type":"ListItem","@id":"https:\/\/blog.keitaro.io\/en\/category\/legacy\/#listItem","position":2,"name":"Legacy","item":"https:\/\/blog.keitaro.io\/en\/category\/legacy\/","nextItem":{"@type":"ListItem","@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#listItem","name":"How to Protect your Website from Malicious Bots"},"previousItem":{"@type":"ListItem","@id":"https:\/\/blog.keitaro.io\/en#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#listItem","position":3,"name":"How to Protect your Website from Malicious Bots","previousItem":{"@type":"ListItem","@id":"https:\/\/blog.keitaro.io\/en\/category\/legacy\/#listItem","name":"Legacy"}}]},{"@type":"Organization","@id":"https:\/\/blog.keitaro.io\/en\/#organization","name":"Keitaro Tracker","description":"Keitaro Tracker is a self-hosted ad tracker that gives you complete control over your traffic. Designed specifically for media buying, affiliate marketing, traffic arbitrage, and internet marketing, it ensures privacy, handles large volumes of clicks, and offers extensive customization options.","url":"https:\/\/blog.keitaro.io\/en\/","telephone":"+16562184636","logo":{"@type":"ImageObject","url":"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2024\/08\/Logo-Keitaro-green.png","@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#organizationLogo","width":1000,"height":442},"image":{"@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#organizationLogo"},"sameAs":["https:\/\/www.facebook.com\/keitaro.tracker","https:\/\/twitter.com\/keitaro_tracker?lang=en","https:\/\/www.instagram.com\/keitaro_tracker","https:\/\/www.tiktok.com\/@keitaro_tracker","https:\/\/www.youtube.com\/channel\/UCtL1YEGv3EolfAor-vFiYaw","https:\/\/www.linkedin.com\/showcase\/keitaro-tracker-apliteni"]},{"@type":"Person","@id":"https:\/\/blog.keitaro.io\/en\/author\/marketing-team\/#author","url":"https:\/\/blog.keitaro.io\/en\/author\/marketing-team\/","name":"Marketing Team","image":{"@type":"ImageObject","url":"https:\/\/secure.gravatar.com\/avatar\/cde99b1f5f99357d4f5f72c02149c9903057bdae61b102b2f71e3d631f1fa1c3?s=96&d=mm&r=g"}},{"@type":"WebPage","@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#webpage","url":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/","name":"How to Protect your Website from Malicious Bots","description":"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/blog.keitaro.io\/en\/#website"},"breadcrumb":{"@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#breadcrumblist"},"author":{"@id":"https:\/\/blog.keitaro.io\/en\/author\/marketing-team\/#author"},"creator":{"@id":"https:\/\/blog.keitaro.io\/en\/author\/marketing-team\/#author"},"image":{"@type":"ImageObject","url":"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2018\/12\/pexels-photo-106344-1.jpeg","@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#mainImage","width":920,"height":460},"primaryImageOfPage":{"@id":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/#mainImage"},"datePublished":"2018-12-28T12:26:20+02:00","dateModified":"2025-09-17T18:06:58+02:00"},{"@type":"WebSite","@id":"https:\/\/blog.keitaro.io\/en\/#website","url":"https:\/\/blog.keitaro.io\/en\/","name":"Keitaro Tracker Blog","alternateName":"Keitaro Tracker Blog","description":"Top Trends in Digital Marketing and Ad Tracking","inLanguage":"en-US","publisher":{"@id":"https:\/\/blog.keitaro.io\/en\/#organization"}}]},"og:locale":"en_US","og:site_name":"Keitaro Blog \u00bb Top Trends in Digital Marketing and Ad Tracking","og:type":"article","og:title":"How to Protect your Website from Malicious Bots","og:description":"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing","og:url":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/","og:image":"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2024\/08\/Screenshot-2024-08-02-at-12.18.52\u202fPM.png","og:image:secure_url":"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2024\/08\/Screenshot-2024-08-02-at-12.18.52\u202fPM.png","og:image:width":1860,"og:image:height":948,"article:published_time":"2018-12-28T08:26:20+00:00","article:modified_time":"2025-09-17T16:06:58+00:00","article:publisher":"https:\/\/www.facebook.com\/keitaro.tracker","twitter:card":"summary","twitter:site":"@keitaro_tracker","twitter:title":"How to Protect your Website from Malicious Bots","twitter:description":"Today we will tell how to downgrade your website load. This solution will help to protect your website from search and malicious bots. Content Search Bots Malicious Bots: How to Ban them on a Server Read More Search Bots We will work with robots.txt file in this case. We need to set up an indexing","twitter:creator":"@keitaro_tracker","twitter:image":"https:\/\/blog.keitaro.io\/en\/wp-content\/uploads\/2024\/08\/Screenshot-2024-08-02-at-12.18.52\u202fPM.png"},"aioseo_meta_data":{"post_id":"662","title":null,"description":null,"keywords":null,"keyphrases":{"focus":{"keyphrase":"","score":0,"analysis":{"keyphraseInTitle":{"score":0,"maxScore":9,"error":1}}},"additional":[]},"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":"","og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":{"id":"#aioseo-article-65d3a81400bbd","slug":"article","graphName":"Article","label":"Article","properties":{"type":"BlogPosting","name":"#post_title","headline":"#post_title","description":"#post_excerpt","image":"","keywords":"","author":{"name":"#author_name","url":"#author_url"},"dates":{"include":true,"datePublished":"","dateModified":""}}},"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"BlogPosting","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":"{\"article\":{\"articleType\":\"BlogPosting\"},\"course\":{\"name\":\"\",\"description\":\"\",\"provider\":\"\"},\"faq\":{\"pages\":[]},\"product\":{\"reviews\":[]},\"recipe\":{\"ingredients\":[],\"instructions\":[],\"keywords\":[]},\"software\":{\"reviews\":[],\"operatingSystems\":[]},\"webPage\":{\"webPageType\":\"WebPage\"}}","pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":"-1","robots_max_videopreview":"-1","robots_max_imagepreview":"large","priority":null,"frequency":"default","local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":"0","open_ai":null,"ai":{"faqs":[],"keyPoints":[],"titles":[],"descriptions":[],"socialPosts":{"email":[],"linkedin":[],"twitter":[],"facebook":[],"instagram":[]}},"created":"2021-07-01 08:45:07","updated":"2025-09-17 16:14:43"},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t<a href=\"https:\/\/blog.keitaro.io\/en\" title=\"Home\">Home<\/a>\n<\/span><span class=\"aioseo-breadcrumb-separator\">&ndash;<\/span><span class=\"aioseo-breadcrumb\">\n\t<a href=\"https:\/\/blog.keitaro.io\/en\/category\/legacy\/\" title=\"Legacy\">Legacy<\/a>\n<\/span><span class=\"aioseo-breadcrumb-separator\">&ndash;<\/span><span class=\"aioseo-breadcrumb\">\n\tHow to Protect your Website from Malicious Bots\n<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/blog.keitaro.io\/en"},{"label":"Legacy","link":"https:\/\/blog.keitaro.io\/en\/category\/legacy\/"},{"label":"How to Protect your Website from Malicious Bots","link":"https:\/\/blog.keitaro.io\/en\/malicious-bots-protect\/"}],"_links":{"self":[{"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/posts\/662","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/comments?post=662"}],"version-history":[{"count":3,"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/posts\/662\/revisions"}],"predecessor-version":[{"id":6624,"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/posts\/662\/revisions\/6624"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/media\/1206"}],"wp:attachment":[{"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/media?parent=662"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/categories?post=662"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.keitaro.io\/en\/wp-json\/wp\/v2\/tags?post=662"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}