V4.2023.04.3679 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-AiHitBot
-Aipbot
-Alexibot
+Aboundexbot
+AlphaBot
 Anarchy
-Anarchy99
-Atomseobot
+Attach
+AwarioSmartBot
 BDCbot
-BackStreet
-Black Hole
-BunnySlippers
-CODE87
-Calculon
-CherryPicker
-ChinaClaw
-Chlooe
+BDFetch
+Boardreader
+CensysInspect
+CheTeam
+Claritybot
 Cliqzbot
-Cloud mapping
 Collector
-CopyRightCheck
+Cosmos
+CrunchBot
 DSearch
-Discobot
-DnyzBot
-Dragonfly
+DTS Agent
+DatabaseDriverMysqli
+DigitalPebble
+Dirbuster
+Disco
+Dispatch
+DomainCrawler
+Ebingbong
+EirGrabber
 Express WebPictures
-Fimap
-Firefox/7.0
-FrontPage
-GermCrawler
-Gigabot
-GrapeFX
-Harvest
-Humanlinks
-HybridBot
-IDBot
-InterGET
+ExtLinksBot
+FlashGet
+GT::WWW
+Go!Zilla
+HEADMasterSEO
+HMView
+Havij
+IRLbot
+Iblog
 InternetSeer
+Jbrofuzz
 JennyBot
-Jyxobot
+Joomla
+Jorgee
+Kozmosbot
+Leap
+LeechGet
+LexiBot
 Lightspeedsystems
+Linkbot
+LinqiaRSSBot
 LinqiaScrapeBot
-Lipperhey
-MJ12bot
+MFC_Tear_Sample
+MQQBrowser
+MSFrontPage
+MSIECrawler
 MTRobot
-Majestic-SEO
+Magnet
 Mb2345Browser
-MicroMessenger
-Morfeus Fucking Scanner
-Mr.4x3
-Msrabot
-Nessus
-NimbleCrawler
-Octopus
-OrangeBot
+MeanPath Bot
+Minefield
+Pandalytics
+Pockey
+PxBroker
 PyCurl
-Rogerbot
+Quick-Crawler
+SBIder
 SEOprofiler
 SISTRIX
-Scanbot
-ScreenerBot
-SiteCheckerBotCrawler
+SMTBot
+Scrapy
+ScrepyBot
 SiteExplorer
 SiteLockSpider
-SiteSucker
-Siteimprove
-Snoopy
-Sociscraper
-Sogou web spider
-Sucker
-SuperHTTP
+Sitevigil
+Snapbot
+Spinn3r
+Sqlmap
+Steeler
+T0PHackTeam
+Teleport
+TheNomad
 Thumbor
-Twice
-URLy Warning
-URLy.Warning
-VeriCiteCrawler
+Toweyabot
+TwengaBot
+Typhoeus
+Virusdie
 WBSearchBot
 WWW-Mechanize
+WWW::Mechanize
+WWWOFFLE
+Web Sucker
 WebAuto
-WebImageCollector
-WebLeacher
-WebZIP
-Wprecon
-Xaldon_WebSpider
-adscanner
-arquivo.pt
-autoemailspider
-crawl.sogou.com
-evc-batch
-instabid
-isitwp.com
-iubenda-radar
-muhstik-scan
-s1z.ru
-sitechecker.pro
-sogouspider
-spyfu
-trendiction.com
-ubermetrics-technologies.com
-webprosbot
+WebBandit
+WebFetch
+WebGo IS
+Zauba
+ZoominfoBot
+ZumBot
+com.plumanalytics
+crawler4j
+sysscan
+tAkeOut
 x22Mozilla
-xpymep1.exe