V4.2024.05.4487 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-404checker
-Abonti
-Aspiegel
-Atomseobot
-Attach
+404enemy
+AhrefsBot
+Alexibot
+Anarchy99
+Ankit
+AwarioRssBot
+BackDoorBot
+Backlink-Ceck
 Battleztar Bazinga
-Black Hole
-Bolt
-CCBot
-Calculon
-CazoodleBot
-Crescent
-Curious
-Devil
+BotALot
+Buck
+BuiltWith
+Chlooe
+Cliqzbot
+Cogentbot
+CrazyWebCrawler
+DBLBot
+DIIbot
+DatabaseDriverMysqli
 Digincore
-Discobot
-ECCP/1.0
-EMail Siphon
-FHscan
-FyberSpider
-GetRight
+Disco
+DomainAppender
+EMail Wolf
+Ecxi
+EroCrawler
+Extreme Picture Finder
+Fimap
+FrontPage
+Genieo
 Getintent
-Gotit
 Haansoft
-Humanlinks
-ImagesiftBot
-IndeedBot
+Heritrix
+IRLbot
+IlseBot
+InterGET
 Internet Ninja
-InternetMeasurement
-JOC Web Spider
-Jetty
-Keybot Translation-Search-Machine
-Keyword Density
-LexiBot
-Lightspeedsystems
-MIIxpc
-MQQBrowser
-Mag-Net
-Majestic-SEO
+Iria
+JikeSpider
+Kenjin Spider
+LeechGet
+LinkScan
+Ltx71
+MFC_Tear_Sample
+MJ12bot
 Majestic12
-MarkMonitor
+Mass Downloader
 MauiBot
-Mediatoolkitbot
-MicroMessenger
-Mister PiX
-Navroad
-NetAnts
+MegaIndex.ru
+Morfeus Fucking Scanner
+Musobot
+Nameprotect
+Netcraft
 Netvibes
-Niki-bot
+NextGenSearchBot
+Nikto
 Nimbostratus
-Octopus
-OnCrawl
-Openfind
+OpenLinkProfiler
+OrangeBot
 OrangeSpider
-RankActive
-RankingBot2
-Re-re
-ReGet
-SEOkicks-Robot
-SMTBot
-ScanAlert
-SearchmetricsBot
-Semrush
+Petalbot
+Picsearch
+PictureFinder
+RSSingBot
+ScreenerBot
+ScrepyBot
+Searchestate
 SemrushBot
+SiteCheckerBotCrawler
 Sociscraper
-Sogou web spider
-Sqlmap
-Steeler
-Swiftbot
-T0PHackTeam
-T8Abot
-TinyTestBot
-Trendiction
-VeriCiteCrawler
-Virusdie
-Voltron
-WISENutbot
-Web Auto
-WebFuck
-WebGo IS
+SpaceBison
+Spbot
+SuperHTTP
+Suzuran
+Toweyabot
+Upflow
+VB Project
+VCI
+VelenPublicWebCrawler
+WWW-Collector-E
+Web Collage
+Web Sauger
+WebBandit
+WebImageCollector
 WebWhacker
+Website Quester
+Whatweb
 Who.is Bot
-ZmEu
-com.plumanalytics
-facebookscraper
-heritrix
-instabid
-isitwp.com
-lwp-request
-meanpathbot
-netEstate NE Crawler
-openai
-page scorer
-satoristudio.net
-scan.lol
-sogouspider
+Wotbox
+Zeus
+ZoominfoBot
+crawl.sogou.com
+demandbase-bot
+domainsproject.org
+muhstik-scan
+omgili
+seobility
+sexsearcher
+sitechecker.pro
 tAkeOut
 webmeup-crawler
-webpros.com
-x22Mozilla