V4.2023.03.3594 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-404enemy
-ALittle Client
-Aboundex
-Aboundexbot
-Anthill
-BackStreet
-Bigfoot
-CensysInspect
+ASPSeek
+Alexibot
+Atomseobot
+BlowFish
+Buck
+CSHttp
+Calculon
 CheTeam
-CherryPicker
-CopyRightCheck
-CrunchBot
-Custo
-DataCha0s
-Deusu
-Digincore
+Cloud mapping
+Copyscape
 DigitalPebble
 Disco
-DomainCrawler
-EasyDL
-ExtractorPro
-FemtosearchBot
-Firefox/7.0
-Flunky
-G-i-g-a-b-o-t
-GT::WWW
-GalaxyBot
-Getintent
-Gigabot
-Go-Ahead-Got-It
-HTTP::Lite
-HaosouSpider
-Harvest
-HybridBot
-IDBot
-Iria
-Iskanie
-JamesBOT
-Jbrofuzz
-JustView
-Likse
-MIDown tool
-MTRobot
+Dispatch
+Dragonfly
+EirGrabber
+ExtLinksBot
+EyeNetIE
+FDM
+HEADMasterSEO
+HTMLparser
+Haansoft
+IRLbot
+IstellaBot
+JennyBot
+Kenjin Spider
+Keyword Density
+LNSpiderguy
+Lanshanbot
+LeechFTP
+LexiBot
+Libwhisker
+Lightspeedsystems
+LinkWalker
+LinksManager
+Ltx71
 Mag-Net
-Mediatoolkitbot
-MegaIndex.ru
-Microsoft URL Control
-MolokaiBot
-Musobot
-NetAnts
-NetMechanic
-Netvibes
-NextGenSearchBot
-Nibbler
-NimbleCrawler
-Offline Navigator
-Page Analyzer
-PageAnalyzer
-Picsearch
-Pockey
-ProWebWalker
+MarkMonitor
+Masscan
+Mb2345Browser
+Microsoft Data Access
+Moblie Safari
+Mojolicious
+NICErsPRO
+OpenVAS
+Openfind
+OrangeBot
+OrangeSpider
+OutclicksBot
+Pandalytics
+Papa Foto
+Piepmatz
+ProPowerBot
+Pump
+PyCurl
 RankurBot
-Scanbot
-Scrapy
-Sitevigil
-Sogou web spider
-SpaceBison
-Spbot
-T8Abot
+Re-re
+RocketCrawler
+Rogerbot
+SBIder
+SalesIntelligent
+Screaming
+ScreenerBot
+Searchestate
+SemanticJuice
+Semrush
+Site Sucker
+SiteCheckerBotCrawler
+SiteExplorer
+SpankBot
+SputnikBot
+Sqworm
+TeleportPro
+Telesoft
 Thumbor
-Titan
+Tracemyfile
+Trendictionbot
 Twice
-VCI
-Vacuum
-Vagabondo
-Virusdie
-WISENutbot
-WWW::Mechanize
-WeSEE
-Web Enhancer
-WebAuto
-WebFetch
-WebLeacher
-Whack
-Xaldon WebSpider
-ZumBot
-ZyBorg
-crawler.feedback
-crawler4j
-dataforseo.com
-domainsproject.org
-probe-image-size
+URLy Warning
+VidibleScraper
+WWWOFFLE
+Wallpapers/3.0
+Web Fetch
+WebReaper
+Whatweb
+Who.is Bot
+Widow
+Zitebot
+archive.org_bot
+cah.io.community
+cognitiveseo
+com.plumanalytics
+crawl.sogou.com
+isitwp.com
+netEstate NE Crawler
+s1z.ru
+scalaj-http
 sitechecker.pro
 spyfu
-trendiction.com
-ubermetrics-technologies.com
+trendiction.de
 voyagerx.com
-webmeup-crawler
-webpros.com
-xpymep1.exe