V4.2023.10.4047 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-80legs
-Aboundexbot
-Anarchy
-Apexoo
+AdsTxtCrawlerTP
+AwarioRssBot
 AwarioSmartBot
-BackWeb
-Barkrowler
-Bigfoot
-Black Hole
-Bolt
-Buddy
-BunnySlippers
-Claritybot
-Cocolyzebot
-CopyRightCheck
-Craftbot
-Crescent
+Blow
+Cogentbot
+Collector
+CrazyWebCrawler
+DTS Agent
+DataCha0s
 Demon
+Deusu
 DigitalPebble
-Dispatch
-DnBCrawler-Analytics
-EMail Wolf
-Ecxi
-EirGrabber
-FlashGet
-FyberSpider
-G-i-g-a-b-o-t
+Discobot
+Dotbot
+Dragonfly
+ECCP/1.0
+FrontPage
+Fyrebot
 GPTBot
-Genieo
-GermCrawler
-Getintent
-HMView
-HonoluluBot
+GalaxyBot
+GetWeb
+Go-Ahead-Got-It
+Gotit
+Grabber
+Grafula
+GridBot
+HaosouSpider
 HybridBot
-Intelliseek
-Iria
-Keybot Translation-Search-Machine
-Lightspeedsystems
-LinqiaScrapeBot
+Id-search
+Indy Library
+InterGET
+JamesBOT
+Linkbot
+Lipperhey
 Lipperhey Spider
 Lmspider
-Mail.RU_Bot
+MFC_Tear_Sample
+MJ12bot
+MQQBrowser
+MSFrontPage
+Mag-Net
 Majestic12
-Masscan
-Microsoft URL Control
-Musobot
-NPbot
-Net Vampire
-NetAnts
-NetZIP
-Nikto
-OpenLinkProfiler
-Openfind
-Pandalytics
-PleaseCrawl
+Mata Hari
+MauiBot
+Minefield
+Mozlila
+Nessus
+Netcraft
+OpenVAS
+Picsearch
+PictureFinder
+ProPowerBot
 Probethenet
-PxBroker
+Psbot
+Pu_iN
+RankingBot2
+RankurBot
+Reaper
+RebelMouse
+Ripper
+SEOlyticsCrawler
+SEOprofiler
 SMTBot
-Screaming
-SiteCheckerBotCrawler
-SiteSnagger
-Snapbot
-SocialRankIOBot
+SeekportBot
+Sitevigil
+SmartDownload
+Snoopy
+Sociscraper
+Sosospider
+Sottopop
+SpaceBison
+Spbot
+Sqlmap
+Steeler
 Sucker
-SurveyBot
-Suzuran
-T0PHackTeam
-The Intraformant
+Teleport
+Thumbor
 Trendiction
-Trendictionbot
-Turnitin
-VB Project
-VidibleScraper
-VoidEYE
-Voil
-WASALive-Bot
-WISENutbot
-WWW-Mechanize
-Wallpapers/3.0
+Twice
+Typhoeus
+V-BOT
+VCI
+VeriCiteCrawler
+WallpapersHD
 WebStripper
-WebWhacker
-WebZIP
-Whacker
+WebSucker
+Webalta
 Widow
-YoudaoBot
-Zade
-arquivo-web-crawler
-arquivo.pt
-autoemailspider
-backlink-check
-eCatch
-evc-batch
-isitwp.com
+Wonderbot
+Zauba
+archive.org_bot
+check1.exe
+demandbase-bot
 openai.com
-page scorer
 scalaj-http
-seoscanners
-tAkeOut
-ubermetrics-technologies.com
-x09Mozilla
+seocompany.store
+seostar
+sitechecker.pro
+siteripz
+xpymep1.exe