V4.2023.06.3802 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
+404checker
 ADmantX
-AIBOT
-AdsTxtCrawlerTP
-Anarchy
-Ankit
-Attach
-BatchFTP
-Battleztar Bazinga
-BetaBot
-Blackboard
-BuiltWith
-BunnySlippers
+ASPSeek
+AllSubmitter
+Atomseobot
+BDCbot
+Bandit
+BlowFish
+Boardreader
+BotALot
+Buck
+BuiltBotTough
+BuzzSumo
 CATExplorador
-Calculon
-CazoodleBot
-Citoid
-DIIbot
-Disco
-DnBCrawler-Analytics
+CODE87
+ChinaClaw
+Claritybot
+Cloud mapping
+Cocolyzebot
+Cogentbot
+Copier
+Cosmos
+Crawling at Home Project
+DBLBot
+DTS Agent
 Dragonfly
-EasyDL
-Evil
-Express WebPictures
-ExtractorPro
-FDM
-Flunky
-Genieo
-GetRight
-Gigabot
-GrabNet
-Grafula
-GridBot
-HEADMasterSEO
-HTTrack
-Harvest
+EMail Wolf
+Extreme Picture Finder
+Firefox/7.0
+FlashGet
+Heritrix
 Hloader
-Humanlinks
 HybridBot
-Iblog
-IndeedBot
-InfoTekies
-JamesBOT
-JikeSpider
-JustView
-Libwhisker
-LinkextractorPro
-LinkpadBot
-LinksManager
-Majestic-SEO
-Mb2345Browser
-Minefield
+Image Sucker
+InfoNaviRobot
+Intelliseek
+IstellaBot
+Jbrofuzz
+Jetty
+Keybot Translation-Search-Machine
+LWP::Simple
+LieBaoFast
+Likse
+Lipperhey Spider
+Litemage_walker
+MSFrontPage
+Mail.RU_Bot
+Majestic12
+Masscan
+Metauri
 Mojeek
-Msrabot
-Net Vampire
-NetAnts
-Offline Explorer
-PECL::HTTP
-Pimonster
-ProWebWalker
-RankFlex
-Rogerbot
-SEOkicks
-SEOstats
-SentiBot
-SenutoBot
-SiteExplorer
-Sitevigil
-SmartDownload
-Snake
-Snapbot
-Spbot
-Sqlworm
-TheNomad
-Toweyabot
-Trendiction
-Turingos
-Twice
-VB Project
+Morfeus Fucking Scanner
+NPbot
+NetMechanic
+Nettrack
+Openfind
+POE-Component-Client-HTTP
+Papa Foto
+Picsearch
+RankingBot
+SEOprofiler
+SalesIntelligent
+Scrapy
+Screaming
+ScreenerBot
+SearchmetricsBot
+SemanticJuice
+SocialRankIOBot
+Sqlmap
+Stripper
+Sucker
+SurveyBot
+Swiftbot
+TwengaBot
 VeriCiteCrawler
-VidibleScraper
-Virusdie
 VoidEYE
-Wallpapers/3.0
-Web Enhancer
+WBSearchBot
+WPScan
 Web Fuck
-Web Pix
-WebGo IS
-WebZIP
-WebmasterWorldForumBot
-Website Quester
-Whack
-adscanner
-archive.org_bot
+WebAuto
+WebReaper
+Wotbox
+Xaldon WebSpider
+Xaldon_WebSpider
+ZoominfoBot
 arquivo-web-crawler
+cognitiveseo
+eCatch
+evc-batch
+lwp-trivial
 magpie-crawler
+meanpathbot
+mediawords
 muhstik-scan
+s1z.ru
 seobility
-sexsearcher
-spyfu
+seoscanners
+siteripz
+sogouspider
 webgains-bot