V4.2023.12.4189 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
+404enemy
+ADmantX
+AhrefsBot
 AiHitBot
-Anarchy99
-Attach
+Aipbot
+AwarioSmartBot
+BLEXBot
 Backlink-Ceck
-Badass
+Bandit
 Bitacle
-Black Hole
-BlowFish
-BuiltBotTough
-BunnySlippers
+BotALot
+Buck
+Bullseye
 Bytespider
-Crawling at Home Project
-DIIbot
-Deusu
+CODE87
+CherryPicker
+Digincore
+Discobot
 DittoSpyder
-Drip
-EasyDL
-Express WebPictures
+DnyzBot
+Download Wonder
+Evil
 Extractor
+Ezooms
+FemtosearchBot
+FrontPage
 Fuzz
-FyberSpider
-GT::WWW
-GalaxyBot
 Genieo
-HMView
-Image Sucker
-InfoTekies
+Grafula
+HTMLparser
+Havij
+HybridBot
+Indy Library
+InterGET
+IstellaBot
 LexiBot
-Libwhisker
-LinksManager
-Lipperhey
-Magnet
-Majestic SEO
-Majestic12
-Mb2345Browser
-Meanpathbot
-Mister PiX
-Name Intelligence
-NearSite
-NetLyzer
-NetZIP
-Nettrack
-Nimbostratus
-Offline Navigator
-OrangeBot
-OutclicksBot
-PHPCrawl
-Page Analyzer
+Likse
+Litemage_walker
+MIIxpc
+Mail.RU_Bot
+Majestic-SEO
+MarkWatch
+Msrabot
+Navroad
+OpenVAS
+PageScorer
+Pimonster
 PleaseCrawl
-Probethenet
-QueryN Metasearch
-RankFlex
-RankingBot2
-Reaper
-Recorder
-SEOkicks
-SEOkicks-Robot
-Screaming
-SeekportBot
-SentiBot
+Proximic
+RankurBot
+ReGet
+RocketCrawler
+SalesIntelligent
+ScanAlert
+ScoutJet
+ScreenerBot
+Searchestate
+SemrushBot
 SenutoBot
-SeoSiteCheckup
-Shodan
-Site Sucker
-SiteSnagger
-SmartDownload
-Snoopy
-SocialRankIOBot
+Seomoz
+Sitebeam
+SlySearch
+Sogou web spider
 Sottopop
-Sqlmap
-Sqlworm
-TinyTestBot
-Toweyabot
-Turnitin
-TwengaBot
+SpaceBison
+SpankBot
+Spinn3r
+SuperHTTP
+Swiftbot
+Szukacz
+T0PHackTeam
 Twice
-Vacuum
+URLy.Warning
 VeriCiteCrawler
-Virusdie
+Voltron
+WASALive-Bot
+WBSearchBot
 WPScan
-Web Collage
-WebBandit
-WebImageCollector
-WebStripper
-WebmasterWorldForumBot
-Webshag
+WWW-Mechanize
+Wallpapers
+Web Fetch
+WebCopier
+WebGo IS
+WebWhacker
 WebsiteQuester
-Xaldon WebSpider
-Xaldon_WebSpider
-ZmEu
-cah.io.community
-facebookscraper
+Wprecon
+Zauba
+ZoomBot
+arquivo-web-crawler
+arquivo.pt
+internetVista monitor
+muhstik-scan
 netEstate NE Crawler
-openai
-pcBrowser
-polaris version
-seobility
-seoscanners
-serpstatbot
-ubermetrics-technologies.com
+probe-image-size
+ripz
+scalaj-http
+sogouspider
+tAkeOut
+webprosbot
+x09Mozilla