V4.2023.06.3819 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-404checker
-AllSubmitter
-AlphaBot
-Atomseobot
-Bandit
+AIBOT
+ASPSeek
+AfD-Verbotsverfahren
+Alexibot
+Alligator
+Anarchy99
+Anthill
+Apexoo
+Asterias
+BacklinkCrawler
 Barkrowler
-BlowFish
-Brandwatch
-Bullseye
-Bytespider
-Citoid
-Copier
-CopyRightCheck
-Crawling at Home Project
-DnBCrawler-Analytics
-DomainAppender
-DomainStatsBot
-Drip
-ECCP/1.0
-EMail Siphon
-Evil
-Express WebPictures
-Extreme Picture Finder
-G-i-g-a-b-o-t
-GT::WWW
-Genieo
-Grafula
-GrapeshotCrawler
+BatchFTP
+Blackboard
+Bolt
+CCBot
+CensysInspect
+CheTeam
+Claritybot
+Craftbot
+Crescent
+Custo
+Devil
+Dirbuster
+Disco
+DittoSpyder
+Exabot
+Extractor
+ExtractorPro
+FDM
+FyberSpider
+Go!Zilla
+Go-Ahead-Got-It
 GridBot
-HEADMasterSEO
-HTTrack
-Harvest
-Havij
-IRLbot
-Indy Library
+Hloader
 InternetSeer
-IstellaBot
-JOC Web Spider
-Jbrofuzz
-JennyBot
-JikeSpider
-Jyxobot
-LWP::Simple
-Larbin
+JetCar
+JustView
+Libwhisker
 LinqiaRSSBot
-Mag-Net
+MQQBrowser
+MSIECrawler
 Majestic12
-MeanPath Bot
-Metauri
-Mojolicious
-Morfeus Fucking Scanner
-Mr.4x3
-Msrabot
-NetAnts
-Offline Explorer
-POE-Component-Client-HTTP
+Mister PiX
+Moblie Safari
+Mozlila
+Nameprotect
+Navroad
+Netcraft
+Netvibes
+Nikto
+Nimbostratus
+Nmap
+OnCrawl
+Openfind
+OutfoxBot
+Page Analyzer
 PageAnalyzer
-Papa Foto
-Picscout
-Pimonster
-Pockey
-ProWebWalker
-RankingBot
-Rankivabot
-SBIder
-SEOstats
-SISTRIX
-ScreenerBot
-Semrush
-SiteCheckerBotCrawler
-SiteExplorer
-SlySearch
-SmartDownload
-Snapbot
-SuperHTTP
-TheNomad
-Upflow
-WASALive-Bot
-WWW-Collector-E
-Wallpapers
-Wallpapers/3.0
-Web Fuck
+Piepmatz
+PyCurl
+ReGet
+RebelMouse
+SEOprofiler
+SalesIntelligent
+Searchestate
+Siphon
+Site Sucker
+SiteSnagger
+Siteimprove
+SocialRankIOBot
+Sociscraper
+Sottopop
+SpaceBison
+Sqlmap
+Sqlworm
+Titan
+Tracemyfile
+URLy.Warning
+UnisterBot
+VCI
+Vacuum
+WWW::Mechanize
+Web Pix
 WebImageCollector
-WebSauger
-WebWhacker
-Webshag
-WiseGuys Robot
-Wonderbot
-coccocbot
-cognitiveseo
-heritrix
-internetVista monitor
-isitwp.com
-mediawords
-pcBrowser
-s1z.ru
-seobility
-spyfu
+WebLeacher
+WebPix
+Whatweb
+Who.is Bot
+Zeus
+eCatch
+evc-batch
+instabid
+muhstik-scan
+sogouspider
+tAkeOut
+trendiction.de
+voyagerx.com
+webmeup-crawler
 x09Mozilla
 xpymep1.exe
+zauba.io