V4.2024.08.4671 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-80legs
-Atomseobot
-Attach
-BackStreet
-BacklinksExtendedBot
-Battleztar Bazinga
-Boardreader
-Bullseye
-CensysInspect
-ClaudeBot
-Cocolyzebot
-Crawling at Home Project
-CrunchBot
-Curious
-CyotekWebCopy
-DTS Agent
-Demon
-Dirbuster
-Discoverybot
-Ebingbong
+360Spider
+404enemy
+Abonti
+Aboundexbot
+Anarchie
+Aspiegel
+Bandit
+BlackWidow
+Buck
+BuiltWith
+CATExplorador
+CSHttp
+Chlooe
+Craftbot
+Crescent
+DIIbot
+Discobot
+Domains Project
+Ecxi
 EroCrawler
-Express WebPictures
-ExtLinksBot
-EyeNetIE
-FlashGet
-FrontPage
-GalaxyBot
-GermCrawler
+Evil
+Exabot
+FyberSpider
+Fyrebot
+G-i-g-a-b-o-t
+GPTBot
 GetRight
-GrabNet
-GrapeFX
-GridBot
-Hloader
-Humanlinks
-HybridBot
+HMView
+Havij
 IDBot
-ImagesiftBot
-InfraSec Scanner
-Intelliseek
-Internet Ninja
-JOC Web Spider
-Joomla
-LeechFTP
-LinkScan
-Linkbot
+InternetSeer
+JamesBOT
+JustView
+Kinza
+LieBaoFast
+LinqiaMetadataDownloaderBot
+Lmspider
+MIIxpc
+MTRobot
+Magnet
 Majestic SEO
-Metauri
-NICErsPRO
+MauiBot
+Meanpathbot
+Microsoft Data Access
+Mojeek
+Musobot
+Name Intelligence
+Net Vampire
 NetLyzer
-Netcraft
-Ninja
+Nimbostratus
+OnCrawl
 OpenVAS
 Openvas
 PECL::HTTP
 PHPCrawl
-PageScorer
-Picscout
-PictureFinder
-Pockey
+Probethenet
 Psbot
 RankActive
-Recorder
-Rogerbot
-SEOlyticsCrawler
+RankFlex
+Re-re
+ReGet
+Ripper
+SEOkicks-Robot
+SISTRIX
+Scanbot
 Screaming
-SearchmetricsBot
-SeoSiteCheckup
-Seomoz
-SiteLockSpider
-Snoopy
-Spinn3r
-TightTwatBot
-TwengaBot
-URLy.Warning
-VCI
-VelenPublicWebCrawler
-WWW-Collector-E
-WeSEE
-WebGo IS
-WebReaper
-WebSauger
-WebWhacker
-Website Quester
+SeobilityBot
+Siphon
+SiteCheckerBotCrawler
+Snake
+Sqworm
+SuperHTTP
+T0PHackTeam
+TeleportPro
+Telesoft
+Toata
+Twice
+Voil
+Wallpapers
+Web Auto
+Web Pix
+Web Sauger
+WebAuto
+WebImageCollector
+Whack
 Whacker
-Wonderbot
+Xenu
 Zade
-ZoominfoBot
 ZumBot
-autoemailspider
-imagesift.com
-iubenda-radar
-linkfluence
-probe-image-size
+ZyBorg
+eCatch
+ips-agent
+openai.com
+satoristudio.net
+scan.lol
+seobility
+seostar
+serpstatbot
 sitechecker.pro
 siteripz
-sogouspider
-trendiction.com
-x22Mozilla
-zauba.io
-zgrab