V4.2024.09.4727 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
 404checker
-AIBOT
-Aboundex
-BetaBot
-Brandwatch
-Calculon
-Chlooe
-Claritybot
-Copier
-Crescent
-CyotekWebCopy
+Aboundexbot
+Alligator
+Apexoo
+BLEXBot
+BackWeb
+Badass
+Bandit
+Buck
+CazoodleBot
+Citoid
+Cloud mapping
+Collector
+Crawling at Home Project
+CrazyWebCrawler
+Custo
+DIIbot
 Demon
-DnyzBot
-ECCP/1.0
-EasyDL
-EirGrabber
+Deusu
+DigitalPebble
+Domains Project
+Dotbot
+Download Wonder
+Dragonfly
 Exabot
-ExtLinksBot
-EyeNetIE
-Ezooms
-Fimap
-FrontPage
-Fuzz
-G-i-g-a-b-o-t
-GetRight
-Go!Zilla
-Go-Ahead-Got-It
-HTTP::Lite
-Harvest
-HybridBot
-InfoNaviRobot
-Information Security Team InfraSec Scanner
-InternetSeer
-JamesBOT
-Jetty
-JikeSpider
-Joomla
-Kenjin Spider
-Lanshanbot
-Larbin
-Libwhisker
-LinksManager
-Lipperhey
-Lipperhey Spider
-MIIxpc
-MQQBrowser
-MarkWatch
-Mediatoolkitbot
-Msrabot
+ExtractorPro
+Extreme Picture Finder
+Foobot
+FyberSpider
+GT::WWW
+GetWeb
+GoZilla
+GrapeFX
+HaosouSpider
+IDBTE4M
+IndeedBot
+InterGET
+InternetMeasurement
+Iria
+Jbrofuzz
+JetCar
+Jorgee
+LinkScan
+Mag-Net
+MarkMonitor
+MegaIndex.ru
+Metauri
 Musobot
 NPbot
-Net Vampire
-NetLyzer
-Netcraft
-Openfind
-Piepmatz
-Pimonster
-Pump
-Re-re
-Reaper
+Name Intelligence
+Nikto
+Nimbostratus
+Nmap
+OrangeBot
+OrangeSpider
+OutfoxBot
+ProWebWalker
+Quick-Crawler
+RSSingBot
+RankingBot
+RankingBot2
+RealDownload
 Recorder
-SalesIntelligent
-Seekport
+ScreenerBot
+Semrush
+SeobilityBot
+Seomoz
 SiteCheckerBotCrawler
-SiteLockSpider
-SiteSnagger
-Sitevigil
-Snapbot
-Spanner
-Spider_Bot/3.0
-Teleport
+SpaceBison
+Sucker
+SuperHTTP
+Swiftbot
+TeleportPro
+Telesoft
 Telesphoreo
-Telesphorep
-Trendictionbot
-Upflow
-VB Project
+Toata
+Toweyabot
+TurnitinBot
+Typhoeus
 VeriCiteCrawler
-Virusdie
-WWW-Collector-E
-Web Sucker
-WebEnhancer
-Website Quester
-Webster
-Who.is Bot
-Wprecon
-YoudaoBot
-ZoomBot
-ZyBorg
-anthropic-ai
-coccocbot
+WPScan
+WallpapersHD
+WeSEE
+Web Auto
+Web Sauger
+WebsiteExtractor
+Whack
+ZumBot
+arquivo.pt
 com.plumanalytics
-lwp-request
-oBot
-polaris version
+instabid
+openai.com
+probe-image-size
 satoristudio.net
-sp_auditbot
-trendiction.de
+scalaj-http
+seobility
+sexsearcher
+sitechecker.pro
 ubermetrics-technologies.com
-zauba.io
-zgrab
+webgains-bot