V4.2023.08.3928 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-404enemy
-80legs
-Aboundex
-AiHitBot
-Aipbot
-Anarchie
+ALittle Client
+Acunetix
 AwarioRssBot
-Black Hole
+Backlink-Ceck
+Barkrowler
+Bigfoot
 BlowFish
-BotALot
-CCBot
+Brandprotect
+Brandwatch
+Bytespider
+CATExplorador
 CheeseBot
-ChinaClaw
-Cocolyzebot
-Cosmos
-Custo
-Digincore
+Collector
+Crawling at Home Project
+CrunchBot
+CyotekWebCopy
 DigitalPebble
-Dispatch
+Dirbuster
+Discobot
+DnBCrawler-Analytics
 DomainCrawler
-Dotbot
-Ecxi
-ExtLinksBot
-Ezooms
-FDM
-Flunky
-Genieo
-Gigabot
+Domains Project
+FemtosearchBot
+Fimap
+FlashGet
+FyberSpider
+GetWeb
 Go!Zilla
-GridBot
-HTTrack
-HonoluluBot
-IDBTE4M
-InterGET
-JOC Web Spider
-JustView
+Grafula
+Hloader
+Iblog
+Id-search
+JamesBOT
+Joomla
+Keyword Density
+Kinza
 LeechFTP
-Linkbot
-LinqiaRSSBot
-MQQBrowser
+Lipperhey
+Litemage_walker
 Mag-Net
 Magnet
-MauiBot
 MeanPath Bot
-Microsoft Data Access
-NICErsPRO
-NearSite
-Nmap
-Openfind
-OrangeBot
-PHPCrawl
+MegaIndex.ru
+Minefield
+Mojeek
+MolokaiBot
+Name Intelligence
+Navroad
+NextGenSearchBot
+Niki-bot
+Nuclei
+Offline Navigator
 Page Analyzer
-PageScorer
-Pi-Monster
-Pockey
-ProPowerBot
-PyCurl
-Quick-Crawler
-RankActiveLinkBot
-Reaper
-RebelMouse
+PageThing.com
+Papa Foto
+Pavuk
+PeoplePal
+PxBroker
+RankActive
+Rankivabot
 Recorder
-RocketCrawler
-SalesIntelligent
-Scanbot
-Shodan
-SiteSnagger
-Sitebeam
-Sqlworm
-Steeler
-Surfbot
-Swiftbot
-T8Abot
-Telesphoreo
+SISTRIX
+Searchestate
+SemanticJuice
+SeoSiteCheckup
+SiteCheckerBotCrawler
+Sociscraper
+Sottopop
+Spbot
+Sqworm
+SurveyBot
+Szukacz
+Teleport
+Telesphorep
+The Intraformant
 Titan
-Toweyabot
-VB Project
-VCI
-Vagabondo
-WISENutbot
-Wallpapers
-WeSEE
-WebGo IS
-WebReaper
-WebmasterWorldForumBot
-Website Quester
-Widow
+Trendictionbot
+Turingos
+V-BOT
+VeriCiteCrawler
+WASALive-Bot
+WWW::Mechanize
+Wallpapers/3.0
+WallpapersHD
+Web Auto
+WebLeacher
+WebSauger
+WebsiteExtractor
+Wotbox
+Xaldon WebSpider
 Xenu
-Zauba
+Zade
 Zitebot
-archive.org_bot
-coccocbot
-domainsproject.org
+autoemailspider
 isitwp.com
-netEstate NE Crawler
-oBot
-polaris version
-seocompany.store
-siteripz
-spyfu
+pcBrowser
+satoristudio.net
+seobility
+sogouspider
+sysscan