V4.2024.03.4391 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-AIBOT
+ALittle Client
+ASPSeek
+Abonti
+Aboundex
+AhrefsBot
+Aipbot
+Alexibot
 Anarchie
-Anarchy
-Apexoo
-Aspiegel
 AwarioRssBot
-BDFetch
-BetaBot
-Boardreader
-Bolt
-BotALot
-BunnySlippers
-CSHttp
-CazoodleBot
-Cegbfeieh
+BBBike
+BLEXBot
+Badass
+BatchFTP
+Buddy
+CATExplorador
+CensysInspect
 CheeseBot
-Cocolyzebot
-DBLBot
+Citoid
+CopyRightCheck
+Crawling at Home Project
+Curious
 DIIbot
-Dirbuster
-Discoverybot
-Domains Project
-Dotbot
-ECCP/1.0
+Disco
+DnyzBot
 EMail Wolf
-EirGrabber
-ExtLinksBot
-FemtosearchBot
-GalaxyBot
-GetRight
-Gigabot
-HaosouSpider
+EyeNetIE
+GoZilla
+Google-Extended
+Gotit
+GrabNet
+Havij
 HybridBot
-InfoNaviRobot
-IstellaBot
-JennyBot
-JikeSpider
-Joomla
-LWP::Simple
-Lanshanbot
-LibWeb
+Iria
+Iskanie
+Jorgee
+Jyxobot
+Larbin
+LeechGet
 LinkScan
-MIIxpc
-Mass Downloader
-MauiBot
-Mister PiX
-Mojolicious
-Mozlila
+LinkWalker
+LinkextractorPro
+Lipperhey Spider
+Mag-Net
+Majestic SEO
+Metauri
+Microsoft Data Access
+Minefield
+Mojeek
 Navroad
-Nessus
-Netvibes
-Niki-bot
-Openvas
-PECL::HTTP
-Petalbot
-Piepmatz
+Ninja
+Nmap
+Nutch
+Octopus
+OnCrawl
+OpenLinkProfiler
+Page Analyzer
+PageAnalyzer
+Pavuk
+PeoplePal
+Picsearch
+Pimonster
 ProWebWalker
-Proximic
 Psbot
-RankActiveLinkBot
-RankFlex
-Rankivabot
-RedesScrapy
-SEOstats
-SMTBot
-Scanbot
+SBIder
+SEOlyticsCrawler
+SalesIntelligent
 SentiBot
-SeoSiteCheckup
-Siteimprove
-Sitevigil
-Snake
-Sociscraper
-Toata
-Trendictionbot
-Turnitin
-VCI
-VidibleScraper
+Site Sucker
+SiteSnagger
+SmartDownload
+Snoopy
+Sucuri
+Szukacz
+TheNomad
+Tracemyfile
+URLy.Warning
+V-BOT
 Voil
-WWW-Collector-E
-WWW-Mechanize
-WWW::Mechanize
-WallpapersHD
-WebFetch
-WebPix
+Voltron
+WWWOFFLE
+Web Collage
+Web Sauger
+WebLeacher
 WebReaper
-WebWhacker
-WebmasterWorldForumBot
-WinHTTrack
-WiseGuys Robot
-Woobot
+Whack
 Zauba
-anthropic-ai
-clark-crawler
-coccocbot
-crawler.feedback
-internetVista monitor
-pcBrowser
-seostar
-serpstatbot
-voyagerx.com
+ZoominfoBot
+arquivo-web-crawler
+cognitiveseo
+gopher
+imagesift.com
+ips-agent
+linkdexbot
+lwp-request
+openai
+scalaj-http
+scan.lol
+sexsearcher
+webmeup-crawler
+zauba.io