V4.2025.08.5380 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
+360Spider
 404enemy
-ADmantX
-Aboundexbot
-AfD-Verbotsverfahren
-AhrefsBot
-AliyunSecBot
-Anarchy99
-Anthill
+Aliyun
+Attach
 AwarioRssBot
-BackDoorBot
-BacklinksExtendedBot
-Barkrowler
+BetaBot
 Boardreader
-Brandwatch
-BuiltBotTough
-BunnySlippers
-CODE87
-Cliqzbot
-Collector
-Crawling at Home Project
+BuiltWith
+Bullseye
+BuzzSumo
+Claritybot
+Cogentbot
 DataCha0s
-Demon
-Discobot
-Discoverybot
-DittoSpyder
-EMail Wolf
-Ebingbong
-Ezooms
-Fyrebot
-GT::WWW
-Genieo
-GetRight
+Dispatch
+DomainAppender
+Dotbot
+Ecxi
+Evil
+Exabot
+Foobot
+Freeuploader
+Getintent
+GrabNet
+Grafula
 HEADMasterSEO
-HMView
-HTMLparser
-HTTrack
-Heritrix
-HybridBot
-IDBTE4M
+Havij
+Hloader
 IstellaBot
-LNSpiderguy
-LeechGet
-Likse
+JamesBOT
+Leap
+LeechFTP
+Lftp
+LinkextractorPro
+LinqiaMetadataDownloaderBot
+Lipperhey
+Lipperhey Spider
 Litemage_walker
-MJ12bot
-Mail.RU_Bot
 Mb2345Browser
-Mozlila
-Msrabot
-Musobot
-Netvibes
-Offline Explorer
-OrangeSpider
-OutfoxBot
-POE-Component-Client-HTTP
-PageScorer
-Papa Foto
-Piepmatz
-Probethenet
-Quick-Crawler
-RankActive
-Re-re
-ReGet
-RebelMouse
-Recorder
+MeanPath Bot
+Mediatoolkitbot
+Minefield
+Needle
+Nessus
+NimbleCrawler
+Nmap
+OnCrawl
+OrangeBot
+Panscient
+PictureFinder
+ProPowerBot
+RSSingBot
+Rainbot
 RedesScrapy
-RocketCrawler
-SEOkicks-Robot
-SEOlyt
-ScanAlert
-SenutoBot
-Sitevigil
-SlySearch
-Spanner
-Sqlmap
-Telesoft
-Telesphoreo
-Trendiction
-Turingos
-Twice
-VCI
-Wallpapers/3.0
-Web Sauger
+Ripper
+SISTRIX
+Searchestate
+SiteAuditBot
+Sottopop
+SpaceBison
+Spammen
+Spbot
+Spinn3r
+SputnikBot
+Sqworm
+Sucker
+SuperHTTP
+T8Abot
+The Intraformant
+Tracemyfile
+TurnitinBot
+Upflow
+Wallpapers
+Web Enhancer
+Web Fuck
 WebCollage
-WebCopier
-WebFuck
-WebStripper
-WinHTTrack
-Wonderbot
-Xaldon WebSpider
-eCatch
-isitwp.com
-openai.com
-page scorer
-s1z.ru
-seocompany.store
-sexsearcher
+Who.is Bot
+Widow
+Woobot
+Wprecon
+Zeus
+ZyBorg
+arquivo-web-crawler
+awario.com
+check1.exe
+cognitiveseo
+cohere-ai
+com.plumanalytics
+crawler.feedback
+demandbase-bot
+mediawords
+muhstik-scan
+ripz
+satoristudio.net
+seostar
+sitechecker.pro
 sysscan
-trendiction.de
+voyagerx.com
+webgains-bot
 webprosbot
+zgrab