nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-10 22:04:49 +00:00

100 lines
1 KiB
Text

AlphaBot
Anarchy
Backlink-Ceck
BacklinkCrawler
BatchFTP
Bigfoot
Blow
Citoid
Cogentbot
Craftbot
CrunchBot
Custo
Deusu
Discoverybot
DomainAppender
Domains Project
EroCrawler
Exabot
ExtractorPro
FDM
Foobot
FyberSpider
GPTBot
GalaxyBot
Genieo
GermCrawler
GetRight
Harvest
Heritrix
HonoluluBot
Iblog
InfoNaviRobot
Iria
IstellaBot
JamesBOT
JennyBot
Kinza
LNSpiderguy
LibWeb
LieBaoFast
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
Litemage_walker
MIIxpc
MJ12bot
MQQBrowser
Mag-Net
Majestic12
Mata Hari
MauiBot
Meanpathbot
Metauri
Minefield
Mister PiX
Mojolicious
NPbot
PictureFinder
Quick-Crawler
ReGet
RealDownload
RepoMonkey
SBIder
SEOkicks
Screaming
Searchestate
SenutoBot
SeobilityBot
Sitevigil
Snake
Snapbot
Sociscraper
Sqworm
Sucker
SuperBot
T8Abot
Telesphoreo
The Intraformant
Toata
VelenPublicWebCrawler
WPScan
WallpapersHD
WebFetch
WebLeacher
WebWhacker
Webshag
Webster
Whacker
Wotbox
autoemailspider
check1.exe
clark-crawler
com.plumanalytics
netEstate NE Crawler
satoristudio.net
seoscanners
seostar
serpstatbot
spyfu
xpymep1.exe