nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-21 22:04:59 +00:00

100 lines
1.1 KiB
Text

404checker
Aboundexbot
AhrefsBot
BBBike
BackWeb
BatchFTP
BuzzSumo
CensysInspect
CheTeam
Cliqzbot
Copyscape
Craftbot
DatabaseDriverMysqli
Digincore
DittoSpyder
DomainAppender
Dragonfly
EroCrawler
EyeNetIE
Foobot
Freeuploader
FyberSpider
GetRight
HTTrack
Haansoft
HaosouSpider
Id-search
Image Sucker
InterGET
Internet Ninja
JOC Web Spider
Jbrofuzz
Kenjin Spider
Keybot Translation-Search-Machine
LeechFTP
LieBaoFast
Likse
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
MIDown tool
Masscan
MeanPath Bot
Moblie Safari
Mojeek
Msrabot
NICErsPRO
NetMechanic
NextGenSearchBot
Nimbostratus
Nuclei
OnCrawl
OrangeSpider
PageAnalyzer
PageThing.com
Pi-Monster
Piepmatz
Pimonster
Pixray
Pockey
ProPowerBot
Psbot
RankActiveLinkBot
RankFlex
Reaper
RepoMonkey
SEOkicks
ScanAlert
Site Sucker
SiteLockSpider
Sogou web spider
Steeler
Stripper
Sucuri
Trendictionbot
TwengaBot
Upflow
Vagabondo
WebFetch
WebPix
WebStripper
WebZIP
Webshag
Zade
backlink-check
check1.exe
clark-crawler
coccocbot
crawler4j
eCatch
gopher
oBot
seobility
siteripz
voyagerx.com
webprosbot
zgrab