nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-12 10:09:21 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
404enemy
80legs
AhrefsBot
Alexibot
AllSubmitter
Alligator
Anarchie
Anarchy
Anarchy99
Ankit
Aspiegel
BDCbot
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
BlackWidow
Bolt
BuiltWith
Bullseye
BunnySlippers
CSHttp
CazoodleBot
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Copier
Cosmos
Craftbot
CrazyWebCrawler
CrunchBot
CyotekWebCopy
DataCha0s
Digincore
Disco
Discoverybot
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Dotbot
ECCP/1.0
EirGrabber
EroCrawler
Evil
FemtosearchBot
Fimap
Foobot
Freeuploader
Fyrebot
Genieo
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
Grabber
HTTrack
Harvest
Havij
Hloader
HonoluluBot
IDBTE4M
Iblog
Id-search
IlseBot
Indy Library
Intelliseek
InterGET
Iria
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
Jorgee
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Lanshanbot
Lftp
Libwhisker
LieBaoFast
LinkScan
LinkWalker
Linkdexbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MSFrontPage
Mag-Net
Magnet
Majestic SEO
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner
Mozlila
NICErsPRO
Nameprotect
Nessus
NetAnts
NetMechanic
NetZIP
Nettrack
Netvibes
Nimbostratus
Not
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
OutclicksBot
OutfoxBot
Page Analyzer
PageScorer
Panscient
PeoplePal
Petalbot
Picscout
Picsearch
Piepmatz
Pockey
ProPowerBot
Pump
PyCurl
RSSingBot
RankActive
RankFlex
RankingBot
RankingBot2
Rankivabot
Re-re
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SEOkicks
Scanbot
ScoutJet
Scrapy
Screaming
ScrepyBot
SearchmetricsBot
Seekport
SemrushBot
Seomoz
Site Sucker
Sitevigil
SlySearch
Snoopy
SpankBot
Spanner
Sqlmap
Sqlworm
Sucuri
SuperBot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Titan
True_Robot
Turnitin
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
Wallpapers
Web Collage
Web Fetch
Web Fuck
Web Sauger
WebGo IS
WebSauger
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Zade
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
autoemailspider
check1.exe
clark-crawler
coccocbot
crawler.feedback
facebookscraper
ips-agent
meanpathbot
mediawords
page scorer
plumanalytics
probe-image-size
ripz
s1z.ru
seobility
seocompany.store
seostar
sp_auditbot
spyfu
sysscan
trendiction.de
webmeup-crawler
xpymep1.exe
zauba.io