nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-25 22:07:35 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
ADmantX
Aboundexbot
AhrefsBot
Alligator
Anarchy99
Asterias
Attach
Backlink-Ceck
Badass
Bandit
BatchFTP
Black Hole
BlackWidow
Blackboard
BlowFish
Brandprotect
Brandwatch
Buck
Buddy
BuiltBotTough
Bullseye
BunnySlippers
CCBot
CODE87
CSHttp
CensysInspect
CheTeam
Chlooe
Citoid
Collector
CrunchBot
Curious
Custo
DataCha0s
Demon
Digincore
Dirbuster
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainStatsBot
Domains Project
Dotbot
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Extreme Picture Finder
FHscan
FemtosearchBot
Foobot
GT::WWW
Genieo
GermCrawler
GetWeb
Go!Zilla
Go-Ahead-Got-It
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
HybridBot
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
Image Fetch
Image Sucker
IndeedBot
InfoTekies
Intelliseek
InterGET
Internet Ninja
JamesBOT
JetCar
JikeSpider
Jorgee
JustView
Jyxobot
Kenjin Spider
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
LeechGet
LibWeb
Likse
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Litemage_walker
MJ12bot
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MicroMessenger
Mister PiX
Mojeek
Mojolicious
Mr.4x3
Musobot
NICErsPRO
Nameprotect
NearSite
Needle
NetMechanic
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Ninja
Nmap
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
Pandalytics
Papa Foto
Pavuk
PeoplePal
Picscout
Picsearch
PleaseCrawl
Probethenet
Psbot
Pump
PxBroker
Quick-Crawler
RankingBot2
Rankivabot
RankurBot
RebelMouse
Recorder
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
ScanAlert
Scanbot
Screaming
Searchestate
SearchmetricsBot
Semrush
SeoSiteCheckup
SiteSucker
Sitebeam
Sitevigil
Snoopy
Sogou web spider
Sosospider
SpaceBison
Spinn3r
Sqlmap
Sqlworm
Steeler
Sucuri
Suzuran
T8Abot
Telesoft
The Intraformant
TheNomad
Thumbor
TightTwatBot
Titan
Toweyabot
Trendictionbot
True_Robot
Turingos
URLy Warning
URLy.Warning
VB Project
Vacuum
VeriCiteCrawler
Voltron
WBSearchBot
WWW-Mechanize
WWW::Mechanize
Wallpapers
Web Collage
WebBandit
WebCollage
WebFetch
WebFuck
WebGo IS
WebPix
WebReaper
WebSauger
WebStripper
Webalta
Website Quester
Webster
Whack
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Xenu
Zermelo
ZoomBot
ZumBot
ZyBorg
archive.org_bot
arquivo.pt
cah.io.community
check1.exe
coccocbot-web
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
gopher
internetVista monitor
mediawords
oBot
page scorer
pcBrowser
plumanalytics
polaris version
seobility
seocompany.store
seoscanners
sexsearcher
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com