nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-06 22:07:10 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
Aboundex
Acunetix
AfD-Verbotsverfahren
Alexibot
Anarchy
Ankit
Anthill
Apexoo
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BLEXBot
BackWeb
Backlink-Ceck
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Black Hole
BlackWidow
BlowFish
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
CheeseBot
Chlooe
Citoid
Claritybot
Cocolyzebot
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
Custo
DBLBot
DTS Agent
DatabaseDriverMysqli
Devil
DigitalPebble
Discoverybot
Dispatch
DittoSpyder
DomainCrawler
DomainSigmaCrawler
EMail Siphon
EirGrabber
EroCrawler
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
Firefox/7.0
Freeuploader
FrontPage
FyberSpider
G-i-g-a-b-o-t
GermCrawler
Getintent
Gigabot
GoZilla
Gotit
Grabber
Grafula
HMView
HTMLparser
HTTP::Lite
Haansoft
Harvest
Hloader
Humanlinks
IDBTE4M
Id-search
Image Fetch
IndeedBot
Indy Library
InterGET
Internet Ninja
JamesBOT
Jbrofuzz
JennyBot
Jetty
Jorgee
Kozmosbot
LeechGet
LexiBot
Lftp
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinqiaScrapeBot
Lipperhey
Lmspider
MIDown tool
MQQBrowser
MSIECrawler
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
MicroMessenger
Microsoft Data Access
Mister PiX
Mojeek
MolokaiBot
Mozlila
Msrabot
Musobot
NPbot
NearSite
Needle
Nessus
NetMechanic
NextGenSearchBot
Nibbler
NimbleCrawler
Ninja
Not
Nuclei
Octopus
OnCrawl
Openfind
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageScorer
Picscout
PictureFinder
Pimonster
PleaseCrawl
ProPowerBot
PyCurl
QueryN Metasearch
RealDownload
RepoMonkey
SBIder
SISTRIX
SalesIntelligent
Scrapy
Screaming
ScrepyBot
Searchestate
Seekport
SemanticJuice
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Sqworm
SuperHTTP
Surfbot
SurveyBot
T0PHackTeam
Teleport
TheNomad
Thumbor
TightTwatBot
True_Robot
Turingos
Turnitin
URLy Warning
UnisterBot
Upflow
VelenPublicWebCrawler
Voltron
WEBDAV
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Sucker
WebFetch
WebFuck
WebPix
WebWhacker
Webalta
WebsiteQuester
Whack
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
Zermelo
ZoominfoBot
ZumBot
adscanner
autoemailspider
cognitiveseo
com.plumanalytics
crawler.feedback
eCatch
evc-batch
facebookscraper
gopher
muhstik-scan
pcBrowser
polaris version
ripz
scan.lol
seobility
seocompany.store
seoscanners
seostar
sexsearcher
sogouspider
sp_auditbot
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x22Mozilla
xpymep1.exe
zgrab