nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-06 22:07:05 +00:00

250 lines
2.6 KiB
Text

404enemy
ADmantX
AIBOT
ALittle Client
Aboundex
Acunetix
AfD-Verbotsverfahren
AiHitBot
Alexibot
Anarchie
Anthill
Asterias
Attach
AwarioRssBot
BDCbot
BDFetch
Barkrowler
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
BlackWidow
Blow
BotALot
Brandwatch
Buck
BuiltBotTough
BuiltWith
CODE87
CSHttp
CazoodleBot
CheTeam
Chlooe
Cloud mapping
Cogentbot
Copier
Cosmos
Craftbot
Crawling at Home Project
Curious
CyotekWebCopy
DSearch
DTS Agent
Demon
Digincore
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainSigmaCrawler
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Extractor
FDM
Firefox/7.0
Foobot
Freeuploader
Fyrebot
GermCrawler
GoZilla
GrabNet
Grabber
Grafula
HEADMasterSEO
Haansoft
Havij
IDBot
IRLbot
Id-search
IndeedBot
Indy Library
InfoNaviRobot
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jorgee
LNSpiderguy
Leap
LexiBot
LieBaoFast
Likse
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Majestic-SEO
Majestic12
Mb2345Browser
Mediatoolkitbot
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Msrabot
NICErsPRO
NPbot
NearSite
Needle
Nessus
Net Vampire
NetLyzer
Nibbler
Nimbostratus
Ninja
Not
Offline Explorer
Offline Navigator
OpenVAS
Openfind
OrangeSpider
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Pi-Monster
Picsearch
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
RankurBot
Re-re
RebelMouse
RedesScrapy
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
ScrepyBot
SearchmetricsBot
Semrush
SemrushBot
SentiBot
SeobilityBot
Siphon
SiteExplorer
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
Snapbot
Sottopop
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
SurveyBot
Suzuran
Swiftbot
Szukacz
TeleportPro
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Trendiction
Turnitin
TwengaBot
Typhoeus
URLy Warning
V-BOT
VCI
VeriCiteCrawler
VoidEYE
Voltron
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW::Mechanize
WallpapersHD
WeSEE
Web Collage
Web Pix
Web Sauger
WebBandit
WebCopier
WebFuck
WebLeacher
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whacker
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wotbox
Wprecon
Zade
Zauba
Zermelo
Zitebot
adscanner
arquivo-web-crawler
arquivo.pt
backlink-check
com.plumanalytics
crawler.feedback
dataforseo.com
eCatch
gopher
heritrix
instabid
internetVista monitor
isitwp.com
oBot
pcBrowser
satoristudio.net
sexsearcher
siteripz
tAkeOut
ubermetrics-technologies.com
x22Mozilla