nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-23 10:13:18 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
AIBOT
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Anarchie
Apexoo
Attach
BBBike
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
BlackWidow
Blackboard
Blow
Bolt
Brandwatch
Buddy
BuzzSumo
CATExplorador
CODE87
CazoodleBot
Cegbfeieh
CherryPicker
ChinaClaw
Citoid
Claritybot
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
Crescent
DSearch
DataCha0s
Deusu
Discoverybot
Dispatch
DnBCrawler-Analytics
DomainCrawler
DomainStatsBot
Download Wonder
Dragonfly
Drip
EMail Siphon
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Ezooms
FHscan
Firefox/7.0
Freeuploader
FrontPage
Fuzz
FyberSpider
Genieo
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX
HTTP::Lite
Haansoft
Heritrix
IDBTE4M
IDBot
IRLbot
Id-search
Image Fetch
IndeedBot
Indy Library
InterGET
InternetSeer
Iria
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
Joomla
Jorgee
Jyxobot
Kinza
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MIDown tool
MIIxpc
MJ12bot
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan
MauiBot
MeanPath Bot
MicroMessenger
Mojolicious
MolokaiBot
Mr.4x3
NPbot
Name Intelligence
Nameprotect
NearSite
Nessus
NetMechanic
Netcraft
Nettrack
Nibbler
Niki-bot
NimbleCrawler
Nmap
Not
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
PHPCrawl
PageGrabber
PageScorer
PageThing.com
Pandalytics
Papa Foto
Picscout
PictureFinder
Pimonster
Pockey
ProWebWalker
Pu_iN
PyCurl
Quick-Crawler
RankFlex
RankurBot
ReGet
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
SemrushBot
Siphon
Site Sucker
SiteSucker
Sitebeam
SlySearch
Snapbot
SocialRankIOBot
Sociscraper
SpankBot
Spinn3r
Sucker
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
TheNomad
TightTwatBot
Toata
Toweyabot
Turingos
Turnitin
Typhoeus
UnisterBot
VeriCiteCrawler
Virusdie
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WWW::Mechanize
WWWOFFLE
WallpapersHD
Web Auto
Web Collage
Web Fetch
WebFetch
WebLeacher
WebPix
WebStripper
WebWhacker
Webalta
Webshag
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
WinHTTrack
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
ZyBorg
arquivo-web-crawler
backlink-check
cah.io.community
cognitiveseo
domainsproject.org
eCatch
heritrix
instabid
isitwp.com
mediawords
pcBrowser
polaris version
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
seobility
serpstatbot
siteripz
sogouspider
trendiction.com
ubermetrics-technologies.com
x09Mozilla
x22Mozilla
xpymep1.exe