nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-10 08:36:36 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ALittle Client
ASPSeek
Acunetix
AhrefsBot
Anarchy
Anthill
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
BatchFTP
BetaBot
Black Hole
Bolt
Buck
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CCBot
CODE87
Calculon
Cegbfeieh
CensysInspect
Claritybot
Collector
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
DataCha0s
DatabaseDriverMysqli
Demon
DigitalPebble
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainStatsBot
Download Wonder
Drip
EMail Wolf
Ebingbong
EroCrawler
Extractor
Extreme Picture Finder
FDM
FHscan
Firefox/7.0
FlashGet
Flunky
Fuzz
Genieo
GermCrawler
GetRight
GetWeb
Go!Zilla
Go-Ahead-Got-It
Gotit
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
Haansoft
HaosouSpider
Harvest
HybridBot
IDBot
Id-search
Image Fetch
Image Sucker
Indy Library
Jbrofuzz
JetCar
Jetty
Joomla
Jorgee
Keybot Translation-Search-Machine
Kozmosbot
LWP::Simple
Lanshanbot
LeechFTP
LeechGet
Lftp
Lightspeedsystems
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIIxpc
MTRobot
Majestic12
Mata Hari
MauiBot
MicroMessenger
Minefield
Mojolicious
Musobot
NPbot
Nessus
NetMechanic
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Nimbostratus
Ninja
Nmap
Not
Offline Navigator
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
PageScorer
PageThing.com
Panscient
Papa Foto
Piepmatz
Pixray
PleaseCrawl
ProWebWalker
Psbot
Pump
PyCurl
Quick-Crawler
RSSingBot
RankingBot2
ReGet
RebelMouse
RedesScrapy
SEOkicks-Robot
SISTRIX
SMTBot
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SemanticJuice
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
SiteLockSpider
SiteSnagger
Sitebeam
SlySearch
Snake
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
Spbot
Sqlworm
Steeler
Stripper
Sucker
SuperBot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Telesoft
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toweyabot
Trendiction
True_Robot
Turnitin
TurnitinBot
Typhoeus
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
Voltron
WASALive-Bot
WPScan
WWW-Mechanize
WWWOFFLE
WallpapersHD
WeSEE
Web Auto
Web Pix
Web Sucker
WebAuto
WebFuck
WebPix
Webalta
Webshag
Webster
Whatweb
Widow
Woobot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zeus
ZmEu
ZoomBot
ZoominfoBot
archive.org_bot
clark-crawler
com.plumanalytics
crawl.sogou.com
demandbase-bot
ips-agent
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
oBot
pcBrowser
satoristudio.net
scan.lol
seobility
serpstatbot
siteripz
spyfu
sysscan
webgains-bot
webpros.com
x09Mozilla
xpymep1.exe
zauba.io