nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-02 22:06:49 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
ASPSeek
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Asterias
AwarioRssBot
AwarioSmartBot
BDCbot
Badass
BatchFTP
Bigfoot
BlackWidow
BlowFish
Buck
BuiltWith
Bullseye
Calculon
CazoodleBot
CensysInspect
CheeseBot
Cliqzbot
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Cosmos
Craftbot
Crescent
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
Devil
Digincore
Dirbuster
Discobot
DnBCrawler-Analytics
DomainStatsBot
Dotbot
Dragonfly
Drip
ECCP/1.0
EMail Siphon
EirGrabber
Extreme Picture Finder
FlashGet
Fuzz
FyberSpider
Fyrebot
GalaxyBot
GermCrawler
Go!Zilla
Grabber
Grafula
GridBot
HEADMasterSEO
HMView
Haansoft
Havij
Humanlinks
InfoTekies
InterGET
Iria
Iskanie
JOC Web Spider
JamesBOT
JetCar
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
LWP::Simple
Lanshanbot
LeechFTP
Libwhisker
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MTRobot
Majestic SEO
Majestic12
Mass Downloader
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft URL Control
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
NICErsPRO
Name Intelligence
Nessus
NetMechanic
Netcraft
NextGenSearchBot
Niki-bot
NimbleCrawler
Nimbostratus
Nmap
Nutch
Octopus
Offline Explorer
OpenVAS
OutclicksBot
PECL::HTTP
Panscient
Pixray
ProPowerBot
ProWebWalker
Probethenet
Psbot
RankActiveLinkBot
Rankivabot
Re-re
ReGet
Recorder
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOstats
SMTBot
ScanAlert
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
Snake
Sociscraper
Sosospider
Sottopop
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Sucuri
Surfbot
Szukacz
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
Titan
Trendictionbot
True_Robot
Turingos
UnisterBot
Upflow
VCI
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voil
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Pix
WebCollage
WebEnhancer
WebFuck
WebLeacher
WebPix
WebReaper
Webalta
Website Quester
WebsiteQuester
Webster
WinHTTrack
Wprecon
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZumBot
archive.org_bot
arquivo-web-crawler
autoemailspider
clark-crawler
coccocbot-web
cognitiveseo
crawler.feedback
dataforseo.com
demandbase-bot
evc-batch
facebookscraper
internetVista monitor
isitwp.com
lwp-trivial
meanpathbot
muhstik-scan
oBot
pcBrowser
probe-image-size
scan.lol
seobility
sexsearcher
sogouspider
sp_auditbot
spyfu
trendiction.de
webgains-bot
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zgrab