nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-11 22:07:06 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
AIBOT
ASPSeek
Aboundex
AhrefsBot
AllSubmitter
Anarchie
Anarchy
Ankit
Anthill
Asterias
Attach
AwarioRssBot
BBBike
BDFetch
BLEXBot
BackWeb
Badass
Barkrowler
BatchFTP
BetaBot
BlackWidow
BlowFish
Boardreader
BuiltWith
BunnySlippers
CATExplorador
Calculon
Cegbfeieh
ChinaClaw
Chlooe
Citoid
Cogentbot
Collector
CopyRightCheck
Craftbot
Curious
Custo
CyotekWebCopy
DIIbot
DSearch
DataCha0s
Demon
DigitalPebble
Dirbuster
Discoverybot
DomCopBot
DomainStatsBot
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
Ecxi
EroCrawler
FlashGet
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
GridBot
Haansoft
Havij
Hloader
HonoluluBot
IDBTE4M
IDBot
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
InternetSeer
Iria
IstellaBot
Jbrofuzz
Jetty
JikeSpider
Jorgee
JustView
Keyword Density
LNSpiderguy
LWP::Simple
LeechGet
Lftp
LibWeb
Lightspeedsystems
Likse
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
MarkMonitor
MauiBot
Meanpathbot
Metauri
MicroMessenger
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Msrabot
NICErsPRO
NPbot
Name Intelligence
NetAnts
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nmap
Not
Offline Explorer
Offline Navigator
Page Analyzer
PageAnalyzer
PageScorer
Panscient
Pavuk
PeoplePal
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pixray
ProWebWalker
Probethenet
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankurBot
RebelMouse
Ripper
RocketCrawler
SBIder
SEOkicks-Robot
SEOlyticsCrawler
Scanbot
Scrapy
Screaming
Searchestate
SearchmetricsBot
SemanticJuice
SentiBot
SeobilityBot
Seomoz
Shodan
SiteCheckerBotCrawler
SiteSucker
Siteimprove
SlySearch
Sociscraper
SpaceBison
Spammen
SpankBot
Spinn3r
Sqlmap
Sucker
Sucuri
Suzuran
Swiftbot
TeleportPro
Telesphorep
The Intraformant
Thumbor
Titan
Toata
Trendictionbot
True_Robot
Turingos
Typhoeus
URLy.Warning
VelenPublicWebCrawler
VoidEYE
Voil
Voltron
WASALive-Bot
WEBDAV
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Sucker
WebCollage
WebEnhancer
WebFetch
WebReaper
WebSucker
WebZIP
Webalta
Webshag
Website Quester
WebsiteExtractor
Widow
WiseGuys Robot
Wonderbot
Woobot
Wprecon
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
arquivo.pt
autoemailspider
backlink-check
com.plumanalytics
crawler.feedback
crawler4j
eCatch
gopher
instabid
isitwp.com
iubenda-radar
linkdexbot
lwp-trivial
mediawords
muhstik-scan
oBot
page scorer
pcBrowser
polaris version
probe-image-size
serpstatbot
sexsearcher
sitechecker.pro
tAkeOut
voyagerx.com
x09Mozilla
xpymep1.exe
zauba.io