nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-30 22:07:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
ASPSeek
Aboundex
Aboundexbot
Acunetix
Alligator
Ankit
Anthill
Asterias
Atomseobot
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
Backlink-Ceck
Badass
Battleztar Bazinga
Bigfoot
Black Hole
Blow
Brandprotect
Buck
BuiltBotTough
BuzzSumo
Calculon
CazoodleBot
Cegbfeieh
CheTeam
Claritybot
Cogentbot
Collector
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
Custo
DBLBot
DataCha0s
Demon
Deusu
Devil
Digincore
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DomainAppender
DomainStatsBot
Drip
ECCP/1.0
EMail Siphon
EroCrawler
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
FHscan
Firefox/7.0
Freeuploader
FrontPage
Fuzz
FyberSpider
GT::WWW
GermCrawler
GetRight
GoZilla
Gotit
Grabber
GridBot
HEADMasterSEO
HTTrack
Havij
Hloader
IDBTE4M
Iblog
InfoNaviRobot
InfoTekies
Internet Ninja
InternetSeer
Iria
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
Joomla
Keyword Density
Kinza
LWP::Simple
Larbin
Leap
LeechFTP
LibWeb
Libwhisker
Likse
LinkScan
LinksManager
Lipperhey
Lipperhey Spider
MIDown tool
MJ12bot
MSFrontPage
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
MegaIndex.ru
Microsoft Data Access
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mozlila
Msrabot
Musobot
NICErsPRO
NearSite
Net Vampire
NetMechanic
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Ninja
Nutch
OnCrawl
OpenLinkProfiler
OpenVAS
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Panscient
Papa Foto
Pavuk
PeoplePal
Petalbot
Picscout
Picsearch
ProPowerBot
Probethenet
Psbot
PxBroker
PyCurl
RSSingBot
RankFlex
RankingBot
RankingBot2
RedesScrapy
SBIder
SEOstats
Screaming
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice
SentiBot
SeobilityBot
Seomoz
SiteCheckerBotCrawler
Siteimprove
Sitevigil
SlySearch
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
SpankBot
Sqlmap
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
Szukacz
The Intraformant
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
URLy.Warning
UnisterBot
Vacuum
VidibleScraper
VoidEYE
Voltron
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Fetch
WebCollage
WebFuck
WebGo IS
WebLeacher
WebReaper
WebSauger
WebZIP
Whacker
Widow
Wonderbot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zeus
ZmEu
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
clark-crawler
coccocbot
crawler4j
demandbase-bot
domainsproject.org
eCatch
isitwp.com
linkdexbot
lwp-trivial
muhstik-scan
page scorer
polaris version
ripz
scalaj-http
seobility
seoscanners
sexsearcher
trendiction.com
ubermetrics-technologies.com
xpymep1.exe
zgrab