nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-06-29 14:02:06 +02:00

250 lines
2.6 KiB
Text

404enemy
80legs
Aboundex
ADmantX
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Apexoo
ASPSeek
autoemailspider
Backlink-Ceck
backlink-check
BackStreet
BackWeb
Badass
BatchFTP
Battleztar Bazinga
BBBike
Bitacle
Blackboard
BLEXBot
BlowFish
BotALot
Buddy
BuiltWith
BuzzSumo
Calculon
CATExplorador
CheeseBot
CherryPicker
CheTeam
Claritybot
Cliqzbot
coccocbot-web
Cogentbot
Collector
Copier
CopyRightCheck
Copyscape
crawler4j
crawler.feedback
Crescent
CrunchBot
CSHttp
Curious
DatabaseDriverMysqli
demandbase-bot
Deusu
DigitalPebble
DIIbot
Discobot
Discoverybot
Dispatch
DomainAppender
DomainSigmaCrawler
Dragonfly
EroCrawler
ExtLinksBot
Extreme Picture Finder
FHscan
Firefox/7.0
Fyrebot
GalaxyBot
Genieo
GermCrawler
Getintent
Gigablast
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
Grabber
GrabNet
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Havij
HEADMasterSEO
Heritrix
HMView
HTTP::Lite
HTTrack
HybridBot
Iblog
IlseBot
IndeedBot
InfoNaviRobot
InfoTekies
instabid
Internet Ninja
internetVista monitor
Iria
JamesBOT
Jbrofuzz
Jorgee
Jyxobot
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
Likse
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Litemage_walker
Ltx71
lwp-trivial
Magnet
Majestic12
MarkWatch
Masscan
Mass Downloader
Mata Hari
MauiBot
mediawords
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Msrabot
MS Web Services Client Protocol
muhstik-scan
Nameprotect
NearSite
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
Netvibes
NICErsPRO
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Nutch
oBot
Octopus
Openfind
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
PageGrabber
Panscient
PECL::HTTP
PeoplePal
PictureFinder
Pimonster
Probethenet
ProPowerBot
ProWebWalker
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RealDownload
RebelMouse
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
ScreenerBot
Semrush
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
seoscanners
SISTRIX
Sitebeam
SiteSucker
SlySearch
SMTBot
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
SpankBot
Spinn3r
spyfu
Steeler
Stripper
Sucker
SuperBot
Swiftbot
tAkeOut
TeleportPro
Toata
Tracemyfile
trendiction.com
trendiction.de
True_Robot
Turingos
TurnitinBot
Twice
Typhoeus
UnisterBot
Upflow
URLy.Warning
Wallpapers/3.0
WallpapersHD
WBSearchBot
Webalta
WebAuto
WebCollage
Web Collage
WEBDAV
Web Enhancer
Web Fetch
WebFuck
WebImageCollector
WebPix
WebsiteExtractor
Website Quester
WebSucker
WebWhacker
WebZIP
Whack
Whacker
Who.is Bot
WISENutbot
WWW-Mechanize
x09Mozilla
x22Mozilla
Xaldon_WebSpider
xpymep1.exe
Zade
zauba.io
Zermelo
Zeus
zgrab
Zitebot
ZumBot
ZyBorg