nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-12-28 21:27:28 +02:00

250 lines
2.6 KiB
Text

404checker
404enemy
80legs
ADmantX
AfD-Verbotsverfahren
Alexibot
Alligator
Anarchie
Apexoo
archive.org_bot
Attach
autoemailspider
AwarioRssBot
AwarioSmartBot
Backlink-Ceck
backlink-check
Barkrowler
BBBike
BDCbot
BDFetch
BetaBot
Bigfoot
Bitacle
Blackboard
Black Hole
BlowFish
Bolt
BotALot
BuiltBotTough
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
CheeseBot
CheTeam
Chlooe
Claritybot
Cliqzbot
Cogentbot
cognitiveseo
com.plumanalytics
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawl.sogou.com
CrunchBot
CSHttp
Curious
Custo
DataCha0s
DIIbot
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Dragonfly
Drip
eCatch
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
Extractor
ExtractorPro
EyeNetIE
Ezooms
Freeuploader
FrontPage
GermCrawler
Getintent
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Grabber
Grafula
GrapeFX
GridBot
GT::WWW
Harvest
Havij
HEADMasterSEO
heritrix
Heritrix
Hloader
HTTrack
Humanlinks
HybridBot
Iblog
Id-search
Image Sucker
Indy Library
InfoNaviRobot
InterGET
InternetSeer
IRLbot
JamesBOT
JennyBot
Jetty
JikeSpider
JOC Web Spider
JustView
Kozmosbot
Lanshanbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lmspider
LNSpiderguy
magpie-crawler
MarkWatch
MauiBot
Meanpathbot
Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIDown tool
MJ12bot
Mojeek
MSIECrawler
Msrabot
Name Intelligence
Nameprotect
Needle
NetAnts
netEstate NE Crawler
NetLyzer
NextGenSearchBot
NimbleCrawler
Ninja
Nmap
Offline Navigator
Openfind
OpenLinkProfiler
Openvas
OrangeSpider
PageGrabber
page scorer
PageScorer
Pandalytics
Pavuk
PeoplePal
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
ProWebWalker
Pump
QueryN Metasearch
Rankivabot
Reaper
Recorder
RedesScrapy
ReGet
RocketCrawler
SalesIntelligent
SBIder
Scanbot
ScoutJet
Screaming
ScreenerBot
SEOkicks
SEOlyticsCrawler
SEOprofiler
serpstatbot
Siphon
Sitebeam
SiteSnagger
SlySearch
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
sp_auditbot
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
SurveyBot
Szukacz
tAkeOut
Teleport
Telesoft
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendiction
TwengaBot
Twice
URLy Warning
URLy.Warning
Vagabondo
VCI
Virusdie
Voltron
WallpapersHD
Webalta
WebAuto
Web Auto
WebCollage
Web Collage
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebGo IS
WebImageCollector
WebLeacher
Web Pix
WebReaper
Webshag
WebsiteExtractor
Webster
WebStripper
WebSucker
Web Sucker
WebWhacker
WebZIP
WeSEE
Whack
Whacker
Whatweb
WISENutbot
Wotbox
Wprecon
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xenu
zauba.io
Zermelo
zgrab
ZmEu