nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-11-15 10:09:10 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ADmantX
AIBOT
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
Alligator
Anarchy99
Aspiegel
Asterias
Attach
BDFetch
BLEXBot
Barkrowler
Blackboard
BlowFish
Bolt
Brandprotect
Buck
BuiltWith
BunnySlippers
CATExplorador
CODE87
Calculon
CazoodleBot
CensysInspect
CheTeam
Chlooe
Cliqzbot
Cloud mapping
CopyRightCheck
Copyscape
Curious
Custo
DBLBot
DSearch
DTS Agent
Demon
Digincore
Discobot
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Drip
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Exabot
Express WebPictures
Extreme Picture Finder
FemtosearchBot
Freeuploader
Fyrebot
GermCrawler
GetRight
Gigabot
Gotit
GridBot
HEADMasterSEO
HTTP::Lite
Harvest
Heritrix
Hloader
HybridBot
IDBTE4M
IDBot
Iblog
Id-search
IlseBot
IndeedBot
Indy Library
InternetSeer
JennyBot
Jetty
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Keyword Density
LWP::Simple
LeechFTP
LexiBot
LibWeb
Libwhisker
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MFC_Tear_Sample
MIDown tool
MTRobot
Mail.RU_Bot
Majestic12
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Msrabot
NPbot
Navroad
NearSite
Needle
Net Vampire
NetLyzer
Nettrack
Nibbler
Niki-bot
Nikto
Ninja
OnCrawl
OpenLinkProfiler
Openfind
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PageAnalyzer
PageScorer
Pi-Monster
Pimonster
PleaseCrawl
Pockey
ProWebWalker
Probethenet
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankingBot
Re-re
Ripper
Rogerbot
SEOkicks-Robot
SEOprofiler
SEOstats
SMTBot
Scanbot
SearchmetricsBot
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Siteimprove
Snake
SpankBot
Spanner
Stripper
Sucker
Surfbot
SurveyBot
Telesphoreo
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turingos
Turnitin
TurnitinBot
Twice
Upflow
VeriCiteCrawler
Voil
Voltron
WBSearchBot
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Auto
Web Pix
Web Sucker
WebAuto
WebBandit
WebCopier
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
Webalta
Webshag
WebsiteExtractor
Webster
Who.is Bot
YoudaoBot
Zade
Zeus
Zitebot
ZoomBot
adscanner
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawler4j
demandbase-bot
eCatch
facebookscraper
heritrix
isitwp.com
magpie-crawler
mediawords
netEstate NE Crawler
pcBrowser
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seocompany.store
seostar
sitechecker.pro
siteripz
sogouspider
spyfu
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe