nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-test.list
2020-05-29 23:00:46 +02:00

250 lines
2.6 KiB
Text

360Spider
404checker
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AIBOT
Aipbot
Alligator
AlphaBot
Aspiegel
ASPSeek
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
BackWeb
Barkrowler
BBBike
BDFetch
BetaBot
Bigfoot
Bitacle
BlowFish
Boardreader
Bolt
Brandprotect
BuiltBotTough
Bullseye
BuzzSumo
CCBot
CherryPicker
CheTeam
Claritybot
Cliqzbot
Cogentbot
cognitiveseo
Collector
crawler4j
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
DatabaseDriverMysqli
DBLBot
Deusu
Devil
DigitalPebble
Dirbuster
Disco
Dispatch
DittoSpyder
DnyzBot
Domains Project
domainsproject.org
DomainStatsBot
Drip
DSearch
DTS Agent
EasyDL
Ebingbong
Ecxi
EMail Wolf
Exabot
Express WebPictures
ExtLinksBot
facebookscraper
FDM
FHscan
Fimap
Freeuploader
FrontPage
FyberSpider
GalaxyBot
GermCrawler
Go-Ahead-Got-It
Gotit
GrapeFX
GridBot
GT::WWW
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
heritrix
Hloader
HTMLparser
Humanlinks
IDBot
IlseBot
Image Sucker
Indy Library
InfoTekies
Intelliseek
Iskanie
IstellaBot
JennyBot
JikeSpider
JOC Web Spider
Jyxobot
Keyword Density
Kinza
Kozmosbot
LeechFTP
LibWeb
Libwhisker
LieBaoFast
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
meanpathbot
Mediatoolkitbot
Microsoft Data Access
Mister PiX
MJ12bot
Mojeek
Mojolicious
Mr.4x3
MSIECrawler
muhstik-scan
Musobot
Name Intelligence
NearSite
NetAnts
Netcraft
netEstate NE Crawler
NetMechanic
Nettrack
Netvibes
NetZIP
Nibbler
Nikto
NimbleCrawler
Nmap
NPbot
Nutch
Openfind
OpenLinkProfiler
OpenVAS
OutclicksBot
PageGrabber
Panscient
pcBrowser
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pimonster
ProPowerBot
ProWebWalker
Psbot
RankFlex
RankingBot
RankingBot2
RankurBot
Reaper
RedesScrapy
ReGet
Ripper
Rogerbot
SalesIntelligent
SBIder
ScanAlert
scan.lol
ScreenerBot
Semrush
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler
SeoSiteCheckup
sexsearcher
SISTRIX
SiteExplorer
Siteimprove
Site Sucker
SMTBot
Snake
Snapbot
Sociscraper
sogouspider
Sottopop
SpankBot
SputnikBot
Sqworm
Sucuri
SuperBot
Swiftbot
sysscan
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo
Telesphorep
TheNomad
Toata
trendiction.de
Turingos
Turnitin
URLy.Warning
VeriCiteCrawler
Virusdie
Voil
WallpapersHD
Webalta
WebAuto
WebCollage
Web Collage
WebEnhancer
Web Enhancer
WebFetch
WebFuck
Web Fuck
WebGo IS
webmeup-crawler
Web Pix
WebReaper
Web Sauger
Webshag
WebsiteExtractor
WeSEE
Whacker
Wonderbot
Woobot
Wprecon
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xenu
YoudaoBot
Zade
Zauba
zauba.io
zgrab