nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-test.list
2019-10-15 20:48:39 +02:00

250 lines
2.6 KiB
Text

Aboundex
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
Alligator
AllSubmitter
Anarchie
Apexoo
ASPSeek
Attach
BackDoorBot
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
BDCbot
Bigfoot
Blackboard
BlackWidow
BLEXBot
Bolt
Brandprotect
Brandwatch
BuiltWith
Bullseye
CATExplorador
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
Copyscape
crawler.feedback
crawl.sogou.com
CrunchBot
CSHttp
Curious
Custo
DatabaseDriverMysqli
DataCha0s
Demon
Devil
DomainCrawler
Download Wonder
Dragonfly
Drip
DTS Agent
EasyDL
Ebingbong
Ecxi
Evil
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
Fimap
Flunky
FyberSpider
Fyrebot
GalaxyBot
GermCrawler
GetRight
Go-Ahead-Got-It
Gotit
Grabber
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
Haansoft
Harvest
Hloader
HTMLparser
HTTP::Lite
Humanlinks
Id-search
IlseBot
IndeedBot
InfoTekies
instabid
Internet Ninja
internetVista monitor
IstellaBot
Jbrofuzz
Joomla
Jorgee
Larbin
LeechGet
Lftp
LibWeb
Likse
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
LWP::Simple
lwp-trivial
Magnet
Mail.RU_Bot
MarkWatch
Mass Downloader
Mata Hari
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
Microsoft Data Access
Microsoft URL Control
MIDown tool
MJ12bot
Mojeek
Musobot
Needle
Nessus
NetAnts
Netcraft
NetLyzer
NetMechanic
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
NICErsPRO
NimbleCrawler
Nimbostratus
Nmap
NPbot
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OrangeSpider
PageGrabber
Papa Foto
Pavuk
PECL::HTTP
PHPCrawl
Picscout
Pixray
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankurBot
Reaper
RebelMouse
ReGet
Rogerbot
RSSingBot
s1z.ru
Scanbot
ScoutJet
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
serpstatbot
Shodan
Siphon
Sitebeam
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
SmartDownload
SocialRankIOBot
Sociscraper
sogouspider
Sosospider
Sottopop
SpaceBison
SpankBot
Spanner
SputnikBot
spyfu
Stripper
SurveyBot
Suzuran
sysscan
Szukacz
tAkeOut
Teleport
TeleportPro
Telesoft
The Intraformant
TightTwatBot
Titan
Toweyabot
Trendiction
trendiction.de
True_Robot
Turnitin
TurnitinBot
Twice
URLy.Warning
Vagabondo
VB Project
VidibleScraper
Virusdie
VoidEYE
Voil
WASALive-Bot
Webalta
WebAuto
WebCollage
Web Collage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebLeacher
WebPix
WebReaper
WebSauger
Web Sauger
WebsiteExtractor
WebSucker
Web Sucker
WebWhacker
WebZIP
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wprecon
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xenu
zgrab