nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-11-29 10:09:06 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
ADmantX
ALittle Client
ASPSeek
Aboundex
AfD-Verbotsverfahren
Alligator
Anarchy99
Apexoo
AwarioRssBot
BBBike
BDFetch
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
BlackWidow
Blackboard
Blow
Bolt
BotALot
Brandwatch
BuiltWith
CATExplorador
CODE87
CSHttp
Calculon
Cegbfeieh
CensysInspect
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Copyscape
Cosmos
CrunchBot
Curious
DIIbot
DSearch
DatabaseDriverMysqli
Deusu
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DittoSpyder
Domains Project
Download Wonder
Dragonfly
EMail Siphon
EroCrawler
ExtLinksBot
Extractor
FDM
FHscan
Flunky
Freeuploader
FrontPage
Fuzz
GT::WWW
GalaxyBot
GermCrawler
GetRight
GetWeb
Gotit
Grafula
GrapeshotCrawler
HMView
HTMLparser
Haansoft
Harvest
Heritrix
HonoluluBot
HybridBot
IDBTE4M
IDBot
Id-search
Indy Library
InfoTekies
Iskanie
JOC Web Spider
JamesBOT
JetCar
Jetty
Joomla
Jyxobot
LWP::Simple
Lanshanbot
LeechFTP
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
Linkbot
LinkextractorPro
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MJ12bot
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
Mediatoolkitbot
Microsoft URL Control
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mozlila
NICErsPRO
NPbot
Navroad
Needle
Net Vampire
NetSpider
NetZIP
Netcraft
Nikto
Ninja
Not
Nutch
OpenLinkProfiler
OutclicksBot
PECL::HTTP
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
PeoplePal
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
ProWebWalker
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RankActive
RankurBot
Re-re
RealDownload
Reaper
Recorder
RedesScrapy
RocketCrawler
Rogerbot
SEOkicks
SalesIntelligent
ScoutJet
Scrapy
Seekport
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
Snake
Sociscraper
Spanner
Spbot
SputnikBot
Steeler
Sucuri
SuperHTTP
Surfbot
T0PHackTeam
Telesoft
Telesphoreo
TheNomad
Toweyabot
Tracemyfile
Turingos
TwengaBot
Typhoeus
URLy Warning
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
WISENutbot
WPScan
WWWOFFLE
Wallpapers
WeSEE
Web Auto
Web Collage
WebBandit
WebCopier
WebPix
WebSauger
WebWhacker
WebZIP
Webalta
WebsiteExtractor
Wotbox
Wprecon
YoudaoBot
Zeus
Zitebot
ZoomBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
facebookscraper
gopher
internetVista monitor
linkdexbot
lwp-request
magpie-crawler
netEstate NE Crawler
oBot
probe-image-size
scalaj-http
seobility
seoscanners
siteripz
sp_auditbot
spyfu
sysscan
trendiction.com
trendiction.de
voyagerx.com
x09Mozilla
zauba.io
zgrab