nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-10-17 22:09:43 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ASPSeek
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchy
Anarchy99
Anthill
Attach
AwarioSmartBot
BDCbot
BDFetch
BackStreet
Backlink-Ceck
Bandit
BatchFTP
BetaBot
Bigfoot
Black Hole
BlackWidow
Brandprotect
Brandwatch
Buck
BuiltWith
CSHttp
Calculon
Cegbfeieh
ChinaClaw
Chlooe
Cogentbot
Copyscape
Curious
Custo
CyotekWebCopy
DatabaseDriverMysqli
Discobot
DittoSpyder
DnyzBot
DomCopBot
Domains Project
EMail Wolf
Ecxi
EirGrabber
ExtLinksBot
Extreme Picture Finder
FemtosearchBot
FlashGet
Flunky
Foobot
Fuzz
FyberSpider
GalaxyBot
Genieo
Getintent
Gotit
Grabber
Grafula
HMView
HTMLparser
HTTP::Lite
Heritrix
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Iblog
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
Iskanie
JOC Web Spider
JamesBOT
Keyword Density
Kinza
LNSpiderguy
Larbin
LeechGet
Lftp
Libwhisker
LieBaoFast
LinkScan
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
Majestic12
Mass Downloader
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Moblie Safari
Nameprotect
NearSite
NetMechanic
NetSpider
Netvibes
NimbleCrawler
Offline Navigator
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
PageScorer
PageThing.com
Panscient
Papa Foto
PeoplePal
Picscout
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
ProPowerBot
Probethenet
PyCurl
QueryN Metasearch
RSSingBot
RankActive
ReGet
RealDownload
Recorder
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
Scanbot
Screaming
Searchestate
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
Siteimprove
Sitevigil
Sociscraper
Sosospider
Sottopop
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Sqlmap
Steeler
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesoft
Thumbor
TightTwatBot
Trendiction
True_Robot
Turingos
VB Project
VCI
VelenPublicWebCrawler
Virusdie
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
WeSEE
Web Collage
Web Pix
Web Sauger
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebSauger
WebStripper
WebWhacker
WebZIP
WebmasterWorldForumBot
Whack
Who.is Bot
WiseGuys Robot
Wprecon
Xaldon_WebSpider
Xenu
Zermelo
Zeus
ZumBot
ZyBorg
arquivo-web-crawler
backlink-check
clark-crawler
com.plumanalytics
crawler.feedback
crawler4j
gopher
instabid
lwp-request
magpie-crawler
oBot
page scorer
s1z.ru
scan.lol
sexsearcher
sogouspider
sp_auditbot
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
webpros.com
xpymep1.exe