nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-09-10 10:09:07 +00:00

250 lines
2.6 KiB
Text

404checker
ALittle Client
AllSubmitter
Anarchy
Anarchy99
Ankit
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BLEXBot
BackStreet
Battleztar Bazinga
BetaBot
Bigfoot
Blow
Bolt
Brandwatch
Bullseye
CCBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
ChinaClaw
Claritybot
Cloud mapping
Collector
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
DataCha0s
DatabaseDriverMysqli
Devil
DigitalPebble
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
EroCrawler
Evil
Exabot
EyeNetIE
Firefox/7.0
Flunky
Freeuploader
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
Genieo
GetWeb
Go!Zilla
GoZilla
Gotit
Grabber
HEADMasterSEO
HTMLparser
Haansoft
Havij
Heritrix
Humanlinks
HybridBot
IDBTE4M
IndeedBot
Indy Library
InfoTekies
Intelliseek
Iria
Jyxobot
Kinza
LWP::Simple
Leap
LeechFTP
Lftp
LieBaoFast
Lightspeedsystems
Likse
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey Spider
MIIxpc
MSFrontPage
MSIECrawler
Mail.RU_Bot
MauiBot
MeanPath Bot
Metauri
MicroMessenger
Mister PiX
Msrabot
Nameprotect
Net Vampire
NetAnts
NetMechanic
Netcraft
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Nuclei
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics
Panscient
Pavuk
Petalbot
Pixray
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pu_iN
Pump
PyCurl
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot
Re-re
ReGet
RepoMonkey
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SalesIntelligent
ScoutJet
Scrapy
Screaming
ScrepyBot
Searchestate
Seomoz
Siphon
SiteLockSpider
Sitevigil
Sosospider
Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
Sqlmap
Sqworm
Steeler
Sucuri
SuperBot
Surfbot
Teleport
TeleportPro
TheNomad
Trendictionbot
Turingos
TurnitinBot
TwengaBot
Twice
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voltron
WASALive-Bot
WISENutbot
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebCollage
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebSucker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Whack
Xaldon WebSpider
Xenu
YoudaoBot
Zauba
Zermelo
Zeus
ZmEu
ZumBot
arquivo.pt
cah.io.community
clark-crawler
crawl.sogou.com
facebookscraper
instabid
ips-agent
magpie-crawler
meanpathbot
mediawords
page scorer
plumanalytics
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seobility
seocompany.store
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
sysscan
tAkeOut
webgains-bot
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io