nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-10-06 22:06:58 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundex
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Anthill
Aspiegel
Asterias
Attach
BDCbot
BDFetch
BLEXBot
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BlackWidow
Blackboard
BlowFish
Bolt
BuiltWith
BuzzSumo
CATExplorador
CSHttp
CazoodleBot
CheTeam
CherryPicker
ChinaClaw
Chlooe
Claritybot
Copier
Crawling at Home Project
CrunchBot
Curious
DSearch
DataCha0s
DigitalPebble
Dirbuster
Dispatch
DomCopBot
DomainSigmaCrawler
Download Wonder
EMail Siphon
EasyDL
EirGrabber
Evil
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Firefox/7.0
FrontPage
FyberSpider
GT::WWW
Genieo
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grafula
GridBot
HTMLparser
HTTP::Lite
HaosouSpider
Havij
Hloader
HybridBot
IRLbot
IlseBot
Intelliseek
Internet Ninja
IstellaBot
JOC Web Spider
Jbrofuzz
JetCar
Joomla
Jorgee
JustView
Kenjin Spider
Keyword Density
LWP::Simple
Larbin
LeechFTP
Libwhisker
LieBaoFast
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MJ12bot
MTRobot
Magnet
Majestic SEO
MarkMonitor
MauiBot
Mediatoolkitbot
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mozlila
NICErsPRO
Net Vampire
NetAnts
NetLyzer
NetSpider
NetZIP
Netvibes
Niki-bot
Nmap
Nuclei
Offline Explorer
OutfoxBot
PageGrabber
PageScorer
PageThing.com
Panscient
Papa Foto
Petalbot
Piepmatz
PleaseCrawl
ProPowerBot
Pu_iN
Pump
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
Reaper
RebelMouse
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
SeoSiteCheckup
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
SmartDownload
Snapbot
Snoopy
Sottopop
SpaceBison
Spammen
Sqlworm
Sucker
Sucuri
Surfbot
Swiftbot
Szukacz
T8Abot
Telesoft
TightTwatBot
Titan
Toweyabot
Trendictionbot
True_Robot
Turingos
Turnitin
URLy Warning
URLy.Warning
Upflow
VB Project
Vacuum
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
Wallpapers/3.0
Web Auto
Web Fetch
WebBandit
WebCollage
WebFetch
WebGo IS
WebReaper
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whack
Whacker
Widow
WinHTTrack
WiseGuys Robot
Wprecon
Xenu
YoudaoBot
ZmEu
ZoomBot
ZoominfoBot
ZyBorg
arquivo.pt
clark-crawler
com.plumanalytics
crawl.sogou.com
heritrix
internetVista monitor
isitwp.com
magpie-crawler
muhstik-scan
netEstate NE Crawler
page scorer
polaris version
probe-image-size
s1z.ru
scalaj-http
scan.lol
seobility
sexsearcher
siteripz
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webpros.com
x22Mozilla
xpymep1.exe
zauba.io
zgrab