nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-31 22:07:05 +00:00

250 lines
2.5 KiB
Text

360Spider
ASPSeek
Abonti
Aboundexbot
Acunetix
Alexibot
AllSubmitter
Anarchy99
Apexoo
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
BlowFish
Bolt
Brandprotect
Buddy
Bullseye
BunnySlippers
CSHttp
CherryPicker
Cliqzbot
Cogentbot
Copyscape
Crescent
CrunchBot
Custo
Deusu
Digincore
Disco
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dragonfly
Drip
Ebingbong
Evil
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
FDM
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
GT::WWW
GetWeb
Gigablast
Go!Zilla
Gotit
Grabber
Grafula
GrapeshotCrawler
HEADMasterSEO
Harvest
HybridBot
IDBTE4M
Image Sucker
InfoTekies
Intelliseek
Iria
Iskanie
Jbrofuzz
JetCar
Joomla
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
Larbin
Leap
LeechFTP
LieBaoFast
LinkextractorPro
LinqiaScrapeBot
MQQBrowser
MSIECrawler
Magnet
Majestic SEO
MarkWatch
Masscan
MauiBot
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Metauri
Mister PiX
Mojeek
Mojolicious
Mozlila
Mr.4x3
Musobot
NPbot
NearSite
Needle
Nessus
Net Vampire
Nikto
Ninja
Nuclei
Nutch
Octopus
Offline Navigator
Openfind
Openvas
OutclicksBot
POE-Component-Client-HTTP
PageScorer
PageThing.com
Panscient
Papa Foto
Picscout
Picsearch
Pixray
ProPowerBot
ProWebWalker
Pump
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActiveLinkBot
Rankivabot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
SMTBot
Scrapy
SentiBot
Shodan
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
SocialRankIOBot
Sottopop
SpankBot
Spinn3r
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
Sucker
SuperHTTP
Surfbot
SurveyBot
Swiftbot
Szukacz
Telesphoreo
Telesphorep
Thumbor
Titan
Toweyabot
Turingos
TurnitinBot
Twice
URLy Warning
VB Project
Vagabondo
VelenPublicWebCrawler
Voil
Voltron
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebCollage
WebFuck
WebLeacher
WebPix
WebStripper
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Website Quester
Webster
Whacker
Widow
WiseGuys Robot
Woobot
Wprecon
Zitebot
ZmEu
ZoomBot
ZyBorg
archive.org_bot
autoemailspider
backlink-check
cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics
crawler4j
demandbase-bot
evc-batch
gopher
ips-agent
isitwp.com
magpie-crawler
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser
polaris version
s1z.ru
scalaj-http
seoscanners
seostar
sexsearcher
sogouspider
sp_auditbot
tAkeOut
trendiction.com
voyagerx.com
webpros.com
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe