nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-07 22:07:28 +00:00

250 lines
2.6 KiB
Text

360Spider
AIBOT
ALittle Client
ASPSeek
Aboundex
Acunetix
AhrefsBot
AllSubmitter
AlphaBot
Anarchie
Ankit
Anthill
Apexoo
Aspiegel
Attach
BDCbot
BacklinkCrawler
Badass
Battleztar Bazinga
Blackboard
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
Brandwatch
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CSHttp
Calculon
CheeseBot
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copyscape
Craftbot
CrazyWebCrawler
Crescent
CyotekWebCopy
DIIbot
DSearch
DataCha0s
Demon
Dirbuster
Discobot
Discoverybot
DnyzBot
DomainCrawler
DomainStatsBot
Domains Project
EMail Siphon
Ebingbong
Ecxi
ExtLinksBot
EyeNetIE
Ezooms
Firefox/7.0
FlashGet
Foobot
FrontPage
GT::WWW
GalaxyBot
Genieo
Go!Zilla
Go-Ahead-Got-It
HEADMasterSEO
HTMLparser
HTTP::Lite
Haansoft
Heritrix
Humanlinks
IDBot
IRLbot
Id-search
Image Fetch
InfoTekies
InterGET
Iskanie
JikeSpider
Joomla
JustView
LeechFTP
LexiBot
LibWeb
Linkbot
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
MIIxpc
MJ12bot
Majestic-SEO
MarkMonitor
Mass Downloader
MauiBot
Mb2345Browser
MicroMessenger
Mojeek
MolokaiBot
Mr.4x3
Msrabot
Nameprotect
Net Vampire
NetLyzer
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
Nikto
Not
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeSpider
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picsearch
PictureFinder
Pixray
PleaseCrawl
Pockey
ProPowerBot
Probethenet
PyCurl
RankingBot2
RankurBot
Re-re
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SEOstats
SISTRIX
Scanbot
Scrapy
Screaming
SearchmetricsBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
SmartDownload
Snapbot
Snoopy
Sociscraper
Spammen
SputnikBot
Sqlworm
Sqworm
Steeler
Stripper
Sucuri
SuperBot
SurveyBot
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
Toweyabot
Trendiction
True_Robot
Twice
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
WISENutbot
WWW-Collector-E
WWW::Mechanize
WallpapersHD
Web Enhancer
Web Fetch
Web Pix
Web Sauger
WebAuto
WebBandit
WebFetch
WebPix
WebStripper
WebSucker
WebZIP
Whack
WinHTTrack
Wonderbot
Wprecon
Zauba
Zeus
Zitebot
ZmEu
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
crawl.sogou.com
crawler.feedback
crawler4j
domainsproject.org
instabid
internetVista monitor
isitwp.com
lwp-request
lwp-trivial
muhstik-scan
oBot
page scorer
pcBrowser
polaris version
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
seocompany.store
seostar
serpstatbot
sitechecker.pro
ubermetrics-technologies.com
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zauba.io