nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-24 22:06:58 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AlphaBot
Anarchy
Anthill
Asterias
AwarioSmartBot
BDCbot
BDFetch
BackStreet
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
Bigfoot
BlackWidow
BlowFish
Bolt
BotALot
Brandprotect
Bullseye
BunnySlippers
CATExplorador
CCBot
CODE87
Calculon
CazoodleBot
CheTeam
CheeseBot
ChinaClaw
Citoid
Claritybot
Cloud mapping
Collector
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
Curious
Custo
DBLBot
Demon
Deusu
Dispatch
DnBCrawler-Analytics
Dotbot
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EirGrabber
EroCrawler
Exabot
Extractor
Ezooms
FDM
FemtosearchBot
Firefox/7.0
FlashGet
FrontPage
FyberSpider
GT::WWW
GalaxyBot
Go!Zilla
GoZilla
GrapeFX
HEADMasterSEO
HMView
HTTP::Lite
HaosouSpider
Heritrix
Iblog
Id-search
IlseBot
Image Sucker
InternetSeer
Iria
JamesBOT
Jetty
Keybot Translation-Search-Machine
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
Lipperhey
Litemage_walker
Lmspider
MFC_Tear_Sample
MIDown tool
MJ12bot
MSFrontPage
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
Majestic12
MarkWatch
Masscan
Mata Hari
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Moblie Safari
MolokaiBot
Musobot
NICErsPRO
NPbot
NearSite
Needle
NetSpider
NetZIP
Netcraft
Niki-bot
Not
Nutch
OpenLinkProfiler
OpenVAS
Openfind
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Pandalytics
Papa Foto
Petalbot
Picscout
Picsearch
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Pump
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot
Rankivabot
Re-re
Reaper
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SEOprofiler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SemanticJuice
SemrushBot
Seomoz
SiteExplorer
SiteSnagger
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snapbot
SocialRankIOBot
SpankBot
Spanner
Spbot
Sqlmap
Sqlworm
Stripper
Sucker
Sucuri
SuperBot
SurveyBot
T0PHackTeam
Teleport
Telesphoreo
Titan
Toata
Trendictionbot
TurnitinBot
VB Project
VCI
Vagabondo
Virusdie
WASALive-Bot
WEBDAV
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
WebFuck
WebGo IS
WebSauger
WebZIP
Webshag
Website Quester
Webster
Whack
Whacker
Whatweb
Wprecon
Zauba
Zermelo
Zitebot
ZyBorg
archive.org_bot
cah.io.community
check1.exe
com.plumanalytics
crawl.sogou.com
domainsproject.org
gopher
heritrix
ips-agent
magpie-crawler
meanpathbot
netEstate NE Crawler
oBot
polaris version
scan.lol
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com