nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-29 11:37:16 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404enemy
80legs
AIBOT
ASPSeek
Aboundex
Aboundexbot
AiHitBot
Alligator
Anarchie
Anarchy
Asterias
AwarioRssBot
BackDoorBot
BackStreet
Backlink-Ceck
Bandit
Barkrowler
Bigfoot
Black Hole
Boardreader
Bolt
Brandprotect
Buck
BuiltBotTough
Bullseye
CATExplorador
CSHttp
Calculon
CherryPicker
Cloud mapping
Cocolyzebot
Cogentbot
Copyscape
Cosmos
Craftbot
CrunchBot
Deusu
Digincore
Discoverybot
Dispatch
Dotbot
Dragonfly
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Firefox/7.0
FlashGet
Flunky
Fuzz
GT::WWW
Go!Zilla
Go-Ahead-Got-It
GrabNet
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
Havij
Heritrix
Humanlinks
IDBTE4M
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
Intelliseek
InterGET
Iskanie
JOC Web Spider
Jbrofuzz
JetCar
Jetty
JikeSpider
Jyxobot
Keyword Density
Larbin
Leap
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
Litemage_walker
Ltx71
MIDown tool
MQQBrowser
MTRobot
Magnet
Majestic SEO
Majestic-SEO
Mb2345Browser
MeanPath Bot
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojeek
Mozlila
Mr.4x3
Musobot
Nameprotect
Needle
Net Vampire
NetAnts
NetLyzer
Netcraft
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Nuclei
Nutch
Octopus
OnCrawl
Openvas
OrangeBot
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
Panscient
Papa Foto
Pavuk
Picscout
Picsearch
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
Pump
PxBroker
PyCurl
QueryN Metasearch
RankFlex
RankingBot2
RankurBot
Re-re
Recorder
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Scrapy
ScrepyBot
Semrush
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
SiteExplorer
SiteSucker
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison
Spbot
Sucker
Surfbot
Swiftbot
T0PHackTeam
T8Abot
Telesphoreo
Telesphorep
TightTwatBot
Toata
True_Robot
Turnitin
URLy.Warning
Upflow
V-BOT
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
Web Auto
Web Collage
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebFetch
WebStripper
WebSucker
WebZIP
Webshag
WebsiteExtractor
WebsiteQuester
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
YoudaoBot
Zauba
ZoominfoBot
ZyBorg
archive.org_bot
arquivo.pt
autoemailspider
check1.exe
crawler.feedback
crawler4j
eCatch
facebookscraper
isitwp.com
lwp-trivial
magpie-crawler
probe-image-size
s1z.ru
serpstatbot
sitechecker.pro
siteripz
sogouspider
sysscan
tAkeOut
ubermetrics-technologies.com
voyagerx.com