nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-10-17 20:49:19 +02:00

250 lines
2.6 KiB
Text

360Spider
404checker
80legs
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Anarchie
Apexoo
arquivo.pt
arquivo-web-crawler
Asterias
Attach
backlink-check
BacklinkCrawler
BackStreet
Badass
Barkrowler
BDCbot
Black Hole
BlackWidow
BlowFish
Bolt
BotALot
Brandwatch
BuiltBotTough
BuzzSumo
CATExplorador
CazoodleBot
CheeseBot
CheTeam
Chlooe
Cliqzbot
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Craftbot
crawler4j
crawl.sogou.com
CrunchBot
CSHttp
Custo
DBLBot
demandbase-bot
Deusu
DigitalPebble
Dirbuster
Disco
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dragonfly
DSearch
DTS Agent
EMail Siphon
Evil
Express WebPictures
Extractor
EyeNetIE
Ezooms
facebookscraper
FDM
FemtosearchBot
FHscan
Firefox/7.0
Freeuploader
FyberSpider
Genieo
GermCrawler
GetRight
G-i-g-a-b-o-t
Gotit
Grabber
GrabNet
GridBot
HaosouSpider
Harvest
Havij
HEADMasterSEO
heritrix
Heritrix
HybridBot
IDBot
Image Fetch
Indy Library
instabid
Intelliseek
InternetSeer
IstellaBot
JamesBOT
JennyBot
JikeSpider
Joomla
Jorgee
Jyxobot
Larbin
LeechGet
Lftp
Libwhisker
Likse
Linkdexbot
LinkpadBot
LinkScan
LNSpiderguy
Ltx71
LWP::Simple
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic12
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mass Downloader
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft Data Access
MIDown tool
MIIxpc
MSFrontPage
muhstik-scan
Musobot
Nameprotect
Navroad
NearSite
Needle
NetAnts
Nettrack
NetZIP
Nutch
Offline Explorer
Openvas
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
Pandalytics
pcBrowser
PECL::HTTP
PeoplePal
PictureFinder
Pimonster
Pi-Monster
Pixray
plumanalytics
Pockey
POE-Component-Client-HTTP
RankActive
RankActiveLinkBot
RankingBot
RankurBot
RealDownload
Reaper
RebelMouse
RedesScrapy
ReGet
Ripper
RocketCrawler
SalesIntelligent
Scanbot
ScreenerBot
Searchestate
Semrush
SemrushBot
SEOprofiler
seoscanners
SeoSiteCheckup
sexsearcher
Sitebeam
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
SmartDownload
SMTBot
Snake
Snoopy
sp_auditbot
Spbot
Sqworm
Sucker
Sucuri
SuperBot
SurveyBot
Swiftbot
sysscan
tAkeOut
Telesphoreo
The Intraformant
Thumbor
Toata
Toweyabot
Trendictionbot
trendiction.de
True_Robot
Turingos
TurnitinBot
TwengaBot
Typhoeus
Vagabondo
VCI
VidibleScraper
VoidEYE
Voil
WallpapersHD
WebAuto
WebCollage
Web Collage
WebEnhancer
Web Fetch
Web Fuck
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
Web Sauger
Webshag
WebsiteExtractor
Webster
Web Sucker
WebWhacker
WeSEE
Widow
Wonderbot
Wotbox
Wprecon
WWW-Collector-E
WWW-Mechanize
x09Mozilla
Xaldon WebSpider
xpymep1.exe
Zade
Zauba
zauba.io
zgrab
ZmEu