nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-27 22:06:54 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
ADmantX
ALittle Client
ASPSeek
AiHitBot
Alligator
Anarchie
Anthill
AwarioRssBot
BDCbot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
Bitacle
BlackWidow
Blackboard
BlowFish
Brandprotect
Buck
BuiltBotTough
BuzzSumo
CATExplorador
CODE87
Calculon
CensysInspect
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
Custo
DIIbot
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Devil
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
Dragonfly
ECCP/1.0
Ecxi
EirGrabber
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
EyeNetIE
FDM
Firefox/7.0
Freeuploader
Fuzz
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GetRight
Getintent
Gigablast
Gigabot
Go-Ahead-Got-It
GrabNet
Grafula
GrapeFX
HTTrack
Humanlinks
Id-search
IlseBot
IndeedBot
Intelliseek
InterGET
Iria
Iskanie
Joomla
JustView
Keyword Density
LWP::Simple
Larbin
LeechGet
Lftp
LibWeb
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkWatch
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Name Intelligence
Navroad
NetAnts
NetLyzer
Netcraft
Netvibes
Nibbler
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
PHPCrawl
PageAnalyzer
Pandalytics
Papa Foto
Petalbot
Picscout
Picsearch
Pimonster
Probethenet
Psbot
Pump
Quick-Crawler
RSSingBot
RankingBot
RankingBot2
RealDownload
RocketCrawler
SBIder
SEOkicks
ScoutJet
Scrapy
Screaming
ScreenerBot
Semrush
SemrushBot
Siphon
Site Sucker
SiteCheckerBotCrawler
Sitevigil
SlySearch
SmartDownload
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Spbot
SputnikBot
Stripper
Sucker
Szukacz
Telesphoreo
Thumbor
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TwengaBot
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WWW-Mechanize
WallpapersHD
WeSEE
Web Auto
Web Fuck
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFuck
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
WebmasterWorldForumBot
Website Quester
Whacker
Whatweb
Widow
WiseGuys Robot
Wonderbot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zeus
ZmEu
ZoominfoBot
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
clark-crawler
com.plumanalytics
crawler4j
demandbase-bot
gopher
mediawords
pcBrowser
ripz
s1z.ru
seoscanners
sexsearcher
sitechecker.pro
siteripz
spyfu
trendiction.com
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
zgrab