nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-13 22:07:05 +00:00

250 lines
2.6 KiB
Text

360Spider
ADmantX
ALittle Client
ASPSeek
AhrefsBot
AiHitBot
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Anthill
AwarioRssBot
BBBike
BackDoorBot
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
BlackWidow
Boardreader
Brandprotect
Buddy
BuiltBotTough
Bullseye
CATExplorador
CCBot
CSHttp
Calculon
CensysInspect
CheTeam
CheeseBot
ChinaClaw
Cliqzbot
Cocolyzebot
Collector
CopyRightCheck
Cosmos
Curious
DIIbot
DataCha0s
Deusu
DigitalPebble
Dirbuster
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Ebingbong
Ecxi
EroCrawler
Extractor
ExtractorPro
EyeNetIE
Ezooms
FDM
FHscan
Firefox/7.0
Freeuploader
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
HMView
HTMLparser
HTTP::Lite
Haansoft
Havij
Hloader
Humanlinks
HybridBot
IRLbot
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoTekies
Intelliseek
InternetSeer
Iria
Iskanie
JennyBot
JetCar
Jorgee
Keyword Density
Kinza
LNSpiderguy
LWP::Simple
Leap
LeechGet
Lftp
LieBaoFast
Likse
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Ltx71
MFC_Tear_Sample
MJ12bot
MSIECrawler
Mag-Net
Majestic12
Mass Downloader
Masscan
Mata Hari
MeanPath Bot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mr.4x3
NearSite
Needle
Nessus
NetAnts
NetMechanic
NetSpider
NetZIP
Netcraft
Netvibes
NextGenSearchBot
NimbleCrawler
Nutch
Offline Navigator
OpenLinkProfiler
OpenVAS
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Petalbot
Psbot
Quick-Crawler
RSSingBot
RankFlex
Rankivabot
Re-re
ReGet
RebelMouse
SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert
Searchestate
SearchmetricsBot
SeoSiteCheckup
SiteLockSpider
Sitebeam
Siteimprove
SlySearch
Snoopy
SocialRankIOBot
Sogou web spider
Spammen
SpankBot
Spbot
Sqlworm
Sqworm
Stripper
Sucker
Surfbot
Swiftbot
Szukacz
Telesoft
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Titan
Trendictionbot
Turnitin
TwengaBot
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
Web Enhancer
Web Fuck
Web Pix
WebAuto
WebBandit
WebFuck
WebStripper
WebWhacker
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
arquivo.pt
backlink-check
cah.io.community
check1.exe
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
domainsproject.org
facebookscraper
gopher
internetVista monitor
linkdexbot
lwp-request
lwp-trivial
polaris version
seoscanners
serpstatbot
spyfu
trendiction.de
xpymep1.exe