nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-18 22:06:56 +00:00

250 lines
2.5 KiB
Text

404enemy
ADmantX
Abonti
Aboundex
AhrefsBot
Alexibot
Alligator
Anarchie
Anarchy
Ankit
AwarioSmartBot
BackStreet
Badass
Black Hole
BlackWidow
Blow
Boardreader
Brandprotect
Brandwatch
Buck
Buddy
CATExplorador
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
ChinaClaw
Chlooe
Claritybot
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Cosmos
Craftbot
Crescent
CrunchBot
DBLBot
DSearch
Deusu
Digincore
DnBCrawler-Analytics
DomainStatsBot
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
Evil
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms
Fimap
FlashGet
Flunky
Freeuploader
FyberSpider
Fyrebot
GT::WWW
Genieo
GetRight
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
GrapeFX
GridBot
HaosouSpider
Harvest
Humanlinks
Iblog
InfoTekies
InterGET
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
JustView
Jyxobot
Keyword Density
LWP::Simple
LeechFTP
Lftp
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MTRobot
MarkWatch
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mozlila
NPbot
NearSite
Net Vampire
NetLyzer
NetSpider
NetZIP
Nettrack
Netvibes
Nibbler
NimbleCrawler
Nutch
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
OutfoxBot
Page Analyzer
PageScorer
Petalbot
Pockey
ProWebWalker
Pu_iN
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankurBot
Re-re
ReGet
RebelMouse
Recorder
Ripper
SBIder
SEOprofiler
ScanAlert
Scanbot
Scrapy
Screaming
Searchestate
Semrush
SentiBot
Site Sucker
Sitevigil
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpankBot
SuperHTTP
Surfbot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesphoreo
TheNomad
Tracemyfile
Trendiction
Turnitin
TurnitinBot
TwengaBot
Twice
URLy.Warning
UnisterBot
Vacuum
VidibleScraper
Virusdie
Voil
WWW-Collector-E
WeSEE
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebCopier
WebFuck
WebLeacher
WebPix
WebZIP
WebsiteExtractor
Webster
Whacker
Who.is Bot
Widow
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
Xenu
Zauba
Zeus
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
backlink-check
check1.exe
clark-crawler
coccocbot
cognitiveseo
crawler4j
dataforseo.com
demandbase-bot
eCatch
evc-batch
facebookscraper
heritrix
instabid
iubenda-radar
linkdexbot
magpie-crawler
muhstik-scan
page scorer
pcBrowser
ripz
scan.lol
sitechecker.pro
sp_auditbot
spyfu
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
zgrab