nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-15 10:09:33 +00:00

250 lines
2.7 KiB
Text

01h4x.com
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
Alligator
Anarchie
Anarchy
Ankit
Apexoo
Asterias
AwarioSmartBot
BDFetch
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
BatchFTP
BetaBot
BlackWidow
BlowFish
Brandprotect
Brandwatch
Buddy
BunnySlippers
CSHttp
CheeseBot
CherryPicker
Chlooe
Collector
Curious
DSearch
DTS Agent
DataCha0s
Demon
Devil
Digincore
DigitalPebble
Disco
Discobot
Dispatch
DomainCrawler
Dotbot
Download Wonder
Drip
ECCP/1.0
EMail Siphon
ExtLinksBot
Extreme Picture Finder
Ezooms
FemtosearchBot
Flunky
Freeuploader
FrontPage
Fuzz
FyberSpider
Genieo
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
GrapeshotCrawler
HMView
Harvest
Heritrix
HybridBot
IDBot
Iblog
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
InterGET
Internet Ninja
IstellaBot
Jbrofuzz
JetCar
JikeSpider
JustView
Kenjin Spider
Keyword Density
Kozmosbot
LWP::Simple
LeechFTP
LexiBot
Lftp
Libwhisker
LieBaoFast
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MIIxpc
MJ12bot
Mail.RU_Bot
Majestic-SEO
Mata Hari
Mb2345Browser
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mojeek
Mojolicious
MolokaiBot
Mozlila
Msrabot
Musobot
Name Intelligence
NetLyzer
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nmap
Nuclei
Nutch
Offline Navigator
OnCrawl
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Pavuk
PleaseCrawl
ProWebWalker
Pu_iN
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RepoMonkey
Ripper
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SMTBot
Scanbot
Scrapy
ScrepyBot
SearchmetricsBot
Seekport
Semrush
SemrushBot
SeobilityBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snapbot
SocialRankIOBot
Sosospider
Sottopop
SpaceBison
Spammen
Sqlmap
Steeler
Sucker
SurveyBot
Telesphorep
The Intraformant
Thumbor
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TwengaBot
Twice
URLy Warning
URLy.Warning
Upflow
VB Project
VidibleScraper
VoidEYE
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
Wallpapers/3.0
Web Collage
Web Fuck
Web Pix
Web Sauger
WebCopier
WebGo IS
WebImageCollector
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Whacker
Widow
Wprecon
Xenu
YoudaoBot
Zeus
ZoominfoBot
ZumBot
archive.org_bot
arquivo-web-crawler
autoemailspider
cah.io.community
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
eCatch
internetVista monitor
iubenda-radar
linkdexbot
lwp-trivial
netEstate NE Crawler
page scorer
plumanalytics
ripz
satoristudio.net
scan.lol
seobility
seoscanners
sexsearcher
sitechecker.pro
siteripz
sysscan
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
xpymep1.exe
zgrab