nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-07 22:07:26 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Attach
AwarioRssBot
BBBike
BDFetch
BackStreet
Bandit
BatchFTP
Black Hole
BlowFish
Bolt
BotALot
Brandprotect
Buddy
BuiltWith
BuzzSumo
CATExplorador
CCBot
CSHttp
Cegbfeieh
CensysInspect
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cloud mapping
CrunchBot
Custo
CyotekWebCopy
DIIbot
DSearch
Demon
Devil
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
Domains Project
Dotbot
EMail Wolf
EasyDL
Ecxi
EroCrawler
Exabot
EyeNetIE
FDM
FHscan
Fimap
FlashGet
Flunky
Foobot
Freeuploader
Genieo
GetWeb
Getintent
Gigabot
GoZilla
Grabber
GrapeFX
HEADMasterSEO
HTTrack
HaosouSpider
Havij
HybridBot
IDBTE4M
IDBot
IRLbot
IlseBot
InfoTekies
InterGET
Jbrofuzz
JikeSpider
JustView
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
Larbin
LeechFTP
LeechGet
Likse
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
Litemage_walker
MIDown tool
MJ12bot
MSIECrawler
MTRobot
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mata Hari
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
NPbot
Name Intelligence
Needle
Nessus
NetSpider
Netcraft
NextGenSearchBot
Nibbler
Nuclei
Offline Explorer
Offline Navigator
Openfind
Openvas
OrangeSpider
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
Panscient
Papa Foto
Pavuk
Pi-Monster
PictureFinder
Pimonster
ProPowerBot
Pump
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot2
Rankivabot
RankurBot
ReGet
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Semrush
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteLockSpider
SiteSnagger
Siteimprove
SocialRankIOBot
SpaceBison
Spammen
Spinn3r
Sqworm
Steeler
Stripper
SuperHTTP
Suzuran
T0PHackTeam
T8Abot
Teleport
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Trendiction
Trendictionbot
Turnitin
URLy Warning
Upflow
Vagabondo
VelenPublicWebCrawler
Virusdie
Voltron
WBSearchBot
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Fetch
WebCollage
WebCopier
WebFetch
WebLeacher
WebStripper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whack
Whacker
WiseGuys Robot
Woobot
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zitebot
ZmEu
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
domainsproject.org
gopher
heritrix
instabid
internetVista monitor
isitwp.com
lwp-request
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
ripz
scan.lol
seoscanners
seostar
sitechecker.pro
sogouspider
trendiction.com
webmeup-crawler
webprosbot
x09Mozilla
zauba.io