nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-12 22:06:56 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
Abonti
Aipbot
Alexibot
Asterias
AwarioRssBot
BDCbot
BLEXBot
BackStreet
Bandit
Barkrowler
BatchFTP
Bitacle
Blow
Boardreader
Brandprotect
BuiltWith
Bullseye
BunnySlippers
CODE87
Calculon
CheTeam
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
Custo
DBLBot
DSearch
Devil
Disco
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Download Wonder
ECCP/1.0
EMail Siphon
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GermCrawler
GetWeb
Getintent
Go!Zilla
GoZilla
Grabber
HTTrack
Haansoft
Havij
Humanlinks
HybridBot
Id-search
IlseBot
Image Sucker
InterGET
IstellaBot
JennyBot
LWP::Simple
LeechFTP
Libwhisker
LinkScan
LinksManager
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
Microsoft URL Control
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
NPbot
Net Vampire
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto
Ninja
Octopus
Offline Navigator
OnCrawl
Openfind
OrangeBot
POE-Component-Client-HTTP
Panscient
Papa Foto
Pi-Monster
Picscout
Picsearch
PictureFinder
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
PxBroker
PyCurl
RSSingBot
RankActiveLinkBot
RankingBot2
Re-re
RebelMouse
RedesScrapy
RepoMonkey
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
ScoutJet
ScreenerBot
ScrepyBot
Searchestate
Semrush
SeoSiteCheckup
Seomoz
Site Sucker
SiteExplorer
Siteimprove
SmartDownload
Snake
Snapbot
SocialRankIOBot
Sociscraper
SpaceBison
Sqlmap
Sqworm
Sucker
Szukacz
T0PHackTeam
T8Abot
Telesoft
Thumbor
TightTwatBot
Titan
Toata
Tracemyfile
Trendictionbot
Turnitin
Twice
Typhoeus
UnisterBot
VB Project
VCI
Vacuum
Voltron
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Collage
Web Pix
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFetch
WebLeacher
WebPix
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Webster
Wonderbot
Wprecon
Xaldon WebSpider
Xenu
YoudaoBot
Zermelo
Zitebot
ZmEu
ZoomBot
ZyBorg
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
clark-crawler
cognitiveseo
eCatch
evc-batch
gopher
isitwp.com
iubenda-radar
magpie-crawler
meanpathbot
muhstik-scan
ripz
scalaj-http
seocompany.store
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sogouspider
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
x22Mozilla
zauba.io
zgrab