nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-05 10:09:30 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti
AhrefsBot
Aipbot
AllSubmitter
Anarchie
Anarchy99
Apexoo
Atomseobot
AwarioRssBot
AwarioSmartBot
BDCbot
BackWeb
BacklinkCrawler
Barkrowler
Bigfoot
Blackboard
BlowFish
Boardreader
Bolt
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Copier
CopyRightCheck
Cosmos
Crescent
CrunchBot
Custo
DIIbot
DataCha0s
Demon
Devil
Digincore
DigitalPebble
Dirbuster
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainCrawler
Dotbot
Download Wonder
EMail Wolf
EasyDL
EirGrabber
ExtractorPro
Fimap
Freeuploader
Fuzz
GalaxyBot
Genieo
GrapeshotCrawler
HaosouSpider
Havij
Heritrix
Hloader
HonoluluBot
IDBTE4M
Iblog
Id-search
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
Jbrofuzz
Jorgee
Jyxobot
Kenjin Spider
LNSpiderguy
LibWeb
Lightspeedsystems
LinkScan
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample
MIIxpc
MSIECrawler
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MegaIndex.ru
Metauri
Microsoft URL Control
Mister PiX
NICErsPRO
Name Intelligence
NearSite
Nessus
Net Vampire
NetSpider
Netcraft
Nettrack
Netvibes
Nibbler
Nimbostratus
Not
Nuclei
Octopus
Offline Navigator
OpenLinkProfiler
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Psbot
Pu_iN
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
ReGet
RealDownload
RebelMouse
Recorder
Ripper
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SMTBot
ScrepyBot
Searchestate
Seekport
SemanticJuice
Semrush
SentiBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
SlySearch
SmartDownload
Snake
Sociscraper
Sosospider
SpaceBison
Spanner
Spbot
SputnikBot
Sqworm
Stripper
Sucker
SuperHTTP
SurveyBot
Szukacz
TheNomad
Toata
Toweyabot
Trendictionbot
TurnitinBot
TwengaBot
Upflow
Vagabondo
Voltron
WEBDAV
WWW-Mechanize
Wallpapers
Web Collage
Web Pix
Web Sucker
WebAuto
WebCollage
WebFetch
WebFuck
WebGo IS
WebReaper
WebSucker
Webalta
Website Quester
WebsiteQuester
Wotbox
Xaldon_WebSpider
Xenu
Zade
Zauba
ZoomBot
ZoominfoBot
ZyBorg
backlink-check
cah.io.community
check1.exe
coccocbot
dataforseo.com
domainsproject.org
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
mediawords
oBot
pcBrowser
scalaj-http
scan.lol
seocompany.store
seostar
serpstatbot
sexsearcher
sogouspider
spyfu
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io