nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-23 10:09:36 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AlphaBot
Anarchie
Anarchy
Ankit
Anthill
Apexoo
Asterias
BBBike
BLEXBot
BackStreet
BacklinkCrawler
Bandit
Barkrowler
Black Hole
Bolt
Brandwatch
Buck
BuiltWith
Bullseye
BuzzSumo
CODE87
CheTeam
CherryPicker
Chlooe
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Collector
Copier
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
DIIbot
DTS Agent
Devil
Digincore
Dirbuster
Discoverybot
DittoSpyder
DomainCrawler
DomainStatsBot
Dotbot
ECCP/1.0
EasyDL
Evil
Exabot
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Freeuploader
Fyrebot
GalaxyBot
Genieo
GermCrawler
GetWeb
Gigabot
Go!Zilla
GoZilla
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HTTrack
Haansoft
Hloader
IDBTE4M
IRLbot
Id-search
Image Fetch
Image Sucker
InterGET
InternetSeer
JetCar
Jorgee
Jyxobot
Keybot Translation-Search-Machine
LNSpiderguy
LWP::Simple
Larbin
Leap
LexiBot
Libwhisker
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic SEO
Majestic12
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
MolokaiBot
Mr.4x3
Needle
Nessus
Nettrack
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nuclei
Offline Explorer
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Panscient
Papa Foto
Picsearch
Pimonster
ProPowerBot
ProWebWalker
Probethenet
Psbot
Pu_iN
Quick-Crawler
RankActiveLinkBot
Reaper
SBIder
SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert
ScoutJet
Screaming
ScreenerBot
ScrepyBot
SemrushBot
SeoSiteCheckup
Shodan
Siphon
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sociscraper
Sottopop
Spammen
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
Sucker
Sucuri
T8Abot
Teleport
Telesoft
Telesphorep
Thumbor
TightTwatBot
Trendiction
Trendictionbot
Turingos
Turnitin
URLy Warning
V-BOT
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
WASALive-Bot
WISENutbot
Web Auto
Web Pix
WebCollage
WebCopier
WebSauger
WebmasterWorldForumBot
Website Quester
Whack
Wprecon
Xaldon WebSpider
YoudaoBot
ZoominfoBot
adscanner
arquivo-web-crawler
check1.exe
crawler.feedback
dataforseo.com
domainsproject.org
facebookscraper
gopher
heritrix
internetVista monitor
ips-agent
isitwp.com
linkdexbot
magpie-crawler
meanpathbot
muhstik-scan
probe-image-size
ripz
scan.lol
seocompany.store
seoscanners
serpstatbot
siteripz
spyfu
tAkeOut
trendiction.de
webgains-bot
x09Mozilla
x22Mozilla
zauba.io
zgrab