nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-24 10:09:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ADmantX
AIBOT
ASPSeek
AiHitBot
Alexibot
Alligator
Anarchy
Anarchy99
AwarioRssBot
AwarioSmartBot
BackDoorBot
BacklinkCrawler
BatchFTP
Battleztar Bazinga
Bigfoot
Black Hole
Blow
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
Buck
CATExplorador
CCBot
CSHttp
Cegbfeieh
CheTeam
Chlooe
Cocolyzebot
Cogentbot
Collector
Copyscape
Craftbot
Crescent
Curious
DTS Agent
DataCha0s
DatabaseDriverMysqli
Disco
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dragonfly
Ecxi
EroCrawler
Evil
Exabot
Express WebPictures
Extractor
EyeNetIE
Ezooms
FDM
FemtosearchBot
Fimap
Flunky
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
Grabber
Grafula
GrapeFX
GridBot
HMView
HTMLparser
HTTP::Lite
HTTrack
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
Id-search
IlseBot
Intelliseek
InterGET
IstellaBot
JOC Web Spider
Jbrofuzz
Jorgee
JustView
Kinza
LWP::Simple
Larbin
Leap
LeechGet
LexiBot
Lftp
LibWeb
LinqiaScrapeBot
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic-SEO
Masscan
MauiBot
Mb2345Browser
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojolicious
MolokaiBot
Msrabot
NICErsPRO
NPbot
NetLyzer
NetSpider
NextGenSearchBot
NimbleCrawler
Nmap
Not
Offline Explorer
Offline Navigator
Openfind
OrangeSpider
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Papa Foto
Pavuk
PeoplePal
Picscout
Piepmatz
Pimonster
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
RebelMouse
Ripper
RocketCrawler
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SalesIntelligent
ScanAlert
ScreenerBot
SemrushBot
SeoSiteCheckup
Shodan
SiteSnagger
Sitebeam
Sitevigil
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
SpankBot
Sucuri
Szukacz
T0PHackTeam
TeleportPro
Telesoft
Toweyabot
Turnitin
TurnitinBot
Twice
URLy Warning
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WEBDAV
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Collage
Web Enhancer
Web Sauger
WebAuto
WebCopier
WebEnhancer
WebGo IS
WebSucker
WebZIP
Webalta
Webshag
Website Quester
WebsiteExtractor
Whacker
Who.is Bot
WinHTTrack
Xaldon WebSpider
Zermelo
Zeus
ZumBot
ZyBorg
adscanner
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
com.plumanalytics
crawler4j
dataforseo.com
demandbase-bot
eCatch
facebookscraper
gopher
instabid
internetVista monitor
lwp-request
magpie-crawler
mediawords
oBot
page scorer
plumanalytics
ripz
satoristudio.net
scalaj-http
seobility
seoscanners
sexsearcher
siteripz
sp_auditbot
sysscan
tAkeOut
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com