nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-26 10:09:32 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ASPSeek
Abonti
Aboundex
Acunetix
AhrefsBot
AllSubmitter
Alligator
AlphaBot
Ankit
Anthill
Aspiegel
Atomseobot
AwarioRssBot
BDCbot
BackDoorBot
Barkrowler
Bitacle
BlackWidow
Boardreader
BotALot
Buck
Buddy
BuiltBotTough
BuzzSumo
CATExplorador
CODE87
Cegbfeieh
CensysInspect
CherryPicker
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Copyscape
Crawling at Home Project
CrazyWebCrawler
Crescent
DIIbot
DSearch
DatabaseDriverMysqli
Deusu
Disco
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
Domains Project
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
Extreme Picture Finder
FDM
FemtosearchBot
Fimap
Firefox/7.0
Fuzz
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
Getintent
Gigabot
GoZilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTTrack
Haansoft
Harvest
IDBTE4M
IDBot
IlseBot
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
IstellaBot
Jbrofuzz
JetCar
JikeSpider
Joomla
Jorgee
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LexiBot
Lightspeedsystems
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MSFrontPage
Mag-Net
Majestic12
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Metauri
Microsoft Data Access
Mister PiX
Moblie Safari
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Nameprotect
Needle
NetSpider
NetZIP
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Not
Nuclei
Openfind
Openvas
OrangeSpider
Papa Foto
Pi-Monster
Picscout
Pimonster
PleaseCrawl
ProWebWalker
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
Rankivabot
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SEOkicks
SEOprofiler
SISTRIX
SMTBot
ScreenerBot
ScrepyBot
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
SiteExplorer
Sitebeam
SmartDownload
Sociscraper
Sosospider
Sottopop
Spammen
SpankBot
Spanner
Spinn3r
Sqlmap
Sqworm
SuperBot
Suzuran
Swiftbot
T8Abot
Telesoft
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
Twice
URLy Warning
Upflow
V-BOT
Vagabondo
Virusdie
Voil
WBSearchBot
WWWOFFLE
WallpapersHD
Web Fetch
Web Pix
WebAuto
WebCopier
WebGo IS
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Webster
WiseGuys Robot
Wotbox
Wprecon
Zade
Zermelo
ZyBorg
archive.org_bot
arquivo.pt
cah.io.community
check1.exe
crawler.feedback
crawler4j
domainsproject.org
evc-batch
instabid
internetVista monitor
ips-agent
isitwp.com
linkdexbot
lwp-request
muhstik-scan
polaris version
probe-image-size
ripz
s1z.ru
satoristudio.net
scalaj-http
serpstatbot
sexsearcher
sogouspider
sysscan
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
x22Mozilla
xpymep1.exe