nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-14 22:07:10 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
ASPSeek
Aboundex
Acunetix
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Ankit
Aspiegel
Atomseobot
Attach
AwarioRssBot
BacklinkCrawler
BetaBot
Bigfoot
Bitacle
Blow
Boardreader
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
CSHttp
Calculon
CensysInspect
ChinaClaw
Claritybot
Cloud mapping
Collector
Crawling at Home Project
DIIbot
DSearch
DataCha0s
Demon
Devil
Dirbuster
Discobot
DomCopBot
Dotbot
Drip
EMail Wolf
EasyDL
Ecxi
Express WebPictures
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
Foobot
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
Go!Zilla
GrabNet
Grabber
GrapeFX
GridBot
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Heritrix
HonoluluBot
IDBot
Iblog
Image Sucker
InfoTekies
InterGET
Internet Ninja
Iria
IstellaBot
JennyBot
JetCar
Jetty
JikeSpider
Joomla
Kenjin Spider
Kinza
Kozmosbot
Larbin
LinkWalker
LinkextractorPro
LinqiaScrapeBot
Lmspider
Ltx71
MJ12bot
MQQBrowser
MSIECrawler
Majestic-SEO
Majestic12
Masscan
Mata Hari
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Minefield
Moblie Safari
Mojeek
MolokaiBot
Mr.4x3
NPbot
Nameprotect
Nessus
NetZIP
Nettrack
NextGenSearchBot
Nibbler
Nikto
Ninja
Not
Nuclei
Offline Navigator
Openfind
OrangeBot
PHPCrawl
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Papa Foto
PeoplePal
Picscout
Piepmatz
Pimonster
Pockey
Probethenet
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
Rankivabot
ReGet
Reaper
RebelMouse
Recorder
Ripper
Rogerbot
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
ScanAlert
ScoutJet
ScreenerBot
Searchestate
SearchmetricsBot
Seekport
SemanticJuice
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
Site Sucker
SiteSucker
Siteimprove
Snapbot
Snoopy
Sottopop
SpaceBison
Spbot
SputnikBot
Sqlworm
Sqworm
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
The Intraformant
TightTwatBot
Toata
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
URLy.Warning
VCI
VeriCiteCrawler
VoidEYE
Voltron
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
Web Fuck
Web Sucker
WebGo IS
Whack
Whatweb
Who.is Bot
Wonderbot
Wotbox
Xaldon_WebSpider
Zade
Zeus
ZmEu
ZoominfoBot
ZumBot
adscanner
arquivo.pt
coccocbot
demandbase-bot
domainsproject.org
evc-batch
instabid
magpie-crawler
meanpathbot
mediawords
oBot
pcBrowser
ripz
s1z.ru
scalaj-http
seoscanners
seostar
siteripz
spyfu
tAkeOut
trendiction.de
webmeup-crawler
webpros.com
xpymep1.exe