nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-15 22:07:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
80legs
ADmantX
AIBOT
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Alexibot
Alligator
AlphaBot
Anarchie
Anarchy99
AwarioRssBot
AwarioSmartBot
BackDoorBot
BackStreet
BacklinkCrawler
Badass
Bandit
BlackWidow
BlowFish
BotALot
Brandwatch
BuiltBotTough
CODE87
Calculon
Cegbfeieh
CensysInspect
CherryPicker
Chlooe
Cloud mapping
Cogentbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
Demon
Deusu
Devil
Disco
Discoverybot
DomainCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
Evil
Extractor
EyeNetIE
FDM
FHscan
FemtosearchBot
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
Go!Zilla
Go-Ahead-Got-It
Grabber
HMView
HTMLparser
HTTP::Lite
Haansoft
HaosouSpider
Havij
Hloader
HonoluluBot
Humanlinks
IndeedBot
Indy Library
Intelliseek
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
Jetty
JikeSpider
Keybot Translation-Search-Machine
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinksManager
Lipperhey Spider
Lmspider
MIIxpc
MSIECrawler
Magnet
Majestic12
MarkWatch
Mass Downloader
Masscan
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
Msrabot
Nameprotect
NearSite
Nessus
NetAnts
NetMechanic
Nettrack
Niki-bot
Nikto
NimbleCrawler
Not
Offline Explorer
OpenVAS
Openvas
OutclicksBot
OutfoxBot
PECL::HTTP
PageScorer
Pandalytics
Panscient
Petalbot
Picsearch
Pixray
Pockey
ProPowerBot
ProWebWalker
Probethenet
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
RankurBot
ReGet
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SMTBot
ScoutJet
Scrapy
Screaming
Searchestate
Seekport
SeobilityBot
Seomoz
Shodan
SiteSnagger
Siteimprove
Sitevigil
Snapbot
Sogou web spider
Spbot
SputnikBot
Steeler
Stripper
Surfbot
Swiftbot
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
The Intraformant
Toata
Toweyabot
Tracemyfile
Turingos
Turnitin
TwengaBot
VelenPublicWebCrawler
VoidEYE
WASALive-Bot
WISENutbot
WPScan
WWW-Mechanize
WeSEE
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebFetch
WebImageCollector
WebReaper
Webshag
Webster
Whack
Whatweb
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
YoudaoBot
Zitebot
ZoomBot
ZyBorg
autoemailspider
backlink-check
check1.exe
clark-crawler
crawler.feedback
domainsproject.org
evc-batch
gopher
ips-agent
linkdexbot
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
oBot
page scorer
pcBrowser
plumanalytics
s1z.ru
scalaj-http
seostar
serpstatbot
sexsearcher
siteripz
sogouspider
sysscan
trendiction.de
webmeup-crawler
x22Mozilla