nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-15 07:09:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AllSubmitter
Alligator
Anarchie
Anarchy99
Anthill
AwarioRssBot
BBBike
BDCbot
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
Bandit
Battleztar Bazinga
Boardreader
Brandwatch
Buck
BuiltBotTough
BuiltWith
Bullseye
CCBot
CazoodleBot
CheTeam
Cliqzbot
Cloud mapping
Copier
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy
DBLBot
DSearch
DataCha0s
Digincore
DigitalPebble
Discobot
Discoverybot
DnyzBot
DomCopBot
DomainSigmaCrawler
Domains Project
Download Wonder
Dragonfly
Drip
ECCP/1.0
EMail Wolf
Ecxi
Evil
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Firefox/7.0
Foobot
Freeuploader
GalaxyBot
GermCrawler
GetRight
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
Humanlinks
IDBTE4M
IDBot
Image Fetch
IndeedBot
Indy Library
InfoTekies
InterGET
Internet Ninja
JOC Web Spider
Joomla
Kinza
LWP::Simple
Lanshanbot
Leap
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
MIDown tool
MJ12bot
MSIECrawler
Mag-Net
Mail.RU_Bot
Mata Hari
MauiBot
Mb2345Browser
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Mr.4x3
NPbot
Name Intelligence
Navroad
Nessus
Net Vampire
NetAnts
NetLyzer
Niki-bot
Nmap
Nuclei
Octopus
Offline Explorer
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
OutfoxBot
PeoplePal
Petalbot
Pi-Monster
Picscout
Pimonster
PleaseCrawl
Psbot
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
RankurBot
Reaper
Recorder
RedesScrapy
Ripper
SEOkicks
SMTBot
ScanAlert
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
SemanticJuice
SemrushBot
SeobilityBot
Shodan
Siphon
SiteLockSpider
SiteSnagger
SmartDownload
Snake
Snapbot
SpaceBison
Spbot
Sqlworm
Sqworm
Steeler
Sucker
Swiftbot
T0PHackTeam
Telesphoreo
Thumbor
Trendictionbot
True_Robot
Turingos
Turnitin
TwengaBot
Typhoeus
UnisterBot
Upflow
V-BOT
WPScan
WWW-Collector-E
WWW-Mechanize
Web Collage
Web Enhancer
Web Sauger
Web Sucker
WebBandit
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebSucker
Website Quester
Webster
WinHTTrack
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xenu
Zade
Zermelo
Zeus
ZmEu
ZoomBot
ZoominfoBot
arquivo.pt
clark-crawler
coccocbot-web
crawler4j
gopher
heritrix
magpie-crawler
mediawords
muhstik-scan
page scorer
plumanalytics
ripz
scalaj-http
scan.lol
seobility
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
spyfu
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
webprosbot
x09Mozilla