nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-14 22:07:13 +00:00

250 lines
2.5 KiB
Text

01h4x.com
Aboundex
AfD-Verbotsverfahren
AiHitBot
Alexibot
Alligator
AlphaBot
Anarchie
Atomseobot
Attach
AwarioSmartBot
BBBike
BLEXBot
BackDoorBot
Bandit
BetaBot
Blow
Bolt
BotALot
Brandwatch
Buck
BuiltBotTough
BuiltWith
CATExplorador
CCBot
CODE87
Chlooe
Claritybot
Cloud mapping
Collector
Copier
Copyscape
Craftbot
Crescent
CrunchBot
Custo
DataCha0s
Demon
Devil
Digincore
Dirbuster
Disco
Discoverybot
DomCopBot
Domains Project
Download Wonder
Dragonfly
Drip
EMail Siphon
EirGrabber
EroCrawler
Evil
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
Ezooms
Firefox/7.0
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
GetWeb
Go!Zilla
Grabber
GrapeFX
HEADMasterSEO
HMView
Harvest
Havij
Heritrix
Iblog
Id-search
IlseBot
Image Fetch
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
JikeSpider
Jorgee
JustView
Keyword Density
LNSpiderguy
Larbin
Leap
LibWeb
Lightspeedsystems
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MIIxpc
MTRobot
Magnet
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Metauri
Msrabot
Musobot
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
Nessus
NetAnts
NetLyzer
Netvibes
NextGenSearchBot
Nimbostratus
Nuclei
Octopus
OnCrawl
Openvas
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
PageScorer
PageThing.com
Petalbot
Picsearch
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
Pump
PxBroker
PyCurl
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks
SEOlyticsCrawler
SISTRIX
ScanAlert
Scanbot
Scrapy
ScreenerBot
SemanticJuice
SemrushBot
SeoSiteCheckup
Siphon
Site Sucker
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SmartDownload
Snake
Snoopy
Spammen
SpankBot
Spanner
Sqlworm
Sucker
Surfbot
Thumbor
TightTwatBot
Titan
Toata
Trendiction
True_Robot
Turnitin
TurnitinBot
URLy.Warning
VCI
Vacuum
Vagabondo
Virusdie
Voil
Voltron
WBSearchBot
WEBDAV
WWW::Mechanize
Web Auto
Web Pix
WebCopier
WebEnhancer
WebFetch
WebWhacker
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Xenu
Zade
Zauba
Zitebot
ZmEu
ZoominfoBot
ZumBot
ZyBorg
backlink-check
check1.exe
coccocbot
crawler4j
demandbase-bot
domainsproject.org
facebookscraper
heritrix
instabid
ips-agent
linkdexbot
lwp-trivial
meanpathbot
mediawords
muhstik-scan
page scorer
plumanalytics
polaris version
probe-image-size
s1z.ru
satoristudio.net
scan.lol
seoscanners
spyfu
tAkeOut
trendiction.com
trendiction.de
webmeup-crawler
webpros.com
webprosbot