nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-29 22:10:15 +00:00

250 lines
2.6 KiB
Text

80legs
AIBOT
ALittle Client
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Atomseobot
Attach
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bigfoot
Bitacle
Boardreader
Brandprotect
Buck
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CCBot
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
Collector
Copyscape
Crawling at Home Project
CrunchBot
Curious
CyotekWebCopy
DSearch
Demon
Deusu
Dirbuster
Disco
Discobot
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
Drip
EMail Siphon
FHscan
Fimap
FlashGet
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
Genieo
GermCrawler
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
HTTrack
Harvest
Havij
Heritrix
HonoluluBot
HybridBot
Iblog
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
Internet Ninja
Iria
Iskanie
JamesBOT
JennyBot
Joomla
Jorgee
JustView
Kenjin Spider
Keyword Density
Lanshanbot
Leap
Libwhisker
LinkScan
LinksManager
Lipperhey
Lmspider
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
MarkMonitor
Mata Hari
Mb2345Browser
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Nameprotect
NearSite
Needle
Nessus
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Nmap
Not
Nutch
Octopus
Offline Navigator
OnCrawl
Openvas
OrangeBot
OrangeSpider
OutfoxBot
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Panscient
Petalbot
Picsearch
Piepmatz
Pockey
Probethenet
Psbot
PxBroker
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
RankingBot
RankingBot2
RebelMouse
Recorder
RedesScrapy
RocketCrawler
SEOkicks
SEOlyticsCrawler
SISTRIX
SalesIntelligent
ScanAlert
Scrapy
SemanticJuice
SeoSiteCheckup
Siphon
Siteimprove
SmartDownload
Snake
Snapbot
SocialRankIOBot
SpaceBison
Spammen
SpankBot
Spanner
SputnikBot
Sqlworm
Stripper
Sucuri
SurveyBot
T0PHackTeam
Teleport
Telesphoreo
TheNomad
Thumbor
Toweyabot
Tracemyfile
Trendictionbot
Turnitin
URLy Warning
VB Project
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voltron
WISENutbot
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Fetch
Web Sauger
Web Sucker
WebCollage
WebFetch
WebPix
WebStripper
WebmasterWorldForumBot
Whatweb
Widow
WiseGuys Robot
Woobot
Wotbox
Xaldon_WebSpider
YoudaoBot
Zeus
ZoominfoBot
archive.org_bot
autoemailspider
dataforseo.com
demandbase-bot
evc-batch
heritrix
instabid
internetVista monitor
isitwp.com
iubenda-radar
lwp-request
page scorer
ripz
seobility
seocompany.store
seoscanners
sexsearcher
sogouspider
sp_auditbot
trendiction.com
trendiction.de
webgains-bot
webpros.com
webprosbot
x09Mozilla
x22Mozilla