nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-17 22:07:40 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404enemy
AIBOT
ASPSeek
Abonti
AfD-Verbotsverfahren
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
Aspiegel
Asterias
BDFetch
BackStreet
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
Boardreader
BotALot
Buddy
BunnySlippers
CCBot
Calculon
ChinaClaw
Cogentbot
Copier
Copyscape
Curious
Custo
CyotekWebCopy
DIIbot
Demon
Deusu
DittoSpyder
DomCopBot
DomainAppender
DomainStatsBot
Download Wonder
ECCP/1.0
EMail Siphon
EasyDL
EroCrawler
Evil
Exabot
ExtLinksBot
FHscan
FemtosearchBot
Fimap
FlashGet
Fuzz
GalaxyBot
GermCrawler
GetRight
GetWeb
Go!Zilla
Go-Ahead-Got-It
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
Harvest
Havij
Heritrix
Hloader
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
InterGET
InternetSeer
JamesBOT
JennyBot
JetCar
Joomla
Kenjin Spider
Keyword Density
Kozmosbot
LWP::Simple
LexiBot
LibWeb
LinkWalker
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MJ12bot
MQQBrowser
MTRobot
Mail.RU_Bot
Majestic12
Mb2345Browser
Metauri
MicroMessenger
Minefield
Mojeek
Msrabot
Musobot
NPbot
Nameprotect
NearSite
NetSpider
NetZIP
Netvibes
Nibbler
Niki-bot
Ninja
Nutch
Octopus
Offline Navigator
OnCrawl
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Papa Foto
PeoplePal
Picsearch
PictureFinder
Pimonster
Pixray
Pockey
ProWebWalker
Pu_iN
Pump
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankurBot
Re-re
ReGet
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SISTRIX
ScoutJet
Scrapy
ScrepyBot
SearchmetricsBot
Seekport
SentiBot
Seomoz
Siphon
Site Sucker
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SmartDownload
Sociscraper
Sogou web spider
Sosospider
SpaceBison
SpankBot
Spbot
Sqlworm
Sqworm
Stripper
Telesphoreo
Tracemyfile
Trendiction
Turnitin
TurnitinBot
Typhoeus
URLy Warning
UnisterBot
Upflow
VB Project
VCI
VoidEYE
Voil
Wallpapers
Web Auto
Web Enhancer
Web Sauger
WebBandit
WebCopier
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebStripper
WebSucker
Webalta
WebmasterWorldForumBot
Website Quester
Whatweb
Who.is Bot
Widow
WinHTTrack
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zermelo
ZmEu
ZumBot
adscanner
arquivo-web-crawler
backlink-check
cah.io.community
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
evc-batch
heritrix
instabid
lwp-trivial
magpie-crawler
meanpathbot
mediawords
pcBrowser
polaris version
scalaj-http
scan.lol
seocompany.store
seoscanners
serpstatbot
siteripz
spyfu
sysscan
trendiction.com
webpros.com
webprosbot
x09Mozilla
zgrab