nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-21 22:07:15 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Alligator
Anarchie
Anarchy99
Apexoo
Attach
BBBike
BackStreet
Badass
Barkrowler
Black Hole
Blow
Boardreader
BotALot
Buck
BuiltWith
Bullseye
BunnySlippers
CCBot
CODE87
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Citoid
Claritybot
Copier
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
Demon
Deusu
DigitalPebble
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
Download Wonder
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ecxi
EroCrawler
Exabot
Express WebPictures
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
Getintent
Gigabot
Go-Ahead-Got-It
GrabNet
Grabber
Grafula
GrapeshotCrawler
HEADMasterSEO
HTMLparser
Haansoft
Harvest
IRLbot
IlseBot
Intelliseek
InterGET
Iria
JOC Web Spider
Jetty
Joomla
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
LibWeb
Libwhisker
Lightspeedsystems
Linkdexbot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MQQBrowser
MTRobot
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
MegaIndex.ru
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Nameprotect
NearSite
Net Vampire
NetZIP
Netcraft
Nettrack
NextGenSearchBot
Nikto
Nimbostratus
Ninja
Not
Nutch
Octopus
Offline Navigator
OutclicksBot
OutfoxBot
PageAnalyzer
PageScorer
Pandalytics
Papa Foto
PeoplePal
Pi-Monster
PictureFinder
Pixray
ProPowerBot
Probethenet
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
Rankivabot
RocketCrawler
SEOkicks
SEOkicks-Robot
SMTBot
Scanbot
ScoutJet
SearchmetricsBot
SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Sitevigil
SlySearch
Snake
Snoopy
SocialRankIOBot
Sogou web spider
SpankBot
Spbot
Spinn3r
Sqworm
Stripper
SuperBot
SurveyBot
Szukacz
Teleport
TheNomad
Thumbor
TightTwatBot
Titan
Tracemyfile
Trendictionbot
Vacuum
Virusdie
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Enhancer
Web Fuck
Web Sucker
WebAuto
WebCollage
WebLeacher
WebStripper
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Who.is Bot
Widow
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zeus
ZumBot
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
crawler.feedback
domainsproject.org
facebookscraper
heritrix
isitwp.com
lwp-request
meanpathbot
mediawords
muhstik-scan
plumanalytics
ripz
s1z.ru
scalaj-http
seoscanners
seostar
serpstatbot
sexsearcher
siteripz
sogouspider
sp_auditbot
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
x09Mozilla