nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-05 22:07:19 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
404checker
404enemy
80legs
ADmantX
AIBOT
ALittle Client
Abonti
Aboundex
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
Alligator
Anarchy
Ankit
Anthill
Apexoo
Aspiegel
BBBike
BDCbot
BLEXBot
BackStreet
Badass
Barkrowler
Boardreader
Brandprotect
Buck
BuiltBotTough
BunnySlippers
BuzzSumo
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
Chlooe
Claritybot
Copier
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Crescent
CrunchBot
Custo
DBLBot
DIIbot
Demon
Deusu
Dirbuster
Dispatch
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
EasyDL
Ecxi
EirGrabber
Exabot
Express WebPictures
FDM
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GetRight
GetWeb
Gigabot
Go!Zilla
Go-Ahead-Got-It
Grabber
Haansoft
Harvest
Havij
Hloader
IDBTE4M
IRLbot
Image Fetch
Intelliseek
InternetSeer
Iria
Iskanie
JOC Web Spider
JetCar
Jetty
Jorgee
JustView
Keyword Density
Kinza
Larbin
LeechGet
LexiBot
Lftp
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinqiaRSSBot
Lipperhey
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Majestic-SEO
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojeek
Msrabot
Navroad
NearSite
Nessus
Net Vampire
NetAnts
Niki-bot
Nimbostratus
Ninja
Nutch
OnCrawl
OpenLinkProfiler
OrangeBot
OrangeSpider
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
Probethenet
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankurBot
RedesScrapy
Ripper
Rogerbot
SEOkicks
SEOprofiler
SISTRIX
Scanbot
Scrapy
Screaming
ScreenerBot
SeoSiteCheckup
Seomoz
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Sqworm
SuperHTTP
SurveyBot
T0PHackTeam
Telesoft
TheNomad
Titan
Trendictionbot
Twice
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voil
WBSearchBot
WEBDAV
WISENutbot
WWW-Mechanize
Wallpapers/3.0
Web Collage
Web Enhancer
Web Fetch
Web Fuck
WebAuto
WebBandit
WebCopier
WebFuck
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Webster
Whack
Whacker
Whatweb
WiseGuys Robot
Woobot
Xaldon WebSpider
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
ZumBot
archive.org_bot
cah.io.community
check1.exe
clark-crawler
demandbase-bot
facebookscraper
gopher
heritrix
isitwp.com
magpie-crawler
oBot
page scorer
pcBrowser
probe-image-size
satoristudio.net
sogouspider
spyfu
tAkeOut
trendiction.de
x09Mozilla
x22Mozilla
xpymep1.exe