nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-10 10:17:50 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
AfD-Verbotsverfahren
AhrefsBot
Aipbot
AlphaBot
Anarchie
Anarchy99
Anthill
Attach
BBBike
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
Bandit
Barkrowler
Bitacle
BlackWidow
BlowFish
Bolt
BuiltWith
Bullseye
BuzzSumo
CCBot
CODE87
CSHttp
CheeseBot
CherryPicker
Chlooe
Cliqzbot
Collector
Copier
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
DSearch
Deusu
Dirbuster
Discoverybot
DomainCrawler
DomainStatsBot
Ecxi
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
Flunky
Fuzz
Fyrebot
GalaxyBot
Genieo
GetRight
GetWeb
Getintent
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX
GridBot
HEADMasterSEO
HTMLparser
HTTrack
Haansoft
Harvest
Havij
Heritrix
Hloader
IRLbot
IlseBot
IndeedBot
Intelliseek
Internet Ninja
InternetSeer
JOC Web Spider
JamesBOT
JetCar
Jorgee
Keyword Density
Larbin
Lftp
LibWeb
LieBaoFast
Likse
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MTRobot
Majestic12
MarkWatch
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Mister PiX
Moblie Safari
Mojeek
Mr.4x3
NPbot
Navroad
NearSite
Needle
Net Vampire
NetSpider
NetZIP
Netcraft
Nettrack
Netvibes
Niki-bot
Nimbostratus
Nmap
Nutch
Offline Navigator
OutclicksBot
POE-Component-Client-HTTP
PageGrabber
PageScorer
Panscient
Papa Foto
Petalbot
Pi-Monster
PictureFinder
ProPowerBot
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RSSingBot
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
Recorder
RepoMonkey
Ripper
Scrapy
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
Shodan
SiteCheckerBotCrawler
Snapbot
Snoopy
Sociscraper
Sosospider
SpankBot
Spanner
Spinn3r
Sqlmap
Stripper
Sucker
Sucuri
Suzuran
T0PHackTeam
TeleportPro
Telesoft
The Intraformant
TightTwatBot
Titan
Trendiction
TurnitinBot
UnisterBot
VB Project
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Fuck
Web Pix
WebCopier
WebFetch
WebReaper
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Widow
WiseGuys Robot
Wotbox
Zeus
Zitebot
ZoomBot
ZumBot
ZyBorg
backlink-check
check1.exe
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
eCatch
facebookscraper
heritrix
internetVista monitor
isitwp.com
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
polaris version
probe-image-size
ripz
satoristudio.net
scan.lol
seobility
seostar
sogouspider
ubermetrics-technologies.com
webpros.com
xpymep1.exe