nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-05 10:09:35 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
ADmantX
AIBOT
ALittle Client
ASPSeek
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
Anarchy99
Apexoo
Asterias
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BackDoorBot
BackWeb
BacklinkCrawler
BetaBot
Bitacle
Black Hole
Blackboard
BlowFish
Boardreader
Buck
Buddy
BuiltWith
BuzzSumo
CATExplorador
CSHttp
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
CopyRightCheck
Cosmos
CrazyWebCrawler
CrunchBot
CyotekWebCopy
DTS Agent
DigitalPebble
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainStatsBot
Domains Project
Dotbot
EMail Wolf
EasyDL
EroCrawler
Evil
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
Fyrebot
GalaxyBot
GermCrawler
Getintent
Go!Zilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HTMLparser
HTTrack
Haansoft
HaosouSpider
Heritrix
Hloader
HonoluluBot
Iblog
IlseBot
Image Fetch
InterGET
Internet Ninja
InternetSeer
JOC Web Spider
JennyBot
JetCar
JikeSpider
Jorgee
Kinza
Kozmosbot
Larbin
LeechGet
Lftp
LieBaoFast
LinkWalker
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MIDown tool
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Magnet
MarkWatch
Masscan
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Mister PiX
MolokaiBot
Mr.4x3
Msrabot
Musobot
NICErsPRO
Nameprotect
NearSite
Net Vampire
NetAnts
NetMechanic
NetZIP
NextGenSearchBot
Nibbler
Nikto
Openvas
Page Analyzer
PageGrabber
PageThing.com
Pavuk
Pi-Monster
Picscout
Picsearch
PictureFinder
PleaseCrawl
Probethenet
Pu_iN
PyCurl
Quick-Crawler
RankActiveLinkBot
RankFlex
RankurBot
RealDownload
Recorder
RepoMonkey
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SISTRIX
ScanAlert
Scanbot
ScoutJet
Screaming
Searchestate
Seekport
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
SiteLockSpider
SlySearch
SocialRankIOBot
Sociscraper
Sottopop
Spammen
Sqworm
Sucker
SuperBot
SuperHTTP
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Telesoft
TheNomad
Thumbor
TightTwatBot
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
Web Collage
Web Pix
Web Sauger
WebAuto
WebCollage
WebCopier
WebGo IS
WebLeacher
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
WebsiteQuester
Whack
Widow
Xaldon WebSpider
Xaldon_WebSpider
ZmEu
ZumBot
autoemailspider
backlink-check
cah.io.community
clark-crawler
coccocbot
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
gopher
heritrix
internetVista monitor
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
pcBrowser
probe-image-size
ripz
s1z.ru
scalaj-http
seoscanners
serpstatbot
voyagerx.com
x09Mozilla
x22Mozilla