nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-05 12:46:50 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ADmantX
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
Alexibot
Anarchy
Anthill
Apexoo
Aspiegel
Attach
AwarioSmartBot
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
Bigfoot
Bitacle
BlackWidow
Blow
Boardreader
Bolt
Buck
Buddy
BuiltWith
BunnySlippers
Calculon
CheTeam
ChinaClaw
Chlooe
Claritybot
Cogentbot
Collector
Copier
Craftbot
CrunchBot
DIIbot
DTS Agent
Digincore
Disco
DittoSpyder
DnyzBot
DomCopBot
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
EMail Wolf
EirGrabber
EroCrawler
Exabot
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
Ezooms
FemtosearchBot
Fimap
Firefox/7.0
Fuzz
GalaxyBot
Getintent
Gigabot
GrabNet
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Humanlinks
IDBTE4M
IDBot
Image Sucker
Intelliseek
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
Jorgee
Kozmosbot
LNSpiderguy
LWP::Simple
LeechFTP
LeechGet
Lftp
LibWeb
LieBaoFast
Likse
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MIIxpc
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan
Mata Hari
MeanPath Bot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Msrabot
Name Intelligence
Nameprotect
Needle
NetAnts
NetMechanic
NetZIP
Nettrack
Netvibes
Nikto
Nimbostratus
Offline Navigator
OpenLinkProfiler
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics
Papa Foto
Pavuk
Picscout
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Psbot
Pump
PxBroker
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
Reaper
RebelMouse
Recorder
RedesScrapy
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
Shodan
Site Sucker
SiteExplorer
Siteimprove
Sitevigil
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sottopop
Spammen
SpankBot
Sqworm
Sucker
SurveyBot
T0PHackTeam
Teleport
Telesoft
Telesphorep
The Intraformant
TheNomad
Toata
Tracemyfile
Trendictionbot
Turingos
Turnitin
VCI
Vagabondo
VelenPublicWebCrawler
Virusdie
WBSearchBot
WEBDAV
WPScan
WallpapersHD
WeSEE
Web Enhancer
Web Pix
Web Sauger
Web Sucker
WebAuto
WebEnhancer
WebFuck
WebLeacher
WebPix
WebReaper
WebStripper
WebmasterWorldForumBot
Whacker
Who.is Bot
Widow
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
Zauba
Zeus
ZoomBot
arquivo.pt
backlink-check
demandbase-bot
eCatch
evc-batch
gopher
internetVista monitor
lwp-trivial
magpie-crawler
muhstik-scan
netEstate NE Crawler
plumanalytics
polaris version
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
sexsearcher
sogouspider
spyfu
tAkeOut
trendiction.com
x09Mozilla
xpymep1.exe
zauba.io