nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2021-02-15 01:15:30 +02:00

250 lines
2.6 KiB
Text

01h4x.com
Aboundex
Acunetix
ADmantX
AfD-Verbotsverfahren
AIBOT
Anarchie
Ankit
archive.org_bot
arquivo.pt
ASPSeek
Asterias
Attach
AwarioSmartBot
BacklinkCrawler
BackStreet
Badass
Barkrowler
BBBike
BDFetch
Bitacle
Blackboard
Blow
BlowFish
Buck
Buddy
CazoodleBot
Cegbfeieh
CensysInspect
check1.exe
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Copier
CopyRightCheck
crawler.feedback
crawl.sogou.com
Crescent
CSHttp
DBLBot
Demon
Digincore
DIIbot
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
domainsproject.org
DomainStatsBot
Drip
DSearch
EasyDL
Ecxi
EirGrabber
EMail Siphon
evc-batch
Evil
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
Fimap
Flunky
FrontPage
Fuzz
FyberSpider
GalaxyBot
GetWeb
G-i-g-a-b-o-t
gopher
Gotit
Go!Zilla
Grafula
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Havij
heritrix
HMView
HTMLparser
HTTrack
IDBTE4M
Image Fetch
Image Sucker
Indy Library
InfoTekies
instabid
Intelliseek
InterGET
Internet Ninja
Iria
IstellaBot
Jbrofuzz
Jetty
JikeSpider
JOC Web Spider
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
Lanshanbot
LexiBot
LibWeb
Lightspeedsystems
Likse
Linkbot
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
Ltx71
lwp-request
magpie-crawler
Mail.RU_Bot
Majestic12
MarkWatch
Masscan
Mass Downloader
Mata Hari
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
Metauri
Mojeek
Msrabot
Nameprotect
Needle
NetAnts
Netcraft
netEstate NE Crawler
NetMechanic
NetSpider
Net Vampire
NetZIP
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
Nmap
Nuclei
Octopus
Offline Explorer
OrangeBot
OrangeSpider
OutfoxBot
page scorer
Pandalytics
Panscient
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Picsearch
Pimonster
Pi-Monster
PleaseCrawl
Psbot
Pu_iN
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot2
RankurBot
Recorder
RedesScrapy
RepoMonkey
Ripper
ScoutJet
Scrapy
SearchmetricsBot
Semrush
SEOkicks-Robot
Seomoz
seoscanners
sexsearcher
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Site Sucker
SlySearch
Snake
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpankBot
Spanner
Sqworm
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
T0PHackTeam
T8Abot
tAkeOut
The Intraformant
TheNomad
Titan
Toweyabot
Tracemyfile
trendiction.de
Turnitin
TwengaBot
Twice
UnisterBot
URLy.Warning
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voltron
Wallpapers/3.0
WebCollage
Web Fetch
WebImageCollector
WebPix
Web Sauger
WebStripper
WebSucker
Web Sucker
WebZIP
Whack
Whacker
WinHTTrack
Wotbox
Wprecon
WWW-Collector-E
x09Mozilla
Xaldon WebSpider
xpymep1.exe
zauba.io
ZoomBot
ZumBot
ZyBorg