nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-04 22:07:05 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
Abonti
Acunetix
AfD-Verbotsverfahren
AllSubmitter
Alligator
AlphaBot
Ankit
Anthill
Attach
BBBike
BDCbot
BLEXBot
BacklinkCrawler
Barkrowler
Battleztar Bazinga
Bitacle
BlackWidow
Blackboard
BlowFish
Boardreader
Brandprotect
BuiltWith
Cegbfeieh
CheeseBot
Chlooe
Citoid
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copyscape
Crescent
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
Deusu
Digincore
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Evil
ExtLinksBot
EyeNetIE
Ezooms
Fimap
Firefox/7.0
FlashGet
Fyrebot
G-i-g-a-b-o-t
GermCrawler
Gigabot
Go-Ahead-Got-It
Gotit
GridBot
HMView
HTTP::Lite
Harvest
Havij
Hloader
Humanlinks
IlseBot
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
InternetSeer
JOC Web Spider
Jbrofuzz
Jetty
Jyxobot
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Mb2345Browser
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mozlila
Mr.4x3
Nameprotect
Net Vampire
Netcraft
Netvibes
Nibbler
Nuclei
Offline Explorer
OnCrawl
OpenVAS
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Panscient
Pavuk
Pi-Monster
Pixray
ProPowerBot
Probethenet
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
RankingBot
RankingBot2
RankurBot
Recorder
SEOkicks-Robot
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Scrapy
ScrepyBot
SearchmetricsBot
SemrushBot
SentiBot
SeobilityBot
Seomoz
Siphon
SiteExplorer
SiteLockSpider
SiteSucker
Siteimprove
SmartDownload
SocialRankIOBot
Sosospider
Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
Sqlmap
Sqlworm
SuperBot
SurveyBot
Telesoft
The Intraformant
Tracemyfile
Turnitin
TurnitinBot
TwengaBot
Typhoeus
VCI
VidibleScraper
Virusdie
WBSearchBot
WEBDAV
WISENutbot
Web Enhancer
Web Fetch
WebAuto
WebCollage
WebCopier
WebFuck
WebImageCollector
WebLeacher
WebPix
WebZIP
Webalta
Website Quester
WebsiteQuester
Webster
Whacker
WiseGuys Robot
Wonderbot
Woobot
Xaldon_WebSpider
Xenu
Zauba
Zermelo
ZmEu
ZoominfoBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
check1.exe
clark-crawler
coccocbot-web
domainsproject.org
eCatch
evc-batch
heritrix
instabid
ips-agent
magpie-crawler
meanpathbot
muhstik-scan
page scorer
pcBrowser
ripz
s1z.ru
scalaj-http
seobility
seostar
siteripz
sogouspider
spyfu
trendiction.com
x09Mozilla
zauba.io
zgrab