nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-12 10:08:59 +00:00

250 lines
2.7 KiB
Text

360Spider
404enemy
ADmantX
AIBOT
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
Alligator
Anthill
Apexoo
Asterias
Atomseobot
AwarioSmartBot
BackDoorBot
BackWeb
Badass
Bandit
Barkrowler
BetaBot
Black Hole
BuiltWith
BuzzSumo
CCBot
CODE87
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
CherryPicker
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler
Curious
CyotekWebCopy
DIIbot
DTS Agent
Digincore
Disco
Discobot
DnBCrawler-Analytics
DnyzBot
DomainAppender
Download Wonder
EMail Siphon
EMail Wolf
Ebingbong
EroCrawler
Express WebPictures
Extractor
FemtosearchBot
Firefox/7.0
Foobot
Freeuploader
FrontPage
GT::WWW
Genieo
Getintent
Gigabot
Go!Zilla
GoZilla
Gotit
GrabNet
Grafula
GrapeshotCrawler
HMView
Haansoft
HaosouSpider
Hloader
Humanlinks
HybridBot
IRLbot
Iblog
IlseBot
Image Fetch
Internet Ninja
JennyBot
Kenjin Spider
Kinza
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LibWeb
Likse
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample
MIDown tool
MIIxpc
MTRobot
Mail.RU_Bot
Majestic12
Masscan
MauiBot
MeanPath Bot
Metauri
Microsoft Data Access
Moblie Safari
Mojeek
MolokaiBot
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
NetZIP
Netcraft
Nettrack
Netvibes
Nibbler
Nimbostratus
Octopus
OnCrawl
OpenVAS
Openvas
OrangeSpider
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Panscient
Pi-Monster
PleaseCrawl
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankFlex
RankingBot2
Rankivabot
RealDownload
Reaper
RebelMouse
Recorder
SBIder
SEOkicks
SEOprofiler
SEOstats
Scanbot
Scrapy
Searchestate
SentiBot
Seomoz
SiteCheckerBotCrawler
Siteimprove
SlySearch
SmartDownload
Snake
Snoopy
Sociscraper
Sogou web spider
Spanner
Sqlmap
Steeler
Stripper
Sucker
Sucuri
SuperBot
Surfbot
Suzuran
Szukacz
T8Abot
TeleportPro
Telesoft
The Intraformant
TightTwatBot
Toweyabot
Trendiction
Trendictionbot
Turingos
TurnitinBot
Twice
Typhoeus
Upflow
Voil
WASALive-Bot
Wallpapers
Wallpapers/3.0
WeSEE
Web Fetch
Web Pix
Web Sauger
Web Sucker
WebCopier
WebEnhancer
WebFuck
WebGo IS
WebLeacher
WebPix
WebSauger
WebWhacker
WebZIP
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
WinHTTrack
Wotbox
Wprecon
Zade
ZoomBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
com.plumanalytics
crawler4j
facebookscraper
ips-agent
iubenda-radar
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
polaris version
probe-image-size
scalaj-http
seobility
seocompany.store
seoscanners
seostar
sitechecker.pro
sogouspider
trendiction.com
ubermetrics-technologies.com
webgains-bot
webprosbot
x09Mozilla
xpymep1.exe
zauba.io