nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-12 22:06:58 +00:00

250 lines
2.6 KiB
Text

ASPSeek
Aboundex
AhrefsBot
AiHitBot
Aipbot
AlphaBot
Apexoo
Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
Badass
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
BlowFish
Brandprotect
Buck
Buddy
CATExplorador
CODE87
Cegbfeieh
Chlooe
Claritybot
Cliqzbot
Cocolyzebot
Collector
Craftbot
Crawling at Home Project
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Digincore
Dirbuster
DomainAppender
DomainStatsBot
Domains Project
Dotbot
ECCP/1.0
EasyDL
EirGrabber
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
Firefox/7.0
FlashGet
Foobot
Freeuploader
FrontPage
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GetRight
Getintent
GoZilla
Gotit
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
HybridBot
IDBot
IRLbot
Iblog
Id-search
InfoNaviRobot
Intelliseek
Iria
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
Kenjin Spider
Keyword Density
LNSpiderguy
Lanshanbot
LeechFTP
LibWeb
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Mag-Net
Magnet
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Metauri
Mister PiX
Msrabot
Musobot
NPbot
Nameprotect
NetAnts
NetSpider
NextGenSearchBot
NimbleCrawler
Nuclei
Nutch
Offline Navigator
Openfind
OutclicksBot
PageThing.com
Pandalytics
Panscient
Papa Foto
Petalbot
Pi-Monster
PictureFinder
PleaseCrawl
ProPowerBot
ProWebWalker
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
Recorder
Ripper
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
Screaming
ScreenerBot
ScrepyBot
Searchestate
Semrush
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitevigil
SmartDownload
Snapbot
Sociscraper
Sosospider
SpaceBison
Spammen
Spanner
Sqlmap
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
T0PHackTeam
T8Abot
Thumbor
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Voil
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
WallpapersHD
Web Pix
WebAuto
WebFetch
WebPix
WebSauger
WebmasterWorldForumBot
Webshag
WebsiteQuester
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Zade
Zauba
Zeus
Zitebot
ZmEu
ZumBot
ZyBorg
archive.org_bot
arquivo.pt
backlink-check
clark-crawler
com.plumanalytics
eCatch
facebookscraper
ips-agent
isitwp.com
mediawords
muhstik-scan
plumanalytics
probe-image-size
sitechecker.pro
siteripz
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
webmeup-crawler
webprosbot
zgrab