nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-12 14:11:04 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
ADmantX
Aboundexbot
Acunetix
AhrefsBot
AllSubmitter
Anarchy
Ankit
Apexoo
Aspiegel
BDFetch
BLEXBot
BackDoorBot
BackStreet
Bandit
Battleztar Bazinga
Bigfoot
BlackWidow
Blow
Brandwatch
BuiltBotTough
BuiltWith
BuzzSumo
CazoodleBot
CensysInspect
CheTeam
Cloud mapping
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Cosmos
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
DIIbot
Demon
Devil
Digincore
DigitalPebble
Disco
DittoSpyder
DnyzBot
DomCopBot
DomainCrawler
DomainStatsBot
Domains Project
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
ExtLinksBot
ExtractorPro
Ezooms
Fimap
Flunky
Fyrebot
GalaxyBot
GermCrawler
GetRight
Gigablast
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Grabber
Grafula
GrapeshotCrawler
GridBot
HMView
HTMLparser
HTTrack
Harvest
Humanlinks
IDBot
Iblog
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Iria
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
JustView
Lanshanbot
LexiBot
LibWeb
LieBaoFast
LinkextractorPro
MFC_Tear_Sample
MIIxpc
Mag-Net
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
Mata Hari
MeanPath Bot
MegaIndex.ru
MicroMessenger
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Name Intelligence
Nameprotect
Navroad
Nessus
Netcraft
Nettrack
Nmap
Nuclei
Offline Explorer
OrangeBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pockey
ProWebWalker
Probethenet
Pump
PxBroker
PyCurl
QueryN Metasearch
RankFlex
RankingBot2
RankurBot
Re-re
ReGet
RebelMouse
RedesScrapy
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
Scanbot
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
Seomoz
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
Sitebeam
SmartDownload
Snake
Snapbot
Sociscraper
SpankBot
Spanner
Spbot
Sqlworm
Sucker
Sucuri
SuperHTTP
Surfbot
SurveyBot
Szukacz
Teleport
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toata
Trendiction
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
URLy Warning
URLy.Warning
Upflow
VB Project
Vacuum
Vagabondo
VidibleScraper
Virusdie
Voil
Voltron
WEBDAV
WPScan
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fetch
Web Fuck
WebBandit
WebCopier
WebFetch
WebFuck
WebGo IS
WebPix
WebSauger
WebWhacker
WebZIP
WebsiteQuester
Whack
Who.is Bot
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xenu
Zade
Zauba
Zermelo
Zitebot
ZoominfoBot
archive.org_bot
arquivo-web-crawler
backlink-check
check1.exe
coccocbot-web
com.plumanalytics
domainsproject.org
eCatch
evc-batch
instabid
ips-agent
lwp-request
netEstate NE Crawler
pcBrowser
plumanalytics
polaris version
satoristudio.net
scan.lol
seobility
sexsearcher
tAkeOut
trendiction.de
xpymep1.exe