nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-08 22:07:22 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
ADmantX
ALittle Client
Acunetix
AiHitBot
Alexibot
Alligator
Anarchie
Anarchy99
Apexoo
Aspiegel
Atomseobot
Attach
AwarioRssBot
BLEXBot
Backlink-Ceck
BacklinkCrawler
Badass
Barkrowler
BatchFTP
Black Hole
Blackboard
Blow
BlowFish
Boardreader
Bolt
Buck
CATExplorador
Calculon
CheTeam
CherryPicker
CopyRightCheck
Copyscape
CrazyWebCrawler
Crescent
Custo
DBLBot
DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
Discoverybot
DittoSpyder
DomCopBot
DomainAppender
DomainCrawler
Domains Project
Dragonfly
Drip
EirGrabber
Express WebPictures
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
Firefox/7.0
Flunky
Foobot
FrontPage
Fuzz
FyberSpider
GalaxyBot
GetRight
Gigabot
GoZilla
Grafula
GrapeFX
GrapeshotCrawler
HMView
HTTrack
Haansoft
Havij
Heritrix
Hloader
IlseBot
Image Sucker
IndeedBot
InfoTekies
Intelliseek
InterGET
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
LWP::Simple
Lanshanbot
LeechFTP
LeechGet
LieBaoFast
LinkWalker
Lipperhey
MJ12bot
MSFrontPage
MTRobot
Mag-Net
Magnet
Majestic12
Mass Downloader
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
Mister PiX
Moblie Safari
Msrabot
Musobot
Nessus
NetLyzer
NetMechanic
NetSpider
Nettrack
NimbleCrawler
Nuclei
Nutch
OpenLinkProfiler
OrangeBot
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pavuk
Petalbot
Pi-Monster
PleaseCrawl
ProPowerBot
ProWebWalker
PyCurl
QueryN Metasearch
RankingBot
RankurBot
RealDownload
RebelMouse
RepoMonkey
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
ScreenerBot
ScrepyBot
Searchestate
Semrush
SeobilityBot
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitebeam
Sitevigil
SmartDownload
Spanner
SputnikBot
Sqlmap
Stripper
Sucuri
SuperBot
Surfbot
Suzuran
Swiftbot
Szukacz
T8Abot
Telesoft
The Intraformant
TheNomad
TightTwatBot
Trendictionbot
Turingos
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
Vacuum
VeriCiteCrawler
VidibleScraper
Virusdie
WASALive-Bot
WPScan
WWW-Mechanize
WWW::Mechanize
Web Collage
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebReaper
WebStripper
Website Quester
WebsiteQuester
Wonderbot
Wprecon
Zermelo
Zitebot
ZmEu
arquivo.pt
check1.exe
clark-crawler
cognitiveseo
crawler.feedback
crawler4j
eCatch
facebookscraper
gopher
instabid
internetVista monitor
pcBrowser
polaris version
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seocompany.store
seoscanners
seostar
sexsearcher
sitechecker.pro
siteripz
sogouspider
sp_auditbot
sysscan
trendiction.de
x22Mozilla
zgrab