nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-25 22:06:54 +00:00

250 lines
2.5 KiB
Text

404checker
80legs
ADmantX
ASPSeek
Aboundex
AfD-Verbotsverfahren
AiHitBot
Alligator
Anthill
Apexoo
Aspiegel
AwarioRssBot
BBBike
BDFetch
BackStreet
BackWeb
Barkrowler
Battleztar Bazinga
BlackWidow
Bolt
BotALot
Buck
BuiltWith
BunnySlippers
CATExplorador
CCBot
Calculon
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Citoid
Cliqzbot
Cocolyzebot
Copier
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
Deusu
Digincore
DigitalPebble
Discobot
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
Dotbot
EasyDL
EroCrawler
ExtractorPro
FDM
FHscan
FemtosearchBot
Freeuploader
Fuzz
FyberSpider
GalaxyBot
Genieo
GermCrawler
Getintent
Gigabot
GoZilla
GrabNet
GrapeFX
HTTP::Lite
HaosouSpider
Harvest
Hloader
InfoTekies
InterGET
Jbrofuzz
JikeSpider
Jyxobot
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkWalker
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
MarkMonitor
Mata Hari
MeanPath Bot
Meanpathbot
MegaIndex.ru
MicroMessenger
Minefield
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Msrabot
NetAnts
NetLyzer
NetMechanic
NetSpider
NetZIP
Netvibes
Nibbler
Niki-bot
Nikto
Nmap
Not
Nuclei
Nutch
Offline Navigator
OpenVAS
OutclicksBot
OutfoxBot
PHPCrawl
PeoplePal
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
Probethenet
Psbot
Pump
PyCurl
Re-re
Recorder
Ripper
SEOkicks
SEOkicks-Robot
SISTRIX
ScoutJet
Screaming
Searchestate
Seekport
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
SiteSnagger
Sitebeam
SlySearch
SmartDownload
Snapbot
Sogou web spider
Sosospider
Sottopop
Spammen
Spanner
Sqlmap
Sqlworm
Sqworm
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Szukacz
T8Abot
Telesoft
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Toweyabot
Trendictionbot
Turingos
TurnitinBot
TwengaBot
Twice
Typhoeus
Virusdie
Voltron
WASALive-Bot
WEBDAV
WWW-Mechanize
Wallpapers
Web Auto
Web Collage
Web Fetch
Web Pix
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebReaper
WebSucker
Webalta
WebsiteExtractor
WebsiteQuester
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
Zermelo
Zitebot
ZumBot
arquivo.pt
cah.io.community
coccocbot
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
facebookscraper
ips-agent
linkdexbot
lwp-request
lwp-trivial
meanpathbot
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
probe-image-size
ripz
satoristudio.net
scalaj-http
seobility
sitechecker.pro
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla