nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-20 10:07:07 +00:00

100 lines
1.1 KiB
Text

404checker
ALittle Client
Acunetix
AlphaBot
Anarchy
Anthill
Barkrowler
Bitacle
Buck
CSHttp
CensysInspect
Cliqzbot
Cloud mapping
Collector
Crawling at Home Project
Curious
DTS Agent
Devil
DomCopBot
DomainStatsBot
ExtLinksBot
Flunky
G-i-g-a-b-o-t
GT::WWW
Genieo
Gotit
IndeedBot
Indy Library
InterGET
InternetSeer
Jbrofuzz
JetCar
Jetty
JustView
Kenjin Spider
LeechFTP
Lightspeedsystems
LinkextractorPro
LinqiaRSSBot
MSFrontPage
Majestic SEO
Mister PiX
Mojolicious
Msrabot
NICErsPRO
NetSpider
NimbleCrawler
Nmap
Offline Navigator
OnCrawl
Openvas
OutclicksBot
Pandalytics
Panscient
PyCurl
RSSingBot
Rainbot
RankingBot2
RealDownload
SEOkicks
SEOkicks-Robot
SEOprofiler
ScoutJet
ScrepyBot
SentiBot
SenutoBot
SocialRankIOBot
Sottopop
SpaceBison
Spanner
Sqworm
Steeler
Swiftbot
TeleportPro
Toata
Tracemyfile
Twice
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WASALive-Bot
WWW-Mechanize
WWWOFFLE
Web Fetch
Web Fuck
WebCopier
WebGo IS
WebReaper
WebmasterWorldForumBot
WebsiteExtractor
Widow
archive.org_bot
autoemailspider
check1.exe
internetVista monitor
plumanalytics
seoscanners
sysscan
webgains-bot