nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-19 10:09:25 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
ALittle Client
Abonti
Aboundexbot
Acunetix
Aipbot
Alexibot
Alligator
Anarchy
Anarchy99
AwarioRssBot
BDCbot
BDFetch
BLEXBot
BackStreet
Barkrowler
BatchFTP
Bigfoot
Blackboard
Blow
BlowFish
Brandprotect
Buck
Bullseye
BunnySlippers
CSHttp
Calculon
CazoodleBot
CensysInspect
CheTeam
CheeseBot
Citoid
Cloud mapping
Cocolyzebot
Cogentbot
Copyscape
Craftbot
Curious
DBLBot
DSearch
DatabaseDriverMysqli
Deusu
Discobot
DomCopBot
DomainCrawler
Domains Project
Download Wonder
Drip
EMail Siphon
Ebingbong
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
FHscan
FemtosearchBot
Flunky
FrontPage
Fyrebot
G-i-g-a-b-o-t
Genieo
Gigabot
Gotit
Grabber
Grafula
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Harvest
HonoluluBot
Humanlinks
Id-search
Image Fetch
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
InternetSeer
JamesBOT
Jbrofuzz
JetCar
Joomla
Jorgee
Jyxobot
Keyword Density
Kinza
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LexiBot
Lftp
Likse
LinkScan
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Ltx71
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Majestic-SEO
MarkWatch
Mass Downloader
MauiBot
MicroMessenger
Microsoft URL Control
Minefield
Mister PiX
Mojeek
Mozlila
Mr.4x3
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
Needle
Nessus
Net Vampire
NetLyzer
NetMechanic
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Nikto
Nmap
Not
Nuclei
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeSpider
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Pandalytics
Panscient
Pavuk
Petalbot
Picsearch
PictureFinder
PleaseCrawl
Probethenet
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
Reaper
Recorder
RedesScrapy
SEOkicks-Robot
SEOstats
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Siphon
SiteLockSpider
Sitebeam
Siteimprove
Snake
Snapbot
Sociscraper
Sosospider
Spanner
Spinn3r
Sqworm
Steeler
Sucker
Sucuri
Surfbot
Swiftbot
TeleportPro
Telesphorep
The Intraformant
TheNomad
Toweyabot
Trendictionbot
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
VB Project
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
WeSEE
Web Auto
Web Enhancer
Web Pix
WebAuto
WebCollage
WebLeacher
WebReaper
WebZIP
Website Quester
Whack
Woobot
Wotbox
Xenu
YoudaoBot
Zade
ZoomBot
ZoominfoBot
ZyBorg
archive.org_bot
check1.exe
coccocbot
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
domainsproject.org
evc-batch
isitwp.com
muhstik-scan
netEstate NE Crawler
pcBrowser
probe-image-size
s1z.ru
scalaj-http
seobility
seocompany.store
seoscanners
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
sysscan
tAkeOut
webgains-bot
webmeup-crawler
x09Mozilla
xpymep1.exe
zauba.io