nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-26 10:09:13 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404enemy
ADmantX
AIBOT
ASPSeek
Aboundex
AiHitBot
Alligator
AlphaBot
Asterias
AwarioRssBot
BLEXBot
BackStreet
BackWeb
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
BlackWidow
Blackboard
BlowFish
Bolt
Buck
Buddy
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CODE87
Calculon
CensysInspect
CheTeam
CheeseBot
Citoid
Cloud mapping
Cocolyzebot
Copier
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DIIbot
DTS Agent
DatabaseDriverMysqli
Dirbuster
Discobot
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainStatsBot
Domains Project
Download Wonder
Drip
ECCP/1.0
EMail Wolf
ExtLinksBot
Extractor
Ezooms
FHscan
Freeuploader
FrontPage
Genieo
GetRight
GoZilla
Grabber
GrapeFX
GridBot
HTMLparser
HTTP::Lite
HaosouSpider
Heritrix
Humanlinks
IDBTE4M
IRLbot
Id-search
IlseBot
Image Sucker
InfoNaviRobot
Iria
Iskanie
JamesBOT
Jorgee
Kenjin Spider
Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
LieBaoFast
Likse
LinkextractorPro
Lipperhey
MFC_Tear_Sample
MIIxpc
MQQBrowser
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
MolokaiBot
Msrabot
Nameprotect
Needle
Net Vampire
NetAnts
Netcraft
Nettrack
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
Not
Octopus
Offline Navigator
OnCrawl
OpenVAS
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Papa Foto
PeoplePal
Pi-Monster
PictureFinder
Pixray
Pu_iN
Pump
QueryN Metasearch
RankActiveLinkBot
RankingBot2
RealDownload
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Scrapy
Seekport
Semrush
SeoSiteCheckup
SeobilityBot
Siphon
Site Sucker
Sitebeam
SlySearch
SmartDownload
Snake
Snoopy
Sociscraper
Sosospider
Spinn3r
Sucker
Sucuri
SuperHTTP
SurveyBot
Suzuran
Swiftbot
Szukacz
T8Abot
TeleportPro
Telesphorep
TheNomad
Thumbor
Trendiction
True_Robot
Twice
URLy Warning
VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WPScan
WWW-Mechanize
Web Auto
Web Fetch
Web Fuck
Web Sucker
WebCopier
WebLeacher
Webalta
WebsiteQuester
Webster
Whacker
WinHTTrack
WiseGuys Robot
Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
ZmEu
adscanner
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
check1.exe
clark-crawler
cognitiveseo
crawler4j
eCatch
evc-batch
instabid
internetVista monitor
linkdexbot
lwp-request
magpie-crawler
muhstik-scan
netEstate NE Crawler
oBot
page scorer
pcBrowser
probe-image-size
ripz
s1z.ru
scalaj-http
scan.lol
seostar
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
webprosbot
zauba.io
zgrab