nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-27 10:10:39 +00:00

250 lines
2.6 KiB
Text

ALittle Client
Abonti
Alexibot
AllSubmitter
AlphaBot
Anarchy
Ankit
Aspiegel
Asterias
AwarioSmartBot
BBBike
BackStreet
Backlink-Ceck
Bandit
BatchFTP
Battleztar Bazinga
Bitacle
Black Hole
Blackboard
Blow
Brandprotect
Bullseye
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CheeseBot
CherryPicker
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
Deusu
Devil
DigitalPebble
Discoverybot
Dispatch
DomainCrawler
DomainStatsBot
Domains Project
Download Wonder
ECCP/1.0
EMail Siphon
Ebingbong
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Flunky
Fuzz
FyberSpider
GT::WWW
GetRight
GetWeb
Gigabot
Grafula
GrapeFX
GridBot
HEADMasterSEO
HTMLparser
Haansoft
HaosouSpider
Harvest
Humanlinks
IlseBot
Image Sucker
Indy Library
InfoTekies
Intelliseek
InterGET
InternetSeer
Iria
JamesBOT
JennyBot
JikeSpider
Jorgee
Keyword Density
LWP::Simple
Lanshanbot
LinkScan
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MSIECrawler
Magnet
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
Minefield
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
NPbot
Nameprotect
Navroad
Nessus
NetAnts
NetMechanic
Netvibes
Nibbler
Nikto
Ninja
Nuclei
Octopus
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OrangeSpider
OutclicksBot
PHPCrawl
PageGrabber
PageThing.com
Papa Foto
PeoplePal
Pi-Monster
Picscout
Piepmatz
ProPowerBot
ProWebWalker
Pu_iN
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankurBot
Re-re
RebelMouse
RedesScrapy
RocketCrawler
Rogerbot
SEOkicks-Robot
SISTRIX
SMTBot
Searchestate
SemanticJuice
SeoSiteCheckup
Shodan
SiteCheckerBotCrawler
SiteSucker
Siteimprove
Sitevigil
SmartDownload
Snoopy
SocialRankIOBot
Sottopop
Sqlworm
Sqworm
Sucker
Sucuri
Surfbot
Suzuran
Swiftbot
Szukacz
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
Titan
Toweyabot
TwengaBot
URLy Warning
Upflow
Vagabondo
Voltron
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
WeSEE
Web Enhancer
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebBandit
WebFetch
WebGo IS
WebImageCollector
WebPix
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Xaldon_WebSpider
Xenu
Zauba
Zeus
Zitebot
ZyBorg
arquivo.pt
cognitiveseo
com.plumanalytics
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
instabid
isitwp.com
lwp-request
muhstik-scan
netEstate NE Crawler
oBot
plumanalytics
ripz
s1z.ru
satoristudio.net
scalaj-http
seocompany.store
seoscanners
sitechecker.pro
siteripz
trendiction.com
webmeup-crawler
x09Mozilla
xpymep1.exe
zauba.io