nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-31 22:08:40 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
ADmantX
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Aspiegel
BBBike
BDCbot
BDFetch
BackStreet
BackWeb
BatchFTP
Bitacle
Black Hole
BlackWidow
Blow
BotALot
Buck
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
Calculon
CensysInspect
Claritybot
Cloud mapping
Cocolyzebot
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DTS Agent
Deusu
Digincore
Dirbuster
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EroCrawler
Evil
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
Firefox/7.0
Flunky
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GermCrawler
Getintent
Gigabot
GoZilla
Gotit
GrabNet
Grabber
Grafula
GrapeFX
HEADMasterSEO
Haansoft
IDBTE4M
IDBot
IRLbot
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
Iria
JOC Web Spider
Jorgee
Keyword Density
Kozmosbot
LWP::Simple
Lanshanbot
Leap
Lftp
LibWeb
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
MIIxpc
MSFrontPage
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
Meanpathbot
MegaIndex.ru
Metauri
Microsoft URL Control
Mister PiX
Musobot
NPbot
Needle
Net Vampire
NetSpider
Netcraft
Nettrack
NextGenSearchBot
Nimbostratus
Nmap
OnCrawl
PageScorer
PageThing.com
Pavuk
Petalbot
PictureFinder
Piepmatz
Pixray
Pockey
ProWebWalker
Probethenet
Psbot
PxBroker
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
RankurBot
RealDownload
Reaper
Recorder
Ripper
SBIder
SEOstats
SalesIntelligent
Scanbot
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
SeobilityBot
Seomoz
Shodan
SiteSnagger
SmartDownload
Snake
Snapbot
Snoopy
Sociscraper
Sogou web spider
SpaceBison
SputnikBot
Steeler
Stripper
Sucker
Sucuri
SuperBot
Surfbot
Suzuran
Szukacz
Telesphoreo
The Intraformant
TheNomad
TightTwatBot
Toweyabot
TurnitinBot
V-BOT
VCI
Vacuum
Vagabondo
VoidEYE
Voltron
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Fetch
Web Pix
Web Sauger
Web Sucker
WebBandit
WebCopier
WebLeacher
WebStripper
Webshag
WebsiteQuester
Whatweb
Widow
Wonderbot
Woobot
Xaldon WebSpider
Zeus
ZmEu
ZoomBot
ZoominfoBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
facebookscraper
instabid
lwp-request
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
probe-image-size
ripz
satoristudio.net
scalaj-http
sexsearcher
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x22Mozilla