nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-04 10:10:01 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
AIBOT
ASPSeek
Abonti
AiHitBot
AlphaBot
Anarchie
Anthill
Aspiegel
Attach
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BacklinkCrawler
Bandit
Battleztar Bazinga
BetaBot
Bitacle
Blackboard
Blow
Boardreader
Bolt
BotALot
Buddy
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
Citoid
Cogentbot
Copyscape
Crawling at Home Project
CrunchBot
Deusu
DomCopBot
DomainCrawler
Domains Project
Dragonfly
EMail Siphon
EMail Wolf
ExtLinksBot
ExtractorPro
EyeNetIE
FDM
Fimap
Firefox/7.0
FlashGet
Flunky
Foobot
Fuzz
Genieo
Getintent
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
HMView
HTMLparser
HTTrack
HaosouSpider
Harvest
Havij
Humanlinks
HybridBot
IDBTE4M
IRLbot
Iblog
Id-search
Intelliseek
InterGET
Internet Ninja
JOC Web Spider
JamesBOT
JetCar
JikeSpider
Jyxobot
LNSpiderguy
Lanshanbot
LeechFTP
LeechGet
Lftp
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Ltx71
MIDown tool
MSFrontPage
MTRobot
Mail.RU_Bot
Majestic12
MarkMonitor
Mata Hari
Mb2345Browser
MicroMessenger
Microsoft Data Access
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Msrabot
NPbot
Name Intelligence
NearSite
Needle
Nessus
NetLyzer
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Nuclei
Offline Navigator
OpenLinkProfiler
PECL::HTTP
PHPCrawl
PageGrabber
PageScorer
Papa Foto
PeoplePal
Pi-Monster
Picscout
PleaseCrawl
ProPowerBot
PxBroker
RankingBot
RankingBot2
Rankivabot
Re-re
RealDownload
RebelMouse
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SalesIntelligent
Screaming
ScreenerBot
ScrepyBot
Searchestate
SentiBot
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Snapbot
Snoopy
SpankBot
Spanner
SputnikBot
Sqworm
Surfbot
Suzuran
Swiftbot
T8Abot
Teleport
Telesphorep
The Intraformant
Toata
Toweyabot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
V-BOT
VelenPublicWebCrawler
VidibleScraper
VoidEYE
WBSearchBot
WEBDAV
WWW-Collector-E
WWWOFFLE
Wallpapers
WeSEE
Web Fuck
Web Pix
WebBandit
WebFuck
WebPix
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Webster
Whacker
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
ZoomBot
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
autoemailspider
check1.exe
clark-crawler
crawl.sogou.com
crawler.feedback
demandbase-bot
domainsproject.org
eCatch
evc-batch
gopher
instabid
ips-agent
isitwp.com
lwp-request
meanpathbot
netEstate NE Crawler
oBot
pcBrowser
probe-image-size
satoristudio.net
scalaj-http
seostar
serpstatbot
sexsearcher
spyfu
sysscan
trendiction.com
trendiction.de
webgains-bot
webmeup-crawler
webpros.com