nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-01 22:07:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
ADmantX
Abonti
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
AllSubmitter
Alligator
Anarchie
Anarchy
Anarchy99
Anthill
Aspiegel
Asterias
Attach
AwarioRssBot
BBBike
BDFetch
BackStreet
BackWeb
Bandit
Battleztar Bazinga
Bigfoot
Blow
BlowFish
Brandwatch
Buck
Buddy
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CSHttp
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
Claritybot
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Copyscape
Craftbot
Crescent
CrunchBot
Curious
Custo
DSearch
DigitalPebble
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
Download Wonder
Drip
EMail Wolf
Ebingbong
Ecxi
Evil
Express WebPictures
FemtosearchBot
Flunky
Foobot
GetRight
Gigabot
Gotit
Grabber
GridBot
HMView
Haansoft
HaosouSpider
Harvest
HonoluluBot
IDBot
Image Fetch
IndeedBot
Intelliseek
Internet Ninja
InternetSeer
JennyBot
Jetty
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LWP::Simple
Larbin
Libwhisker
LieBaoFast
Lightspeedsystems
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
MFC_Tear_Sample
MIIxpc
MJ12bot
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot
MarkWatch
Mb2345Browser
Meanpathbot
Microsoft URL Control
Mister PiX
Moblie Safari
MolokaiBot
Mr.4x3
Nameprotect
NearSite
Nessus
NetLyzer
NetMechanic
Nettrack
NextGenSearchBot
Nibbler
NimbleCrawler
Nutch
OpenLinkProfiler
Openfind
OutclicksBot
Page Analyzer
PageGrabber
Pandalytics
Papa Foto
Pavuk
Pi-Monster
Picscout
Picsearch
Piepmatz
Pixray
ProWebWalker
Probethenet
PxBroker
RankFlex
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SBIder
SEOstats
SISTRIX
SMTBot
Scanbot
Scrapy
Searchestate
SemrushBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
SmartDownload
Snake
Snoopy
Spanner
Spbot
SputnikBot
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Suzuran
Szukacz
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Trendiction
Turnitin
TwengaBot
URLy Warning
V-BOT
VCI
Vacuum
Vagabondo
VoidEYE
Voltron
WEBDAV
WISENutbot
WWW::Mechanize
WeSEE
Web Enhancer
Web Fuck
Web Pix
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebFuck
WebGo IS
WebLeacher
WebStripper
WebWhacker
Webshag
Who.is Bot
Wonderbot
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Xenu
ZoominfoBot
ZyBorg
archive.org_bot
arquivo.pt
cah.io.community
check1.exe
clark-crawler
crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch
evc-batch
instabid
ips-agent
isitwp.com
linkdexbot
magpie-crawler
muhstik-scan
pcBrowser
polaris version
satoristudio.net
seobility
serpstatbot
sexsearcher
sp_auditbot
spyfu
sysscan
tAkeOut
voyagerx.com
webmeup-crawler
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab