nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-10 22:07:06 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Alexibot
AllSubmitter
Alligator
Anarchie
Anarchy
Anarchy99
Anthill
Apexoo
Aspiegel
Atomseobot
AwarioSmartBot
BBBike
BLEXBot
BackDoorBot
BackWeb
BacklinkCrawler
Bandit
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
BlackWidow
Blackboard
BlowFish
BuiltWith
CATExplorador
CODE87
CSHttp
CazoodleBot
Chlooe
Cloud mapping
Cogentbot
Copier
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
DBLBot
DIIbot
DataCha0s
Devil
Dirbuster
Discobot
DittoSpyder
DomCopBot
DomainCrawler
DomainSigmaCrawler
Domains Project
Ebingbong
Ecxi
EirGrabber
Evil
Ezooms
Firefox/7.0
Foobot
Freeuploader
FrontPage
Fuzz
G-i-g-a-b-o-t
Genieo
Getintent
Go-Ahead-Got-It
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
Hloader
Humanlinks
IDBTE4M
Iblog
Id-search
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
InternetSeer
Iria
Kenjin Spider
Keybot Translation-Search-Machine
LWP::Simple
Larbin
LeechGet
Lftp
LieBaoFast
Lightspeedsystems
LinkScan
LinkextractorPro
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MarkWatch
Mass Downloader
Masscan
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Musobot
NearSite
NetAnts
NetSpider
NimbleCrawler
Nimbostratus
Openfind
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PageGrabber
PageThing.com
Picscout
Probethenet
Psbot
Pu_iN
RankingBot
RankingBot2
Re-re
ReGet
RealDownload
Reaper
RepoMonkey
Ripper
RocketCrawler
Rogerbot
Scanbot
Scrapy
Screaming
ScrepyBot
SearchmetricsBot
Seekport
Semrush
SemrushBot
SentiBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
Snoopy
Sosospider
Spbot
Sqlworm
Sqworm
Stripper
Sucker
Sucuri
SuperHTTP
Suzuran
Swiftbot
T8Abot
Teleport
Telesphoreo
The Intraformant
Thumbor
Tracemyfile
True_Robot
Turingos
Turnitin
Twice
URLy.Warning
UnisterBot
VeriCiteCrawler
VidibleScraper
Voil
Voltron
WBSearchBot
WWW-Collector-E
WWW::Mechanize
Wallpapers
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebSauger
WebStripper
WebWhacker
Webalta
Website Quester
Webster
Whack
Widow
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zeus
ZoominfoBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
coccocbot
com.plumanalytics
crawl.sogou.com
domainsproject.org
evc-batch
isitwp.com
iubenda-radar
linkdexbot
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
probe-image-size
ripz
seobility
seoscanners
sitechecker.pro
sogouspider
sp_auditbot
spyfu
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io
zgrab