nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-05 10:09:43 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
404enemy
ADmantX
Abonti
Aboundexbot
Alligator
Anarchie
Anarchy99
Aspiegel
AwarioRssBot
BackWeb
Backlink-Ceck
Badass
Bandit
BatchFTP
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
Blow
BlowFish
Bolt
BotALot
Buck
BuiltWith
Bullseye
CATExplorador
Calculon
CazoodleBot
CensysInspect
CheeseBot
ChinaClaw
Claritybot
Cocolyzebot
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Crescent
DBLBot
DSearch
Dispatch
Download Wonder
EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
ExtractorPro
FDM
FemtosearchBot
Fimap
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetWeb
Gigabot
Gotit
Grafula
GrapeFX
HTTP::Lite
HTTrack
HaosouSpider
Hloader
HonoluluBot
HybridBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InterGET
Internet Ninja
IstellaBot
Jbrofuzz
Joomla
JustView
Kozmosbot
Larbin
Leap
LeechFTP
Libwhisker
Lightspeedsystems
LinkWalker
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MIDown tool
MSFrontPage
MTRobot
Mag-Net
Majestic SEO
MarkMonitor
MarkWatch
Mata Hari
MegaIndex.ru
Metauri
Minefield
Mister PiX
Mozlila
Msrabot
Musobot
NICErsPRO
NPbot
NearSite
Net Vampire
NetAnts
NetMechanic
NetZIP
Netcraft
Nettrack
Not
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
OutfoxBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
PeoplePal
Petalbot
PictureFinder
Pimonster
PleaseCrawl
Probethenet
Pump
PyCurl
RankFlex
Rankivabot
RankurBot
RealDownload
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks
SEOprofiler
SEOstats
ScanAlert
Scanbot
ScoutJet
Screaming
SearchmetricsBot
Seekport
SemanticJuice
SemrushBot
SentiBot
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Sitevigil
Snapbot
Spammen
SpankBot
SputnikBot
Sqworm
Steeler
Stripper
Sucker
Sucuri
T0PHackTeam
Telesoft
Telesphorep
Titan
Tracemyfile
True_Robot
TurnitinBot
Typhoeus
Upflow
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voil
Voltron
WBSearchBot
WISENutbot
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Pix
Web Sauger
WebBandit
WebCopier
WebEnhancer
WebFetch
WebFuck
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
Webster
Whack
Whatweb
Who.is Bot
Zitebot
ZmEu
ZoominfoBot
ZumBot
arquivo.pt
cah.io.community
crawl.sogou.com
domainsproject.org
heritrix
internetVista monitor
linkdexbot
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
page scorer
polaris version
probe-image-size
ripz
scalaj-http
scan.lol
seobility
seostar
sp_auditbot
voyagerx.com
webgains-bot
xpymep1.exe
zauba.io