nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-15 10:10:05 +00:00

250 lines
2.6 KiB
Text

404enemy
ADmantX
ALittle Client
ASPSeek
Aboundex
Acunetix
AhrefsBot
AiHitBot
Alexibot
Anarchie
Ankit
Aspiegel
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
BetaBot
Bigfoot
Black Hole
BlackWidow
Blackboard
Blow
Bolt
Buck
Bullseye
BunnySlippers
CODE87
CazoodleBot
Cegbfeieh
CensysInspect
CherryPicker
ChinaClaw
Cliqzbot
Collector
Copier
Copyscape
Cosmos
Crawling at Home Project
Crescent
CrunchBot
Curious
Custo
DBLBot
DataCha0s
DatabaseDriverMysqli
Demon
DigitalPebble
Dirbuster
DittoSpyder
DnBCrawler-Analytics
DomainStatsBot
EirGrabber
ExtLinksBot
Extractor
EyeNetIE
Ezooms
FHscan
Firefox/7.0
Fyrebot
GalaxyBot
Genieo
GetWeb
Go!Zilla
Grabber
GrapeFX
HEADMasterSEO
HTMLparser
Haansoft
IRLbot
IlseBot
IndeedBot
InfoTekies
JOC Web Spider
JamesBOT
JetCar
JikeSpider
Joomla
JustView
Kenjin Spider
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
Majestic SEO
MarkWatch
Mb2345Browser
MegaIndex.ru
Minefield
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
Msrabot
Musobot
NPbot
Navroad
Net Vampire
NetAnts
NetMechanic
NetSpider
Netcraft
Nimbostratus
Ninja
Nutch
Octopus
Offline Explorer
Offline Navigator
OrangeBot
OutfoxBot
PHPCrawl
Page Analyzer
PageThing.com
Pandalytics
Panscient
Papa Foto
Pavuk
Pi-Monster
Picsearch
PictureFinder
Pixray
Pockey
Probethenet
Pump
PxBroker
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RealDownload
Reaper
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
ScanAlert
Scanbot
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
SentiBot
Shodan
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
SlySearch
Snake
Snapbot
Sogou web spider
SpaceBison
SpankBot
Spbot
Sqlmap
Sqworm
SuperBot
Swiftbot
Teleport
TeleportPro
Telesoft
TightTwatBot
Tracemyfile
True_Robot
Turingos
TurnitinBot
Typhoeus
URLy Warning
V-BOT
VB Project
VCI
Vacuum
Virusdie
Voil
Voltron
WISENutbot
WWW-Mechanize
WallpapersHD
Web Auto
Web Collage
Web Fuck
Web Sucker
WebCopier
WebEnhancer
WebFuck
WebReaper
WebWhacker
Webshag
Website Quester
Whack
Whatweb
Who.is Bot
Wonderbot
Woobot
Wotbox
Wprecon
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZoomBot
ZoominfoBot
backlink-check
cah.io.community
check1.exe
clark-crawler
crawler4j
demandbase-bot
domainsproject.org
facebookscraper
heritrix
lwp-trivial
magpie-crawler
oBot
pcBrowser
polaris version
satoristudio.net
scalaj-http
scan.lol
seobility
seocompany.store
sitechecker.pro
siteripz
sysscan
tAkeOut
trendiction.de
voyagerx.com
webgains-bot
webmeup-crawler