nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-06 10:09:33 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
AIBOT
Acunetix
AhrefsBot
Alexibot
Anarchie
Anarchy99
Aspiegel
Atomseobot
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
BetaBot
Bigfoot
Blackboard
Blow
BlowFish
Bolt
Buck
BuiltBotTough
CATExplorador
CSHttp
CazoodleBot
Cegbfeieh
CheTeam
CherryPicker
Citoid
Claritybot
Collector
CopyRightCheck
CrazyWebCrawler
Crescent
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
Disco
Discobot
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
EasyDL
EroCrawler
Evil
Extractor
Extreme Picture Finder
EyeNetIE
FlashGet
Freeuploader
FrontPage
Fuzz
Fyrebot
GT::WWW
GermCrawler
GetRight
Go!Zilla
GoZilla
Grabber
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HonoluluBot
IlseBot
Image Fetch
Image Sucker
IndeedBot
Intelliseek
Internet Ninja
Iskanie
JOC Web Spider
Jbrofuzz
JetCar
Jetty
JikeSpider
JustView
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
Leap
LeechGet
Lftp
LieBaoFast
LinkWalker
Linkbot
LinqiaRSSBot
Litemage_walker
Ltx71
MIDown tool
MIIxpc
MJ12bot
MTRobot
Mag-Net
Majestic-SEO
Majestic12
MauiBot
Meanpathbot
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Msrabot
NICErsPRO
NearSite
NetAnts
NetMechanic
Netcraft
Nibbler
Nikto
Nimbostratus
Ninja
Not
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider
OutfoxBot
PHPCrawl
PageGrabber
Pavuk
Petalbot
Pi-Monster
Picscout
Picsearch
PleaseCrawl
ProWebWalker
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankurBot
Re-re
RealDownload
Reaper
RebelMouse
Recorder
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SEOkicks
ScrepyBot
SemanticJuice
SemrushBot
SentiBot
Shodan
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Snoopy
Sociscraper
Sottopop
Spanner
Stripper
Sucker
Swiftbot
TeleportPro
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
True_Robot
Turnitin
Twice
Typhoeus
URLy.Warning
Upflow
VB Project
VCI
VelenPublicWebCrawler
VoidEYE
Voil
WWW::Mechanize
Wallpapers/3.0
Web Enhancer
Web Fetch
WebFetch
WebFuck
WebGo IS
WebLeacher
WebPix
WebZIP
Webshag
Website Quester
Whacker
Who.is Bot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zitebot
ZmEu
ZoomBot
ZyBorg
adscanner
autoemailspider
backlink-check
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
facebookscraper
instabid
ips-agent
isitwp.com
iubenda-radar
linkdexbot
magpie-crawler
meanpathbot
oBot
polaris version
scan.lol
seobility
seoscanners
sogouspider
spyfu
tAkeOut
ubermetrics-technologies.com
webgains-bot
webprosbot
x09Mozilla