nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-08 10:09:03 +00:00

250 lines
2.6 KiB
Text

404enemy
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
Alexibot
AllSubmitter
Alligator
Anarchy99
Anthill
BLEXBot
BackDoorBot
BackWeb
BacklinkCrawler
Barkrowler
BlackWidow
Boardreader
Bolt
Brandprotect
Brandwatch
Buddy
Bullseye
CATExplorador
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Copyscape
Crawling at Home Project
Curious
DSearch
DatabaseDriverMysqli
Demon
Deusu
Devil
Discoverybot
DomCopBot
DomainAppender
DomainCrawler
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
EirGrabber
EyeNetIE
Ezooms
FDM
FHscan
FlashGet
Flunky
Freeuploader
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetRight
GetWeb
Gigabot
GoZilla
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
Havij
Hloader
HybridBot
IDBot
Iblog
Image Sucker
JOC Web Spider
Jetty
JikeSpider
Joomla
Jyxobot
Keyword Density
Kinza
Lanshanbot
Larbin
Leap
LeechFTP
LibWeb
Lightspeedsystems
LinkScan
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Ltx71
MFC_Tear_Sample
MJ12bot
MSFrontPage
MSIECrawler
Majestic-SEO
Majestic12
MarkWatch
Mata Hari
Mediatoolkitbot
Microsoft Data Access
Moblie Safari
Mojeek
Mojolicious
Mr.4x3
Musobot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
NetAnts
NetLyzer
NetMechanic
Netcraft
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
Not
Nutch
OnCrawl
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picscout
Pimonster
Pixray
Psbot
QueryN Metasearch
RankActive
RankingBot
Rankivabot
RankurBot
ReGet
RealDownload
Recorder
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
ScanAlert
ScoutJet
ScreenerBot
ScrepyBot
SearchmetricsBot
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
SlySearch
SmartDownload
Sogou web spider
Sosospider
Spammen
SpankBot
Stripper
Sucuri
Telesoft
Telesphorep
Titan
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
TwengaBot
Twice
Typhoeus
UnisterBot
VB Project
Voltron
WBSearchBot
WISENutbot
WWW-Mechanize
WallpapersHD
Web Fuck
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebFetch
WebGo IS
WebLeacher
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
WebsiteExtractor
Who.is Bot
WiseGuys Robot
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zitebot
ZoominfoBot
autoemailspider
check1.exe
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
eCatch
heritrix
instabid
internetVista monitor
pcBrowser
probe-image-size
scalaj-http
scan.lol
seobility
seostar
serpstatbot
sitechecker.pro
siteripz
spyfu
trendiction.de
ubermetrics-technologies.com
webgains-bot
x09Mozilla
x22Mozilla
zauba.io
zgrab