nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-25 10:09:24 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
AIBOT
Aboundex
Aboundexbot
AiHitBot
Anarchy
Aspiegel
Atomseobot
BDFetch
BackDoorBot
BacklinkCrawler
Badass
Barkrowler
Battleztar Bazinga
Bigfoot
Blackboard
Blow
Bolt
BotALot
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
BunnySlippers
CCBot
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CherryPicker
ChinaClaw
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Curious
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Devil
Digincore
Disco
Discoverybot
Dispatch
DomCopBot
Domains Project
Dotbot
Dragonfly
EMail Siphon
EMail Wolf
EroCrawler
Exabot
FemtosearchBot
Flunky
Fuzz
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
Go!Zilla
Go-Ahead-Got-It
Grafula
GrapeFX
HEADMasterSEO
HaosouSpider
Harvest
Heritrix
HonoluluBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
Intelliseek
Iria
JOC Web Spider
Jetty
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
LWP::Simple
Larbin
Leap
LexiBot
Lftp
LibWeb
Lightspeedsystems
Likse
LinkWalker
LinkpadBot
Lmspider
Ltx71
MJ12bot
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
MarkWatch
MauiBot
Mediatoolkitbot
Metauri
Microsoft Data Access
Minefield
Mister PiX
Mojeek
NPbot
Name Intelligence
NearSite
Needle
Net Vampire
NetSpider
NetZIP
Netcraft
Netvibes
Niki-bot
Nikto
Nutch
Octopus
Offline Navigator
OpenLinkProfiler
Page Analyzer
PageGrabber
PeoplePal
Petalbot
Piepmatz
Pixray
PleaseCrawl
Pockey
Probethenet
Pu_iN
QueryN Metasearch
RankActive
RankFlex
RankingBot
RankingBot2
Re-re
ReGet
Reaper
RedesScrapy
SEOlyticsCrawler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
Semrush
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Siphon
Site Sucker
SiteSnagger
SlySearch
SmartDownload
Snapbot
Snoopy
Sociscraper
Sosospider
Sottopop
SpaceBison
Spbot
Sqworm
Stripper
Sucuri
SuperHTTP
Suzuran
T8Abot
Telesoft
Telesphorep
Thumbor
Titan
Toweyabot
Tracemyfile
Trendiction
Turingos
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
VB Project
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voltron
WBSearchBot
WPScan
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Collage
Web Enhancer
Web Fetch
Web Sauger
WebAuto
WebCollage
WebSauger
WebsiteQuester
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Zade
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZyBorg
archive.org_bot
autoemailspider
clark-crawler
crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch
heritrix
instabid
ips-agent
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
polaris version
probe-image-size
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
sysscan
trendiction.com
webgains-bot
webprosbot
x22Mozilla
xpymep1.exe
zauba.io