nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-13 10:09:20 +00:00

250 lines
2.5 KiB
Text

01h4x.com
AIBOT
Abonti
Aboundex
AhrefsBot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy
Anthill
Aspiegel
Atomseobot
BLEXBot
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
Blackboard
Bolt
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Cliqzbot
Cogentbot
Collector
Copier
Craftbot
Curious
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
Dirbuster
Disco
DomainSigmaCrawler
Drip
ECCP/1.0
Ecxi
EirGrabber
Evil
Exabot
ExtLinksBot
Extreme Picture Finder
FDM
FlashGet
Freeuploader
FrontPage
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
Go!Zilla
GoZilla
Grabber
HMView
HTMLparser
HTTrack
HaosouSpider
Havij
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
IDBot
Id-search
Intelliseek
InterGET
Internet Ninja
Iskanie
Jbrofuzz
JetCar
JikeSpider
Joomla
Kozmosbot
LNSpiderguy
LWP::Simple
LeechFTP
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
Ltx71
MIIxpc
MTRobot
Mag-Net
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
Metauri
MicroMessenger
Minefield
MolokaiBot
Mozlila
Msrabot
Musobot
NearSite
Needle
Net Vampire
NetLyzer
Netcraft
Nettrack
Netvibes
Nibbler
Nikto
Nimbostratus
Nmap
Octopus
Offline Explorer
Offline Navigator
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageScorer
Papa Foto
Petalbot
Pi-Monster
Picscout
Picsearch
Pixray
PleaseCrawl
ProWebWalker
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankFlex
RankingBot
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
ScoutJet
Scrapy
Semrush
Seomoz
Shodan
Site Sucker
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
SlySearch
Sociscraper
Sogou web spider
Spanner
Spbot
Spinn3r
SputnikBot
Sqworm
SuperBot
Surfbot
TeleportPro
Thumbor
TightTwatBot
Tracemyfile
Trendictionbot
TwengaBot
Typhoeus
UnisterBot
VB Project
VCI
VelenPublicWebCrawler
VeriCiteCrawler
WBSearchBot
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Collage
Web Enhancer
Web Sauger
Web Sucker
WebAuto
WebFuck
WebLeacher
WebReaper
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Whack
WiseGuys Robot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zitebot
ZmEu
ZoomBot
ZumBot
adscanner
autoemailspider
check1.exe
clark-crawler
crawler4j
gopher
instabid
ips-agent
iubenda-radar
lwp-trivial
magpie-crawler
mediawords
page scorer
plumanalytics
seobility
seostar
sexsearcher
sitechecker.pro
sogouspider
voyagerx.com
webmeup-crawler
webprosbot
zgrab