nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-10 22:07:29 +00:00

250 lines
2.6 KiB
Text

80legs
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
Alligator
Anarchie
Anarchy99
Ankit
Anthill
Aspiegel
Atomseobot
AwarioRssBot
BDFetch
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass
Barkrowler
BatchFTP
BetaBot
Bigfoot
Bitacle
BlackWidow
BlowFish
BotALot
Brandwatch
Buck
CCBot
CODE87
Calculon
ChinaClaw
Citoid
Claritybot
Cloud mapping
Craftbot
CrazyWebCrawler
Crescent
Curious
Custo
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Digincore
Disco
DomCopBot
DomainCrawler
DomainSigmaCrawler
Domains Project
Download Wonder
Dragonfly
Drip
EMail Siphon
Ebingbong
Ecxi
EroCrawler
Evil
ExtLinksBot
Extractor
Extreme Picture Finder
Ezooms
FlashGet
Fyrebot
GT::WWW
GalaxyBot
Gigabot
GrabNet
GrapeshotCrawler
HEADMasterSEO
HTTrack
Haansoft
HaosouSpider
Harvest
Heritrix
Hloader
Humanlinks
HybridBot
IndeedBot
Indy Library
InfoTekies
InterGET
Iria
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JustView
Jyxobot
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp
LinqiaRSSBot
Lipperhey Spider
MSIECrawler
MTRobot
Mag-Net
Majestic12
Mata Hari
Mb2345Browser
MeanPath Bot
Metauri
Microsoft URL Control
Minefield
Mister PiX
MolokaiBot
Mozlila
Msrabot
NICErsPRO
NPbot
Navroad
NetSpider
Netcraft
NextGenSearchBot
Niki-bot
NimbleCrawler
Nmap
Not
Nuclei
Nutch
Octopus
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
PeoplePal
Pi-Monster
Piepmatz
Pixray
Pockey
Pump
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
Re-re
RealDownload
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
Scrapy
ScrepyBot
Semrush
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitevigil
SmartDownload
Snoopy
Sosospider
SpankBot
Spbot
Sqlworm
SuperBot
SuperHTTP
Surfbot
Suzuran
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphoreo
TheNomad
TightTwatBot
Toata
Tracemyfile
Trendiction
True_Robot
Turingos
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WISENutbot
WWW::Mechanize
WeSEE
Web Enhancer
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebAuto
WebGo IS
WebPix
WebStripper
WebWhacker
Website Quester
WebsiteExtractor
WebsiteQuester
Whatweb
Widow
Wprecon
ZmEu
ZoominfoBot
ZumBot
ZyBorg
autoemailspider
backlink-check
cah.io.community
check1.exe
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
demandbase-bot
eCatch
gopher
heritrix
internetVista monitor
ips-agent
lwp-request
lwp-trivial
oBot
page scorer
polaris version
probe-image-size
ripz
scalaj-http
scan.lol
seobility
serpstatbot
sitechecker.pro
spyfu
voyagerx.com
xpymep1.exe
zauba.io