nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-06 10:07:06 +00:00

100 lines
1.1 KiB
Text

ALittle Client
AiHitBot
Aspiegel
AwarioSmartBot
BBBike
BatchFTP
Bullseye
CherryPicker
Cogentbot
Copyscape
Crescent
CrunchBot
DigitalPebble
Discobot
Domains Project
ExtractorPro
FemtosearchBot
FrontPage
Gigabot
GrabNet
Grafula
Haansoft
Image Fetch
Image Sucker
JOC Web Spider
JennyBot
Joomla
Jyxobot
Keybot Translation-Search-Machine
Lanshanbot
LinqiaMetadataDownloaderBot
Lmspider
Metauri
Minefield
Morfeus Fucking Scanner
Name Intelligence
Navroad
Net Vampire
NetAnts
NetLyzer
Ninja
OpenVAS
Openfind
Page Analyzer
Pandalytics
PeoplePal
Petalbot
Picsearch
Piepmatz
ProPowerBot
Pump
PyCurl
Quick-Crawler
RedesScrapy
Ripper
SBIder
SentiBot
Seomoz
SiteCheckerBotCrawler
Sitebeam
Siteimprove
Sociscraper
Sogou web spider
Spammen
SputnikBot
SuperHTTP
TheNomad
Turnitin
URLy.Warning
WBSearchBot
WWW-Collector-E
Wallpapers
Web Enhancer
WebAuto
WebReaper
WebSucker
WebWhacker
Whack
Widow
Zade
Zeus
ZmEu
ZoomBot
adscanner
crawler4j
dataforseo.com
gopher
lwp-trivial
netEstate NE Crawler
openai
pcBrowser
plumanalytics
polaris version
seostar
sp_auditbot
spyfu
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler