nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-05 10:07:29 +00:00

100 lines
1.1 KiB
Text

AIBOT
ASPSeek
Acunetix
AhrefsBot
Anthill
Asterias
BatchFTP
Brandprotect
BuzzSumo
Bytespider
CATExplorador
CSHttp
Cegbfeieh
CherryPicker
Crescent
DBLBot
DTS Agent
Digincore
DigitalPebble
Discobot
Dispatch
DnBCrawler-Analytics
DnyzBot
EMail Wolf
Evil
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Foobot
FrontPage
GT::WWW
GermCrawler
Gigabot
GrabNet
Haansoft
Image Sucker
InfoNaviRobot
Leap
LibWeb
Lightspeedsystems
LinkextractorPro
LinkpadBot
Lipperhey
MIDown tool
MJ12bot
MTRobot
Majestic SEO
MarkMonitor
Microsoft URL Control
Morfeus Fucking Scanner
Mr.4x3
NearSite
Nettrack
Nutch
Octopus
Offline Navigator
OnCrawl
Openvas
OutfoxBot
PageAnalyzer
Pandalytics
PictureFinder
Pockey
Quick-Crawler
RebelMouse
RedesScrapy
SBIder
SEOkicks
SeekportBot
SemanticJuice
SeobilityBot
Sitebeam
SmartDownload
Snoopy
Sottopop
SpankBot
Spinn3r
Steeler
Sucuri
Surfbot
Telesoft
The Intraformant
URLy Warning
WISENutbot
Web Fuck
WebAuto
WebEnhancer
WebFuck
Zitebot
arquivo.pt
crawl.sogou.com
domainsproject.org
page scorer
pcBrowser
seobility
sexsearcher
siteripz
sysscan
x22Mozilla
zauba.io