nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-08 22:05:05 +00:00

100 lines
1.1 KiB
Text

404checker
Anarchy99
Attach
BackWeb
BetaBot
Blackboard
Boardreader
Bullseye
CheTeam
Collector
CopyRightCheck
CrunchBot
Curious
Custo
DomainAppender
Extractor
Extreme Picture Finder
Ezooms
Freeuploader
Fuzz
FyberSpider
Getintent
GoZilla
Grabber
GrapeshotCrawler
HTTrack
Havij
HybridBot
IRLbot
ImagesiftBot
InfoNaviRobot
InfoTekies
Internet Ninja
Iskanie
Keyword Density
LibWeb
Linkbot
MQQBrowser
Mb2345Browser
MicroMessenger
Moblie Safari
Netcraft
Nuclei
Offline Explorer
PHPCrawl
Pimonster
Pixray
ProWebWalker
Reaper
RedesScrapy
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
Seekport
SemanticJuice
Semrush
SentiBot
SenutoBot
SeoSiteCheckup
SiteExplorer
Spammen
Spbot
Sqlworm
Sqworm
SuperHTTP
Surfbot
Swiftbot
Telesphoreo
The Intraformant
Thumbor
TightTwatBot
WPScan
WallpapersHD
Web Sauger
WebEnhancer
Website Quester
WinHTTrack
YaK
Zauba
Zitebot
ZmEu
adscanner
autoemailspider
check1.exe
crawler.feedback
dataforseo.com
heritrix
internetVista monitor
linkdexbot
mediawords
netEstate NE Crawler
page scorer
scan.lol
seoscanners
spyfu
webmeup-crawler
x22Mozilla
xpymep1.exe
zauba.io