nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-05 10:07:45 +00:00

100 lines
977 B
Text

ALittle Client
ASPSeek
Abonti
AiHitBot
Apexoo
Atomseobot
BDCbot
BLEXBot
Badass
Bandit
BetaBot
Black Hole
BlackWidow
Blow
Bullseye
BuzzSumo
CopyRightCheck
DataCha0s
DnyzBot
DomainSigmaCrawler
EMail Siphon
EasyDL
ExtractorPro
Flunky
Fyrebot
HTTrack
HaosouSpider
Harvest
HybridBot
InfoTekies
InterGET
InternetSeer
Kozmosbot
Leap
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinksManager
MIDown tool
MTRobot
Majestic12
MarkMonitor
MarkWatch
MeanPath Bot
Moblie Safari
Mojolicious
Nettrack
Nibbler
Nikto
Octopus
OnCrawl
Piepmatz
Pimonster
Pixray
Proximic
RankActive
RankingBot2
Re-re
RealDownload
RebelMouse
ScoutJet
Shodan
Spinn3r
Sucker
SuperBot
SuperHTTP
Surfbot
Suzuran
T0PHackTeam
TightTwatBot
Trendiction
Turingos
Turnitin
TwengaBot
Typhoeus
URLy.Warning
VCI
Vacuum
Virusdie
WEBDAV
Web Fuck
WebEnhancer
WebFuck
Website Quester
Webster
Widow
Xaldon_WebSpider
Zauba
ZmEu
ZoomBot
arquivo.pt
clark-crawler
crawl.sogou.com
ips-agent
scan.lol
sogouspider
sysscan
webgains-bot
zauba.io