nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-15 10:07:08 +00:00

100 lines
1 KiB
Text

404enemy
Acunetix
Aipbot
Alligator
Ankit
Anthill
Apexoo
Aspiegel
Asterias
AwarioRssBot
Bandit
Black Hole
Boardreader
Brandprotect
Bytespider
Calculon
CensysInspect
CopyRightCheck
Copyscape
Crawling at Home Project
DBLBot
DomainSigmaCrawler
Ecxi
Express WebPictures
FacebookBot
Firefox/7.0
FlashGet
GPTBot
Getintent
Grabber
HTTrack
Haansoft
InfoNaviRobot
InternetSeer
JOC Web Spider
JamesBOT
Jorgee
Jyxobot
Lightspeedsystems
Linkbot
Lmspider
Majestic12
Microsoft URL Control
Mister PiX
Moblie Safari
Musobot
NPbot
NetAnts
Netvibes
NextGenSearchBot
Nikto
Openfind
OutclicksBot
Petalbot
Picsearch
PleaseCrawl
Pockey
ProPowerBot
RankurBot
ReGet
SEOstats
SearchmetricsBot
SenutoBot
SeoCherryBot
Sitebeam
Sitevigil
Sosospider
SpaceBison
Swiftbot
Teleport
Titan
Turingos
UnisterBot
Upflow
Virusdie
Voltron
WASALive-Bot
WPScan
Wallpapers/3.0
WallpapersHD
WeSEE
Web Sauger
WebLeacher
WebSucker
WebWhacker
WebsiteQuester
Wprecon
Zauba
Zermelo
backlink-check
crawler.feedback
crawler4j
demandbase-bot
evc-batch
lwp-request
oBot
page scorer
probe-image-size
ripz
scan.lol