nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-25 10:06:56 +00:00

100 lines
1 KiB
Text

404checker
Alexibot
Alligator
Ankit
Apexoo
BetaBot
BlowFish
Brandprotect
Bullseye
Chlooe
Cliqzbot
Cogentbot
Copier
CrazyWebCrawler
Custo
DBLBot
Dispatch
DittoSpyder
DomainAppender
EMail Siphon
Ezooms
Gigabot
GoZilla
Havij
InterGET
JOC Web Spider
Jbrofuzz
JetCar
JikeSpider
Jorgee
JustView
Kenjin Spider
Kozmosbot
Lanshanbot
LibWeb
Linkbot
LinqiaScrapeBot
Lipperhey
MFC_Tear_Sample
MJ12bot
MSFrontPage
MSIECrawler
Mata Hari
Mediatoolkitbot
MegaIndex.ru
MolokaiBot
Needle
NetAnts
Nibbler
OpenLinkProfiler
OrangeBot
OutfoxBot
Pandalytics
PeoplePal
Pi-Monster
Piepmatz
Pixray
Pockey
ProWebWalker
Probethenet
Pump
RealDownload
Reaper
Recorder
RocketCrawler
Searchestate
Seekport
Semrush
SemrushBot
SenutoBot
SlySearch
Sogou web spider
Spbot
Sqlworm
Sqworm
TinyTestBot
Trendiction
URLy.Warning
Vagabondo
Voil
WEBDAV
Web Fuck
WebImageCollector
Webster
Who.is Bot
WinHTTrack
WiseGuys Robot
Zermelo
Zitebot
ZumBot
archive.org_bot
arquivo.pt
com.plumanalytics
evc-batch
instabid
linkdexbot
muhstik-scan
page scorer
sogouspider
webmeup-crawler