nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-06-27 22:05:06 +00:00

100 lines
1 KiB
Text

ADmantX
Abonti
Aboundex
AhrefsBot
Anarchy
Ankit
Anthill
BLEXBot
Boardreader
Brandprotect
Buck
Bullseye
Bytespider
CCBot
Cegbfeieh
Claritybot
Cocolyzebot
Cogentbot
Copyscape
Discobot
DomainCrawler
EMail Siphon
EroCrawler
FHscan
Fimap
GalaxyBot
Go!Zilla
GrapeFX
Heritrix
HonoluluBot
Image Sucker
InternetSeer
Iria
IstellaBot
JennyBot
JikeSpider
Jorgee
Keyword Density
Lanshanbot
Likse
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MFC_Tear_Sample
MSIECrawler
Mag-Net
Mediatoolkitbot
MicroMessenger
Mister PiX
Msrabot
NPbot
Nameprotect
NetLyzer
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Offline Explorer
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Pandalytics
Pavuk
Piepmatz
Pixray
PyCurl
RankurBot
Re-re
SEOkicks
SEOstats
SISTRIX
ScanAlert
ScrepyBot
Seekport
Seomoz
Site Sucker
Sitevigil
SputnikBot
SurveyBot
Szukacz
TeleportPro
Twice
V-BOT
WASALive-Bot
WISENutbot
WeSEE
WebEnhancer
WebStripper
Website Quester
Webster
WiseGuys Robot
Wprecon
Zeus
archive.org_bot
crawler4j
dataforseo.com
linkdexbot
ripz
satoristudio.net
zauba.io