nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-14 10:13:37 +00:00

100 lines
1.1 KiB
Text

360Spider
Abonti
Aboundexbot
Acunetix
AhrefsBot
Aspiegel
BBBike
BLEXBot
BackDoorBot
BackStreet
BetaBot
Copyscape
Crawling at Home Project
CrunchBot
Curious
DBLBot
Digincore
Discobot
Dispatch
DnyzBot
DomainAppender
DomainStatsBot
Download Wonder
Ebingbong
Ecxi
EirGrabber
ExtLinksBot
Extractor
Extreme Picture Finder
GT::WWW
Go-Ahead-Got-It
GrabNet
GrapeshotCrawler
HTTrack
Heritrix
HonoluluBot
IDBTE4M
InternetSeer
Iskanie
JOC Web Spider
Kozmosbot
Likse
LinqiaRSSBot
Lmspider
MauiBot
Mb2345Browser
Mojolicious
Mr.4x3
Musobot
NetSpider
Nibbler
OpenVAS
OrangeBot
Pi-Monster
Pixray
ProWebWalker
Probethenet
RankingBot
Rankivabot
Reaper
RebelMouse
RedesScrapy
SBIder
ScoutJet
SemanticJuice
SemrushBot-FT
SemrushBot-OCOB
SeoSiteCheckup
SeobilityBot
Sitevigil
Snake
Snoopy
Sogou web spider
SpaceBison
Spinn3r
Szukacz
T0PHackTeam
TeleportPro
Toweyabot
True_Robot
Vacuum
VidibleScraper
Virusdie
Web Auto
Web Sucker
WebPix
Wprecon
Zermelo
Zitebot
ZmEu
arquivo-web-crawler
crawler4j
dataforseo.com
lwp-trivial
mediawords
serpstatbot
sp_auditbot
ubermetrics-technologies.com
webpros.com
xpymep1.exe