nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-13 22:05:03 +00:00

100 lines
1 KiB
Text

404checker
Aboundexbot
Anthill
Aspiegel
BBBike
Bitacle
Black Hole
Brandprotect
Bullseye
CODE87
Cliqzbot
Cocolyzebot
CopyRightCheck
Copyscape
Curious
DIIbot
DTS Agent
DataCha0s
DnyzBot
DomainStatsBot
Download Wonder
Dragonfly
EMail Wolf
EasyDL
Evil
ExtLinksBot
Extractor
ExtractorPro
FrontPage
FyberSpider
GT::WWW
Genieo
Go!Zilla
GrabNet
HTTP::Lite
HaosouSpider
HonoluluBot
IDBTE4M
IDBot
InfoNaviRobot
Intelliseek
InternetSeer
Iskanie
Jyxobot
Kozmosbot
LeechGet
LibWeb
Lipperhey
MIIxpc
MTRobot
Mass Downloader
Masscan
Mb2345Browser
Msrabot
Name Intelligence
NearSite
NetSpider
Octopus
OpenLinkProfiler
PageThing.com
Pandalytics
Papa Foto
Picscout
ProWebWalker
RankFlex
RealDownload
SBIder
SEOstats
Seekport
Semrush
Seomoz
Snake
Sociscraper
Sqworm
Sucuri
Teleport
Telesphoreo
Telesphorep
TurnitinBot
Twice
Web Fuck
WebCollage
WebEnhancer
WebFuck
WebImageCollector
WebLeacher
WebSucker
Webshag
Website Quester
WebsiteExtractor
com.plumanalytics
eCatch
facebookscraper
linkdexbot
magpie-crawler
scan.lol
seobility
sysscan
tAkeOut
xpymep1.exe