nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-06 10:07:06 +00:00

100 lines
1.1 KiB
Text

01h4x.com
360Spider
404checker
ALittle Client
Acunetix
AfD-Verbotsverfahren
Ankit
BDFetch
Bolt
BuiltBotTough
BunnySlippers
CSHttp
CensysInspect
Cliqzbot
Craftbot
DBLBot
DataCha0s
DatabaseDriverMysqli
Digincore
DomainCrawler
Domains Project
Dotbot
ExtLinksBot
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Fimap
FlashGet
GetRight
GrapeshotCrawler
HTMLparser
Image Sucker
InfoNaviRobot
InternetSeer
IstellaBot
Jetty
JikeSpider
JustView
Keybot Translation-Search-Machine
Larbin
Leap
LexiBot
LibWeb
LinkextractorPro
MIDown tool
Mr.4x3
Net Vampire
Netcraft
Niki-bot
OpenLinkProfiler
PECL::HTTP
PictureFinder
Pimonster
Pixray
Pockey
QueryN Metasearch
RankFlex
RankingBot
ReGet
RealDownload
RebelMouse
Scanbot
ScreenerBot
Seekport
SiteLockSpider
Snake
Sogou web spider
Spinn3r
Surfbot
Suzuran
Telesphorep
Titan
Toweyabot
TurnitinBot
TwengaBot
URLy.Warning
WEBDAV
Web Collage
Web Enhancer
Web Pix
Web Sucker
WebCollage
WebWhacker
Website Quester
WebsiteExtractor
Xaldon WebSpider
Xaldon_WebSpider
ZoominfoBot
coccocbot
dataforseo.com
muhstik-scan
oBot
polaris version
satoristudio.net
seocompany.store
serpstatbot
sexsearcher
webmeup-crawler
zauba.io