nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-30 22:05:18 +00:00

100 lines
1.1 KiB
Text

ASPSeek
Abonti
AfD-Verbotsverfahren
Aipbot
AllSubmitter
Anarchy99
Ankit
BDCbot
BLEXBot
BackDoorBot
BackStreet
BacklinkCrawler
Barkrowler
Buck
CheeseBot
ChinaClaw
Claritybot
Collector
Curious
DSearch
DataCha0s
Digincore
Disco
Discobot
Dispatch
DomainSigmaCrawler
Download Wonder
EMail Wolf
EasyDL
Ebingbong
GT::WWW
GetRight
GrapeshotCrawler
HTMLparser
IDBTE4M
InfoNaviRobot
Internet Ninja
InternetSeer
Jbrofuzz
LWP::Simple
Larbin
Likse
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Mail.RU_Bot
Mb2345Browser
Microsoft Data Access
NICErsPRO
Name Intelligence
Net Vampire
NetMechanic
NetZIP
Nutch
OpenLinkProfiler
OutclicksBot
Piepmatz
Pimonster
Pixray
Proximic
Pump
QueryN Metasearch
RankActive
RankFlex
RankingBot
Re-re
Reaper
RedesScrapy
SEOkicks
SlySearch
Sottopop
T8Abot
TeleportPro
Telesphoreo
True_Robot
Turnitin
Typhoeus
WBSearchBot
WWWOFFLE
Web Auto
Web Sucker
WebEnhancer
WebSauger
Website Quester
Whacker
Widow
WinHTTrack
YoudaoBot
backlink-check
cah.io.community
crawler.feedback
dataforseo.com
demandbase-bot
eCatch
mediawords
netEstate NE Crawler
probe-image-size
ripz
voyagerx.com