nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-10 10:07:14 +00:00

100 lines
992 B
Text

Acunetix
Alexibot
AlphaBot
Apexoo
AwarioSmartBot
Badass
Barkrowler
Bigfoot
Blow
Bolt
Bullseye
CSHttp
Cogentbot
CrazyWebCrawler
CyotekWebCopy
Discobot
Dispatch
DomainCrawler
Drip
Ebingbong
Ecxi
Evil
ExtractorPro
FHscan
Foobot
GetRight
Gigabot
HTMLparser
Havij
IDBTE4M
InfoTekies
InternetSeer
Iria
Iskanie
Lftp
LinqiaScrapeBot
Lipperhey Spider
MIDown tool
Majestic12
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Mojolicious
Musobot
NICErsPRO
NetSpider
Netcraft
Nikto
NimbleCrawler
OutfoxBot
PHPCrawl
Pavuk
Picsearch
PictureFinder
Pu_iN
Pump
RankFlex
Ripper
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
Screaming
Shodan
Siphon
SiteSucker
Siteimprove
Sociscraper
Sosospider
Sqlworm
Steeler
SuperBot
Toata
Trendiction
WASALive-Bot
WEBDAV
WWWOFFLE
Web Auto
Web Enhancer
WebFetch
WebGo IS
WebSauger
WebZIP
Webalta
Webshag
WebsiteExtractor
WinHTTrack
Wprecon
Zeus
ZyBorg
autoemailspider
cah.io.community
facebookscraper
ips-agent
mediawords
muhstik-scan
s1z.ru
sysscan
webprosbot
x09Mozilla