nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-19 10:07:22 +00:00

100 lines
1 KiB
Text

01h4x.com
Abonti
AhrefsBot
AlphaBot
Anarchie
Anthill
BBBike
BackStreet
Bandit
BatchFTP
Battleztar Bazinga
Bitacle
Brandwatch
Buddy
BuzzSumo
CATExplorador
Citoid
Claritybot
Cloud mapping
Crawling at Home Project
DatabaseDriverMysqli
Digincore
DomainCrawler
Dotbot
Download Wonder
EyeNetIE
Fimap
G-i-g-a-b-o-t
GoZilla
HTTP::Lite
Haansoft
Iskanie
JetCar
Joomla
Jyxobot
Keybot Translation-Search-Machine
Lanshanbot
Leap
LeechFTP
LibWeb
LinqiaRSSBot
Ltx71
MFC_Tear_Sample
MIIxpc
MQQBrowser
Majestic SEO
Majestic12
MarkMonitor
Mb2345Browser
Moblie Safari
Mozlila
Musobot
NICErsPRO
NetLyzer
NetMechanic
Nettrack
NextGenSearchBot
Nutch
Offline Explorer
Openfind
Pavuk
PxBroker
RankFlex
RankingBot
Re-re
ReGet
Recorder
Rogerbot
SEOkicks-Robot
Scanbot
SeekportBot
SenutoBot
SmartDownload
Sosospider
Sottopop
Sqlworm
Sqworm
SuperBot
Toata
Trendictionbot
URLy.Warning
Vacuum
VelenPublicWebCrawler
Voltron
WPScan
WebReaper
WebSauger
WebStripper
Wonderbot
Xenu
Zitebot
dataforseobot
domainsproject.org
muhstik-scan
ripz
seobility
serpstatbot
sp_auditbot
trendiction.com
xpymep1.exe