vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 03:29:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.04.3022 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-04-04 10:09:29 +00:00
parent 6cd041d070
commit 0aadbde6a3
47 changed files with 86375 additions and 86385 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3021 #### Version: V4.2022.04.3022
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3021 #### Version: V4.2022.04.3022
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3021 #### Version: V4.2022.04.3022
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10660
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3021 #### Version: V4.2022.04.3022
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10664
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10664
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10664
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10664
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.1.156 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.1.156 0;
127.0.0.1 0; 127.0.0.1 0;

10664
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.1.156 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.1.156 0;
127.0.0.1 0; 127.0.0.1 0;

10664
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.1.156 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.1.156 0;
127.0.0.1 0; 127.0.0.1 0;

10664
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3021 3022

10664
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10664
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.25.19.202 0; 52.176.48.22 0;

10664
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.1.156 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.1.156 0;
127.0.0.1 0; 127.0.0.1 0;

10664
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.1.156 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.1.156 0;
127.0.0.1 0; 127.0.0.1 0;

10664
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.1.156 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.1.156 0;
127.0.0.1 0; 127.0.0.1 0;

10664
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.25.19.202 0; 52.176.48.22 0;

10664
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.25.19.202 0; 52.176.48.22 0;

10664
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.1.156 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Battleztar Bazinga AfD-Verbotsverfahren
Firefox/7.0 BetaBot
Gigabot CrazyWebCrawler
HaosouSpider Jbrofuzz
Heritrix NearSite
Leap Sitevigil
Lightspeedsystems Zauba
Nmap dataforseo.com
backlink-check sysscan
instabid tAkeOut

294
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404enemy 80legs
ADmantX
AIBOT AIBOT
ALittle Client
ASPSeek
Abonti Abonti
Aboundex Aboundex
Aboundexbot
Acunetix Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot Alexibot
AllSubmitter AllSubmitter
Alligator Anarchie
AlphaBot Anarchy
Anarchy99
Aspiegel
Attach Attach
BackDoorBot AwarioRssBot
BackStreet AwarioSmartBot
BackWeb BBBike
Backlink-Ceck BDCbot
Badass Black Hole
Barkrowler BlackWidow
BatchFTP
BetaBot
Bigfoot
BlowFish BlowFish
Boardreader
Bolt Bolt
Brandwatch
Buck Buck
Buddy Buddy
BuiltWith Bullseye
CATExplorador
CODE87
CSHttp
CensysInspect CensysInspect
CheTeam CherryPicker
Chlooe
Cliqzbot Cliqzbot
Cocolyzebot Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Crescent Cosmos
CrunchBot Crawling at Home Project
Curious CyotekWebCopy
DBLBot DBLBot
DIIbot DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Deusu
Discobot DigitalPebble
DittoSpyder Disco
DnyzBot DnyzBot
Dotbot DomainAppender
Dragonfly DomainSigmaCrawler
EasyDL DomainStatsBot
ECCP/1.0
EirGrabber EirGrabber
Exabot
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE
FDM FDM
Fimap Fuzz
Firefox/7.0 FyberSpider
Fyrebot G-i-g-a-b-o-t
GT::WWW GermCrawler
GalaxyBot GetRight
Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
GrabNet GrabNet
Grabber Grafula
GrapeFX GrapeshotCrawler
GridBot HEADMasterSEO
HMView HTMLparser
HTTrack HTTP::Lite
Haansoft
Harvest
Havij Havij
Hloader Hloader
IDBTE4M HonoluluBot
Humanlinks
HybridBot
IDBot
IRLbot IRLbot
Id-search Iblog
Indy Library Image Sucker
IndeedBot
InfoTekies InfoTekies
Intelliseek Intelliseek
Internet Ninja InterGET
JOC Web Spider Iria
Iskanie
IstellaBot
JamesBOT JamesBOT
Jbrofuzz
JennyBot
JetCar JetCar
Jorgee
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Kinza Kinza
Kozmosbot
LWP::Simple LWP::Simple
Lanshanbot
LeechFTP LeechFTP
Lftp LexiBot
LinkScan LibWeb
Lightspeedsystems
LinkWalker LinkWalker
Linkbot
Linkdexbot
LinkextractorPro LinkextractorPro
LinkpadBot LinqiaRSSBot
LinqiaMetadataDownloaderBot LinqiaScrapeBot
Lipperhey Spider Ltx71
Lmspider MFC_Tear_Sample
MJ12bot MIDown tool
MSIECrawler MQQBrowser
Magnet MTRobot
Mag-Net
Mail.RU_Bot
Majestic-SEO Majestic-SEO
MauiBot Majestic12
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri Metauri
MicroMessenger MicroMessenger
Microsoft Data Access
Mister PiX Mister PiX
Moblie Safari Moblie Safari
Morfeus Fucking Scanner Mojeek
NICErsPRO Mojolicious
MolokaiBot
Mozlila
Mr.4x3
Name Intelligence
Nameprotect Nameprotect
Navroad Navroad
NearSite Needle
NetLyzer Nessus
Netvibes Net Vampire
NetZIP
NextGenSearchBot
Nibbler Nibbler
Nikto Niki-bot
NimbleCrawler Nmap
Not Not
Nuclei
Octopus Octopus
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OpenLinkProfiler OnCrawl
Openfind
OrangeBot OrangeBot
OutfoxBot OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
PageAnalyzer Page Analyzer
PageGrabber Papa Foto
Pavuk
PeoplePal
Petalbot Petalbot
Picsearch Pi-Monster
PictureFinder
Pimonster Pimonster
Pixray Pixray
PleaseCrawl
Pockey Pockey
ProPowerBot ProPowerBot
Psbot Psbot
Pump RankingBot
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
Rankivabot Rankivabot
RealDownload SBIder
Recorder
SEOkicks SEOkicks
SEOprofiler
SEOstats
SISTRIX SISTRIX
SalesIntelligent SalesIntelligent
ScreenerBot ScanAlert
ScrepyBot Scanbot
Screaming
Searchestate
Seekport Seekport
SemanticJuice
SemrushBot
SentiBot SentiBot
SeobilityBot SeoSiteCheckup
Seomoz
SiteLockSpider SiteLockSpider
Sitebeam SiteSucker
Snake Siteimprove
Sociscraper Sitevigil
SpaceBison Snapbot
Sogou web spider
Spammen Spammen
SpankBot
Spanner
Spbot Spbot
Spinn3r SputnikBot
Sqlmap Sqworm
Sucuri Steeler
Stripper
SuperHTTP
SurveyBot SurveyBot
Suzuran T8Abot
Swiftbot
TeleportPro
Telesoft Telesoft
Telesphorep The Intraformant
Thumbor Titan
Toweyabot
Trendictionbot
True_Robot True_Robot
Turnitin Turnitin
Typhoeus
URLy.Warning
Upflow
VCI VCI
VelenPublicWebCrawler Voil
VidibleScraper Voltron
WASALive-Bot WASALive-Bot
WEBDAV
WISENutbot
WWW-Mechanize WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE
Wallpapers Wallpapers
WallpapersHD Wallpapers/3.0
Web Fetch Web Enhancer
Web Sauger Web Pix
WebAuto WebAuto
WebBandit WebCollage
WebFetch WebFetch
WebFuck WebFuck
WebImageCollector WebGo IS
WebSauger WebLeacher
WebSucker WebReaper
WebWhacker WebStripper
Webalta
Webshag
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster Webster
Whack
Whacker Whacker
Who.is Bot WinHTTrack
Widow
WiseGuys Robot WiseGuys Robot
Wonderbot
Woobot Woobot
Xaldon WebSpider
Xaldon_WebSpider
Xenu Xenu
YoudaoBot Zauba
Zeus Zeus
ZoominfoBot ZoominfoBot
ZumBot ZumBot
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider
backlink-check
check1.exe check1.exe
clark-crawler clark-crawler
coccocbot
cognitiveseo cognitiveseo
crawl.sogou.com crawl.sogou.com
crawler4j crawler.feedback
dataforseo.com dataforseo.com
domainsproject.org evc-batch
heritrix gopher
instabid
ips-agent ips-agent
lwp-request iubenda-radar
meanpathbot lwp-trivial
netEstate NE Crawler
pcBrowser pcBrowser
plumanalytics
probe-image-size probe-image-size
s1z.ru scalaj-http
satoristudio.net scan.lol
seobility seobility
serpstatbot seocompany.store
sitechecker.pro sitechecker.pro
siteripz sogouspider
tAkeOut
trendiction.com trendiction.com
webmeup-crawler ubermetrics-technologies.com
voyagerx.com
webpros.com
x22Mozilla x22Mozilla
xpymep1.exe xpymep1.exe
zgrab

322
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy ADmantX
80legs
AIBOT
ALittle Client
ASPSeek ASPSeek
AhrefsBot Abonti
Aboundexbot
AfD-Verbotsverfahren
AiHitBot AiHitBot
Aipbot Aipbot
Alexibot Alexibot
Alligator
Anarchie Anarchie
Anarchy Ankit
Anthill Atomseobot
Asterias
Attach Attach
BDFetch AwarioRssBot
BLEXBot BackDoorBot
BackStreet BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Battleztar Bazinga Barkrowler
BetaBot BatchFTP
Black Hole Bigfoot
BotALot Bitacle
Buck BlackWidow
BuiltBotTough Blackboard
Blow
Boardreader
Bullseye
BunnySlippers BunnySlippers
BuzzSumo CSHttp
CCBot Cegbfeieh
CODE87
CheTeam
CheeseBot CheeseBot
Chlooe CherryPicker
Claritybot Claritybot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Collector Cogentbot
Copier
Crawling at Home Project Crawling at Home Project
Crescent Custo
DIIbot CyotekWebCopy
DatabaseDriverMysqli DBLBot
Devil DSearch
Digincore DTS Agent
Demon
DigitalPebble
Dirbuster Dirbuster
Disco
Discobot
Discoverybot Discoverybot
Dispatch DnBCrawler-Analytics
DomainAppender DnyzBot
Domains Project DomainCrawler
DomainStatsBot
Dotbot Dotbot
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Wolf
EasyDL EirGrabber
Ecxi Evil
Express WebPictures
Extractor
ExtractorPro ExtractorPro
EyeNetIE Extreme Picture Finder
Ezooms FDM
FHscan Fuzz
Firefox/7.0 Genieo
Flunky GermCrawler
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GalaxyBot
GetWeb
Getintent
Gigabot
GoZilla GoZilla
Gotit
GrabNet GrabNet
GrapeshotCrawler GrapeFX
GridBot
HMView HMView
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
HTTrack Harvest
Haansoft Id-search
HaosouSpider
Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBot
IlseBot IlseBot
InfoTekies Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek Intelliseek
IstellaBot
JamesBOT JamesBOT
Jbrofuzz
JennyBot JennyBot
JetCar JetCar
Jetty Jorgee
Kenjin Spider Jyxobot
Keybot Translation-Search-Machine Keyword Density
Kinza Kinza
LNSpiderguy Kozmosbot
Lanshanbot LeechFTP
LexiBot LeechGet
Lftp Lftp
LibWeb
LieBaoFast LieBaoFast
LinkScan LinkWalker
Linkbot Linkbot
Linkdexbot Linkdexbot
LinksManager LinkpadBot
Lipperhey LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MJ12bot
MIIxpc
MSFrontPage MSFrontPage
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot Mail.RU_Bot
MarkMonitor MarkMonitor
Mata Hari MauiBot
MeanPath Bot MeanPath Bot
Mediatoolkitbot Meanpathbot
Metauri MegaIndex.ru
Minefield MicroMessenger
MolokaiBot Microsoft Data Access
NICErsPRO Microsoft URL Control
NPbot Mister PiX
Morfeus Fucking Scanner
Mozlila
Musobot
Name Intelligence Name Intelligence
Needle
Net Vampire Net Vampire
NetLyzer
NetMechanic
NetSpider NetSpider
NetZIP
Netcraft Netcraft
Nettrack Nettrack
NextGenSearchBot NextGenSearchBot
Nibbler Nikto
Niki-bot NimbleCrawler
Nimbostratus Ninja
Nmap Nmap
Not OnCrawl
Nutch Openfind
Offline Explorer Openvas
Offline Navigator PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Panscient Panscient
Pavuk Petalbot
Piepmatz Pi-Monster
Pimonster PictureFinder
PleaseCrawl Pockey
ProWebWalker ProPowerBot
Probethenet Probethenet
Psbot
PyCurl PyCurl
QueryN Metasearch Quick-Crawler
RankActive RSSingBot
RankActiveLinkBot
RankFlex RankFlex
Re-re RankingBot2
ReGet Reaper
RebelMouse RebelMouse
Rogerbot Recorder
SEOkicks RedesScrapy
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SISTRIX
SMTBot SMTBot
Screaming Scanbot
Scrapy
ScreenerBot ScreenerBot
Searchestate ScrepyBot
SemanticJuice
Semrush Semrush
SeoSiteCheckup SemrushBot
SiteCheckerBotCrawler Seomoz
SiteExplorer Sitebeam
SiteSucker
Siteimprove Siteimprove
SlySearch Snoopy
SmartDownload SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider Sogou web spider
Sottopop Sosospider
SpaceBison
Spammen
SpankBot
Spbot Spbot
Spinn3r Spinn3r
SputnikBot
Sqlmap
Sqlworm Sqlworm
Stripper Suzuran
Sucuri
SuperBot
SurveyBot
Szukacz Szukacz
T0PHackTeam
T8Abot T8Abot
Thumbor Telesoft
Titan Telesphorep
Toata Toata
Tracemyfile Tracemyfile
Trendictionbot Trendictionbot
True_Robot Turingos
Twice TurnitinBot
TwengaBot
Typhoeus
Upflow
VB Project VB Project
Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VeriCiteCrawler
VoidEYE
Voil Voil
WBSearchBot WBSearchBot
WEBDAV WPScan
WISENutbot WWW-Collector-E
WWWOFFLE WWW-Mechanize
Wallpapers WallpapersHD
Web Auto Web Auto
Web Collage Web Enhancer
Web Pix Web Pix
Web Sauger Web Sauger
WebAuto Web Sucker
WebCollage WebCopier
WebPix WebEnhancer
WebSauger Webalta
Website Quester Website Quester
Webster WebsiteExtractor
Whack
Whacker Whacker
Whatweb
Who.is Bot Who.is Bot
Widow WiseGuys Robot
Wonderbot
Woobot
Wotbox Wotbox
Xaldon_WebSpider Xaldon WebSpider
Xenu Zade
Zeus Zeus
Zitebot ZmEu
ZoomBot ZumBot
ZyBorg
adscanner adscanner
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
backlink-check backlink-check
check1.exe check1.exe
crawl.sogou.com cognitiveseo
com.plumanalytics
crawler.feedback crawler.feedback
crawler4j crawler4j
dataforseo.com
demandbase-bot demandbase-bot
gopher domainsproject.org
instabid facebookscraper
iubenda-radar ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot meanpathbot
mediawords
page scorer
plumanalytics
polaris version polaris version
scalaj-http probe-image-size
seocompany.store satoristudio.net
serpstatbot seobility
sexsearcher sogouspider
spyfu
trendiction.de
ubermetrics-technologies.com
voyagerx.com voyagerx.com
x09Mozilla webgains-bot
zgrab webprosbot
x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aaa38852e886ac4af1a3cff9b47cab6272.com animebox.com.ua
cejewelry.xyz bestwrinklecreamnow.com
dnepropetrovsk.mistr-x.org ihc2015.info
ec-file.info insurple.com
galaxyflowers.ru lashstudia.ru
harmonyglen.us mixtapetorrent.com
skyway24.ru naj-filmy24.pl
snjatie-geroinovoy-lomki.ru naval.jislaaik.com
vancleefreplica.pw rating-casino2021.ru
xn--b1ag5cfn.xn--p1ai yatrk.xyz

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0c47f8422d3f.com 007angels.com
101billion.com 101billion.com
7a2rnuey1tw9ar.ru 123cha.com
123locker.com
1j7740kd.website
2drittel.de
4inn.ru
4ureyesonly.com
6hopping.com
7makemoneyonline.com
7search.com 7search.com
aarbur.com 7xc4n.com
83net.jp
a.frcls.fr
abclauncher.com abclauncher.com
absolutelyanalog.com absolute-s.ru
acortarurl.es academia-nsk.org
adimmix.com actices.com
adverster.com adbetclickin.pink
affiliate-fr.com adcash.com
agadelha.com.br adclickservice.com
agapovdg.ru addbin.men
agardomains.com advertisingtag.net
ahrntal.verymes.xyz aihelen.net
aktobe.xkaz.org airmaxshoes-2016.com
akusherok.ru akita.kz
akvamaster.dp.ua amospalla.es
alekseevec.ru anal-acrobats.hol.es
alf-img.com animali.deagostinipassion.it
amazingpic.net apartment.ru
ameblo.jp appsecurityr.com
amigobulls.com arpelsreplica.xyz
anatomiy.com
animalia-life.club
anniemation.com
api.stathat.com
apispringsmartne-a.akamaihd.net
arabsexxxtube.com
arcadeplayhouse.com
arewater.com
arkkivoltti.net
artavenuegardenstudios.com
artefakct.com artefakct.com
artel116.ru arvut.org
atleticpharm.org asrvrep-a.akamaihd.net
autoplate.info atlant-auto.info
autovideobroadcast.com autochoixspinelli.com
avek.ru autoseo-traffic.com
avtointeres.ru autowebmarket.com.ua
avtovolop.ru aviav.eu
azazaporn.com avon-severozapad.ru
azlex.uz avtocredit-legko.ru
babs.com.ua ayanaspa.com
back.dog azartmsl.com
balkanfarma.org baksman.com
balla-boo.se baladur.ru
banksrf.ru basedecor.ru
bannerswap.com belsetirehafi.tk
bayareaaeroclub.org bestdooz.com
best-businessman.ru bestofupload.info
besthomemadepornsites.com bibys.com
bestpriceninja.com big-cash.net
betune.onlinewebshop.net bigcities.org
betwinservice.com biocn.dx.am
big-boards.info blogporn.in
billiard-classic.com.ua bluesalt.co
bio-optomarket.ru
bizcheapjerseyswholesalechina.com
bluesman.nu
bnt-team.com bnt-team.com
boazpower.com bolezniorganov.ru
bochemit.com.ua bradleylive.xyz
bonvillan.com brandedleadgeneration.com
bonzibuddi.com breastaugmentation.co.za
breget74.ru bscodecs.com
bristolhotel.com buckspar.gq
brk-rti.ru bugof.gq
browserprotecter.com buyclomidonlaine.com
businesxxl.com buyhoverboard.com
buttons-for-website.com candlehandmade.com
buynorxx.com capture-room.com
buytizanidineonlinenoprescription.blogspot.com carfax.com.ua
bytimedance.ru cartierlove2u.com
candcstuccoandstone.com cashonads.com
candy-glam-hp.com caulderwoodkennels.com
candycrushshop.com cbozhe.com
cannibalcheerleader.com cheapbarbour.online
cardsharp1.ru chlooe.com
cartierring.xyz ciceros.co
ccjp.eu cienum.fr
celejihad.info citetick.com
ceotrk.com cityadspix.com
cheapjerseysbizwholesale.us click2pawn.com
cheapsergiorossi.online clicksor.net
cheapwebsitehoster.com coccoc.com
choice-credit.ru coderstate.com
christianlouboutinsaleoutletonline.us compliance-alex.xyz
citizenclsdriveri7.pen.io compliance-checker.info
claytransformations.info compliance-ivan.top
clickprotects.com compliance-julianna.top
clicksor.com compliance-margo.top
clknsee.com compliance-nelson.top
co.lumb.co conciergegroup.org
compliance-don.xyz concordexoticrentals.com
comsysnet.com cookielawblog.wordpress.com
contextualyield.com coolgamechannel.com
copypaste.traderzplanet.in
costablue.xyz costablue.xyz
courtshipgift.com counter.bloke.com
crystalslot.com cowlmash.com
craftburg.ru
customerpromos-a.akamaihd.net customerpromos-a.akamaihd.net
d2jsp.org cvety24.by
dcj-nn.ru cyclobenzaprinevstizanidine.blogspot.com
decorazilla.com d0t.ru
danschawbel.com
data1.scopich.com
datsun-do.com
daydream-studio.ru
detmebel.su detmebel.su
dichvuvesinhhanoi.com discountbarbour.online
diegolopezcastan.com
diesel-parts28.ru
divatraffic.com divatraffic.com
dividendo.ru doctissimo.fr
diy-handmade-ideas.com doktoronline.no
djonwatch.ru domashneeruporno.com
documentbase.net domcran.net
doeco.ru dosugrostov.site
domaincdn.xyz dotnetdotcom.org
donvito.unas.cz download-walpaperhd.blogspot.com
dostavka-v-krym.com downloader12.ru
downloadmefiranaratb1972.xpg.com.br drillsaw.ru
dtm-spain.com druzhininevgeniy63.blogspot.com
duplicashapp.com dvd-famille.com
dvr.biz.ua e-avon.ru
e705.net earthmagic.info
easycommerce.cf editors.choice6912650.hulfingtonpost.com
easync.io ekspresihati.info
educatemetv.com
educontest.net
ekosmetyki.net.pl
elektronischezigarettekaufen1.myblog.de
elitedollars.com
embedle.com embedle.com
energy-ua.com empathica.com
energydiet-info.ru encodable.com
englishdictionaryfree.com enskedesquashclub.se
estelight.ru esopini.com
etm-consult.de exci.ru
evidencecleanergold.com extrabot.com
exdocsfiles.com extremez.net
exportshop.us ezigarettekaufen2.mpbloggar.se
expresstoplivo.ru ezigaretteshop2.vefblog.net
f5mtrack.com f5mtrack.com
falcoware.com facebook-mobile.xyz
fbdownloader.com fastfixing.tech
ferretsoft.com favorcosmetics.com
filefilter.weebly.com fighrofacciufreesig.ga
filesdatabase.net filmfanatic.com
filmidivx.com findpics.pw
flashlarevista.com flauntyoursite.com
foodcrafts.website formseo.com
forex21.ru forpostlock.ru
franecki.net forumprofi.de
freelinkbuilding.website.tk foxtechfpv.com
frivgame250.com franklinfire.co
fun2cell.net free-share-buttons.blogspot.com
fungamelands.com free-stock-illustration.com
gambarkatabaru.com free-video-tool.com
garciniaxt.us freenom.link
gazporno.com freeuploader.ml
gcup.ru freewareseek.com
gerhardhealer.com freewlan.info
getprismatic.com frequiry.com
gg.zzyjxs.com freshwallpapers.info
gheus.altervista.org fyxabomiw.ru
glall.ru galaxys6manual.info
golaya.pw gallery.rennlist.com
goo.ne.jp getpopunder.com
goodwinmetals.co gettpromos.com
googlefeud.com gogps.me
gopixdatabase.com golden-praga.ru
goroda-vsego-mira.ru goosefishpost.bid
gourcy.altervista.org
gq-catalog.gq
gratuitbaise.com
greatfind-a.akamaihd.net
greatzip.com greatzip.com
greendream.com.ua gsasearchengineranker.xyz
gsasearchenginerankerdiscount.com guitar-master.org
gsmtlf.ru gungamesz.com
habermetre.com gwagka.com
hackers-crackers.tk hamptonoaks.ca
handicapvansarea.com hanink.biz.ly
hauleddes.com hdimagelib.com
haveinc.xyz hdwalls.xyz
hentai-manga.porn hiwibyh.bugs3.com
hermesreplica.win home.myplaycity.com
hexpilot.com homegardenlova.com
heygidday.biz hoste.octopis.com
hidemyass.com hosting-tracker.com
highspeed5.net hoterika.com
hikesearch.net hothor.se
hmmm.cz hotshoppymac.com
hostsshop.ru houtings.xyz
hoverboard360.nl
hptwaakw.blog.fc2.com
huimin764128.com
hunterboots.online
hustoon.over-blog.com
hyipmanager.in
iboss.com
ideoworld.org ideoworld.org
ie.57883.net ifmo.ru
imguramx.pw igru-xbox.net
imk.com.ua igtools.club
inclk.com imadedinner.net
indo-export.ru images-free.net
iomoio.net iminent.com
isitwp.com impotentik.com
itag.pw infodocsportal.com
itservicesthatworkforyou.com int.search.mywebsearch.com
iweblist.info intervsem.ru
jackwolfskinoutlet.online invitefashion.com
janavibekken.no ipostroika.ru
jav-idol.com isitpaleo.info
jaxcube.info istanbulit.com
jbl-charge.info jav-fetish.site
jerseychinabizwholesale.com jav-way.site
jewelryandfiligree.com jolic2.com
jikoman.info keywordglobal.co.za
jillepille.com keywordsuggests.com
jongose.ninja khafre.us
jovencitas.gratis kinobaks.com
juliadiets.com kiwi237au.tk
jus0wil.pp.ua kliksaya.com
jwcialislrt.com kmgamex.cf
kandidos.com kochanelli.com
kazan.xrus.org konpax.com
kchaxton.com koptims.tiu.ru
keki.info kosmetyki.tm.pl
kemerovo.zrus.org kosova.de
keywords-monitoring-your-success.com kostenlos-sexvideos.com
keywordsuggest.org krasivoe-hd.com
kinky-fetishes.com krasivye-devushki.net
kino-filmi.com krasnodar.zrus.org
konoplisemena.com ktotut.net
koronirealestate.gr lanadelreyfans.us
lampokrat.ws landmania.ru
lapolis.it landscapebackgrounds.blogspot.com
laxob.com law-check-eight.xyz
layola.biz.tc law-check-two.xyz
le-clos-des-alouettes.com lexaprogeneric.link
lechtaczka.net lexixxx.com
likesdesign.com lida-ru.com
likrot.com
lincolntheatre.com lincolntheatre.com
link.ac linkbuddies.com
liumimgx.pw lion.conboy.us
ljusihus.se littlesexdolls.com
loadopia.com liveinternet.ro
locksmith.jp loftdigital.eu
lomza.info longgreen.info
lordzfilmz.me m4ever.net
lotto6888.com manimpotence.com
louisvuittonoutletstore.net map028.com
lulea-auktionsverk.se markjaybeefractal.com
m292.info matchpal-a.akamaihd.net
m3gadownload.pl mcnamaratech.com
mainlinehobby.net mearns-tractors.co.uk
manifestation.betteroffers.review medicine-4u.org
marcowebonyodziezowe.pl medicines-choice.com
massage-info.nl medictube.ru
matrixalchemy.com meds-online24.com
mature.free-websites.com medtherapy.ru
maximilitary.ru meetlocalchicks.com
mcadamssupplyco.com megaindex.ru
mebel-vstroika.ru middlerush-a.akamaihd.net
mejoresfotos.eu migente.com
member-quiz.com
mensandals.xyz
mexicosleevegastrectomy.com
michaelkorsoutletstore.net
milblueprint.com milblueprint.com
mobicover.com.ua minecraft-rus.org
mobilemedia.md miniature.io
modabutik.ru mirmedinfo.ru
mojpregled.com misswell.net
mlf.hordo.win
mnimmigrantrights.net
mobilierland.com
moesonce.com
monclercheap.xyz
monclercoats.xyz
monetizationking.net
money-every-day.com money-every-day.com
morefastermac.trade moneytop.ru
musezone.su moneyzzz.ru
my-floor.in.ua montazhnic.ru
myanyone.net monthlywinners.com
mydoctorok.ru morf.snn.gr
myftpupload.com morocco-nomad-excursions.com
mygameplus.ru multgo.ru
mysexpics.ru muz-baza.net
nailsimg.com mxgetcode.com
najaden.no my-bc.ru
nalogovyy-kodeks.ru myfreemp3.eu
namecrumilchlet.tk mywallpaper.top
netallergy.ru narkologiya-peterburg.ru
netoil.no nationalbreakdown.com
newtechspb.ru netpics.org
newyorkhotelsmotels.info nevansk.ru
nfljerseys.online niki-mlt.ru
nmrk.ru november-lax.com
nomuos.it
nonameread45.live
nrjmobile.fr
nsatc.net nsatc.net
obiavo.net nuit-artisanale.com
offf.info nw-servis.ru
offtime.ru o-o-8-o-o.com
old-rock.com obiavo.ru
onblastblog.online office-windows.ru
openmultipleurl.com office2web.com
oksrv.com
olgacvetmet.com
omoikiri-japan.ru
onclkads.com
onescreen.cc
online-hit.info
onlineslotmaschine.com
onstrapon.purplesphere.in
oops-cinema.ru
openlibrary.org
opinionreelle.com
orhonit.com
ourtherapy.ru ourtherapy.ru
panchro.co.uk oynat.info
oz-offers.com
ozas.net
pandarastore.top pandarastore.top
parajumpersstore.online parfusale.se
parlament.biz partner-stop.men
partner-pop.men pateaswing.com
partners-ship.pro pavlodar.xkaz.org
pay2me.pl perfection-pleasure.ru
pertlocogasilk.tk petsblogroll.com
photo.houseofgaga.ru picquery.com
photochki.com picswe.com
picurams.pw pills24h.com
piluli.info piluli.info
platinumdeals.gr pinapchik.com
pochemychka.net pistonclasico.com
poems.com.ua pix-hd.com
pony-business.com pladform.ru
popup-fdm.xyz playboyfiles.xblog.in
pobeiranie.pl
popugauka.ru
poquoson.org poquoson.org
porno-chaman.info potoideas.us
porno-dojki.net pozvonim.com
pornoinn.com pp-budpostach.com.ua
pornoreino.com privatamateure.com
pornosmola.info proekt-gaz.ru
pornpost.in promoheads.com
portadd.men prostitutki-kharkova.org
portal-eu.ru puserving.com
pospr.waw.pl quelle.ru
producm.ru quick-seeker.com
promgirldresses.xyz quickbuck.com
proprostatit.com qwarckoine.com
prpops.com raavidesigns.com
purplesphere.in radiodigital.co
quickcashlimited.com ragecash.com
quizzitch.net razvratnoe.org
qwertty.net realizmobi.com
randalljhoward.com realmonte.net
rank-checker.online reklamuss.ru
rczhan.com remorcicomerciale.ro
recordpage-a.akamaihd.net ribieiendom.no
redhotfreebies.co.uk rimedia.org
redirect.trafficreceiver.club ring4rhino.com
redirectingat.com ru-mediaget.ru
reelheroes.net ruf777.com
refudiatethissarah.info runtnc.net
registratciya-v-moskve.ru russia-today-video.ru
reklama1.ru rustic-quiver.win
rep-am.com ryetaw.com
rogervivierforsale.com s-iwantyou.com
royal-betting.net saitevpatorii.com
rozalli.com
rubbed.us
rus-teh.narod.ru
ruscopybook.com
rusexy.xyz
s-forum.biz
sabaapress.com
saecsa.co
sakhboard.ru sakhboard.ru
samo-soznanie.ru sale-japan.com
sayyoethe.blogspot.co.za saletool.ru
sbdl.no sammyweaver.com
scanner-donald.top samolet.fr
scanner-nelson.top santasgift.ml
scanner-olga.top savememoney.co.za
scanner-willy.top savetubevideo.com
scrapinghub.com sbtdesign.co.uk
screpy.com sbwealthsolutions.ca
seccioncontrabajo.com scalerite.co.za
seansonline24.pl
sei80.com sei80.com
sell-fb-group-here.com seo-prof1.xyz
semaltmedia.com seofied.com
seoanalyses.com sethrollins.net
seobility.net sex-znakomstva.online
seofirmreviewsus.info shareyards.com
seozoom.it ship-marvel.co.ua
serving.adbetclickin.pink shivafurnishings.com
signal03.ru shoesonlinebuy.cn
sildenafilcitratemed.com shopsellcardsdumps.com
sim-service.net shymkent.xkaz.org
simon3.ru sibtest.ru
sinestesia.host.sk silverage.ru
siteexpress.co.il siteaero.com
skanninge.se sitevaluation.org
skypasss.com sklad-24.ru
smadihome.com skladvaz.ru
sneakyboy.com snip.to
socialbuttons.xyz sobecjvuwa.com.ru
sockshare.net songoo.wz.cz
sockshares.tv soserfis.com
spacash.com sovetogorod.ru
sport7777.net spy-app.info
stariy-baku.com spymac.net
statustroll.com stardevine.com
studiofmp.com starpages.net
sukarame.net stevemonsen.com
supervesti.ru stroimajor.ru
swagbucks.com superinterstitial.com
swiped.su susanholtphotography.com
tattomedia.com svnuppsalaorebro.se
tattoo33.ru swinger-mobil.net
tabletkinaodchudzanie.com.pl
tampabaywatch.org
tecnoteakviareggio.it tecnoteakviareggio.it
telemetryverification.net testbotprocessor44.com
telesvoboda.ru
template-kid.com
templates.radiodigital.co
tgtclick.com tgtclick.com
thedownloadfromwarez.blogspot.com thenetinfo.com
thegioixekhach.com thewomenlife.com
theguardlan.com thexart.club
thelottosecrets.com thfox.com
thiegs.reco.ws timecrimea.ru
titan-cloud.life tizanidine4mg.blogspot.com
tizanidine4mgstreetvalue.blogspot.com tizanidinedrugtest.blogspot.com
tizanidinehcl4mgtablet.blogspot.com tizanidineinfo.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com tizanidinemusclerelaxant.blogspot.com
tizanidineonline.blogspot.com
tizanidinerestlesslegsyndrome.blogspot.com
tmm-kurs.ru tmm-kurs.ru
tnaionline.org tn811.us
tnctrx.com tnctrx.com
toloka.hurtom.com tomck.com
toonfamilies.net tonivedu.it
top250movies.ru topbestgames.com
topanasex.com topclickguru.com
topsy.com torrent-to-magnet.com
torontoplumbinggroup.com torrentgamer.net
totu.us toy-shop.top
traffic-club.info toys.erolove.in
trainoffend.ml tracxn.com
triumf-realty.ru tradgardspartner.se
trkur.com trafficgenius.xyz
twittruth.com traffictrade.life
txxx.com traffixer.com
tyumen.xrus.org trudogolik.net
umg-stroy.ru tryrating.com
unmaroll.ya.ru uasb.ru
uptimebot.net uginekologa.com
urdoot.win ukrtvory.in.ua
url-extractor.xyz um-razum.ru
urldelivery.com unece.org
uroffer.link ural-buldozer.ru
v-doc.co urlopener.com
valueclick.com venta-prom.ru
vapsy.com video-chat.in
vbabule.net videochat.cafe
vbtracker.net videochaty.ru
viandpet.com vids18.site
videochat.tv.br
virtualbb.com
virus-schutzmasken.de
vitanail.ru vitanail.ru
vodaodessa.com vltai.com
vriel.batcave.net vodkoved.ru
vroze.com voloomoney.com
vseigry.fun vseigry.fun
w3data.co vvon.co.uk
w7s.ru vvpg.ru
wapsite.me wallpapers-best.com
webix.biz wallpapersdesk.info
websiteexplorer.info wallpaperstock.net
weekes.biz.tc walpaperlist.com
whatzmyip.net webalan.ru
where-toget.com webmasters.stackexchange.com
wholesalejerseys-cheapest.com webmonetizer.net
wiosenny-bon-1500.pl webstatsdomain.org
witherrom55.eklablog.fr weburok.com
woman-h.ru whatistizanidinehclusedfor.blogspot.com
wrona.it whatsupinfoley.com
wsgames.ru wholesalejerseychinashop.com
www.bookmaker-bets.com whosonmyserver.com
wzgyyq.com wildcattube.com
x-diesel.biz windowssearch-exp.com
x-mix.info wingsofrefuge.net
x-musics.com winx-play.ru
xbaboon.com wjgony.com
xboxster.ru wladimirpayen.com
xev.ru wovis.site
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai woweb.com.ua
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai writersgroup580.web.fc2.com
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai wurr.voila.net
xn--80aikhbrhr.net www.888.com
xn--e1afanlbnfckd7c3d.xn--p1ai xcc24.pl
xnxx699.com xchat26.myfreecams.com
xnxxandxvideos.com xgames-04.com
yaoguangdj.com xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
yeartwit.com xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
yellocloud.be xsion.net
yoshkarola.zrus.org yebocasino.co.za
yottos.com yellowads.men
ynymnwbm.bloger.index.hr
you-shall-not-pass.is74.ru
youjizz.com
youresponsive.com
yourmovies.pl yourmovies.pl
yourporngay.com yoursearch.me
zacreditom.ru zambini.ru
zakon-ob-obrazovanii.ru zebramart.ru
zarabotat-na-sajte.ru
zarenica.net
zawyna.ua
zdesformula.ru
zetgie.com.pl zetgie.com.pl
zhongwenlink.com zigarettenonlinekaufen1.blox.pl
zionstar.net znakom.sibtest.ru
znakomstva-piter78.ru zojirushi-products.ru
zscaler.net zolotoy-lis.ru
zscalertwo.net
zvetki.ru

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
100dollars-seo.com 123kuma.com
2ads.co.uk 12bet.com
3dracergames.com 18ps.ru
4ureyesonly.com 3weekdiet.com
51.la 4senses.co
7ooo.ru 8558l.jobs.net
8jn.dating-app.ru 9med.net
adservme.com
adultfriendfinder.com adultfriendfinder.com
agadelha.com.br alive-ua.com
akuhni.by alloysteel.ru
algarveglobal.com alvtank.se
alienwheels.de anonymousfox.co
allwidewallpapers.com apispringsmartne-a.akamaihd.net
anmysite.com appmsr.org
apiappenableinfo-a.akamaihd.net arkartex.ru
as5000.com azartclub.org
asseenontv.ru azartniy-bonus.com
atovh.local-finders.com azazu.ru
autorn.ru bablonow.ru
babieca.com babyguns.ru
backgroundpictures.net baixar-musicas-gratis.com
balans.shahterworld.org beauty-clinic.ru
battleforupdating.site bedandbreakfast.com
bazaronline24.ru begalka.xyz
bcmp.org bestcalovebracelet.cn
beachtoday.ru bestkfiledxd.cf
bensbargains.net bestplacetobuyeriacta.jw.lt
bestpriceninja.com bitcoinpile.com
bget.ru bjgugu.net.ua
blobar.org blogqpot.com
blog.remote-computer.de bluesalt.co
blue-square.biz brains2.biz
braip.com.br breget74.ru
brandehk.dk bupropion-sr-150-mg.us
brokergid.ru businescoop.men
browserprotecter.com candiceloves.us
burger-tycoon.com choosecuisine.com
businesn.men cicaki.net
cardsdumps.com clean-virus-mac.com
cartierreplica.win clickpapa.com
cercacamion.it compliance-irvin.top
cerev.info comsysnet.com
cheapwebsitehoster.com conciergegroup.org
clickbank.net construmac.com.mx
cmhomestayagency.com converse.ddsoldes.fr
compliance-checker-7.info coop-gamers.ru
compliance-checker.info countbertwistdisp26.soup.io
compliance-jessica.top cpajunkies.com
cookie-law-enforcement-hh.xyz craftinsta.ru
crystalslot.com crystalslot.com
cscwtalkto.site daptravel.com
customcollegeessays.net dayibiao.com
dairyindia.in dev-seo.blog
daretodonate.co devochki.top
data-mining.tk doctormakarova.ru
detskie-konstruktory.ru
discovertreasurenow.com
doeco.ru
dokumentalkino.net
dolohen.com
domini.cat
domoysshop.ru
downloadme.life
downloadmefiranaratb1972.xpg.com.br downloadmefiranaratb1972.xpg.com.br
drpornogratisx.xxx dverimegapolis.ru
druzhbany.ru e-avon.ru
e-c.al eachdayisagift.review
easyshoppermac.com elektronischezi.livejournal.com
ebooknovel.club elitedollars.com
elvenar.com emediate.eu
enews.tech euronis-free.com
eng-lyrics.com exct.net
enge-fotzen.info exoclick.com
enthuse.computernetworksonline.com exportshop.us
eredijovon.com extlinks.com
erotikchat-24.com fastfixing.tech
f00kclan.de ferrotodo.com
fodelsedagspresenter.nu focalink.com
foodgid.net food.dtu.dk
forexgb.ru forex-indextop20.ru
fortwosmartcar.pw fotosfotos.eu
freshwallpapers.info foxtechfpv.com
gamedayassist.com franecki.net
germes-trans.com frankofficial.ru
girlsatgames.ru free-stock-illustration.com
glogow.pl freenom.link
goatse.ru g7m.pl
google-liar.ru gaz-voshod.ru
generalporn.org
genericviagrasildenafiled.net
getpopunder.com
golden-praga.ru
goodhumor24.com
goroda-vsego-mira.ru goroda-vsego-mira.ru
gorodservis.ru gotorussia.com
gourcy.altervista.org gowreckdiving.com
greatdealshop.com greenshop.su
gunsvicceadadebt.tk hauleddes.com
gwhwpxbw.bloger.index.hr highland-homes.com
habermetre.com homik.pw
hao123.com honyaku.yahoofs.jp
hawaiisurf.com huimin764128.com
hentaiheroes.com ideoworld.org
hoporno.com ilmexico.com
hoste.octopis.com imediadesk.com
hotblog.top inboundlinks.win
i4track.net incep.imagine-ex.co
ibmdatamanagement.co intermesh.net
iklysha.ml javxxx18.com
imitex-plus.ru johannesburgsingles.co.za
in-tandem.co jovencitas.gratis
interior-stickers.ru kazrent.com
internet-apteka.ru krynica.info
iomoio.net kwzf.net
japan-bearings.ru landreferat.ru
jerseywholesalebizchina.com law-check-seven.xyz
jmat.cn
jwcialislrt.com
jwss.cc
kamorel.com
kemerovo.zrus.org
kinogolos.ru
kinomaniatv.pl
kiskinhouse.com
kmd-pto.ru
kountrylife.com
ladov.ru
larchik.net
lasvegaslockandsafe.com
leadn.pl leadn.pl
levaquin750mg.blogspot.com letto.by
lifehacĸer.com lifebyleese.com
lightinghomes.net lion.playtap.us
limads.men locimge.pw
lion.conboy.us lonfon.xyz
locatellicorretor.com.br lostaruban.com
louboutinshoes.xyz
louisvuittonoutletstore.net louisvuittonoutletstore.net
lyrster.com luxmagazine.cf
mail.allnews24.in macnewtech.com
mcnamaratech.com mbiologi.ru
mhi-systems.ru micasainvest.com
mockupui.com mixx.com
morocco-nomad-excursions.com mnogabukaff.net
moxo.com mosrif.ru
mural.co most.gov.iq
mustwineblog.com muycerdas.xxx
mybinaryoptionsrobot.com myplaycity.com
myfreecams.com nakozhe.com
mylesosibirsk.ru natali-forex.com
na15.ru navalwiki.info
narosty.com nextbackgroundcheck.gq
nbsproject.ru nicefloor.co.uk
nikitsyringedrivelg.pen.io o-o-6-o-o.com
nofreezingmac.work offer.camp
normalegal.ru online-hd.pl
nosecret.com.ua pagesense.com
notebook-pro.ru pc-test.net
obiavo.net pdfprof.com
odoratus.net pekori.to
oksrv.com perederni.net
omsk.xrus.org piccshare.com
oneminutesite.it picquery.com
online-sbank.ru pictures-and-images.net
onlyporno.ru picturesify.com
ooomeru.ru piratecams.com
orion-code-access.net pirateday.ru
pateaswing.com pizdeishn.com
pcads.ru plastgranar.nu
phuketscreen.com platesauto.com
plaff-go.ru porndl.org
podshipniki-ntn.ru porno-chaman.info
poptool.net pornosmola.info
pornoforadult.com portnoff.od.ua
privatamateure.com posible.net
profit-opportunity.com produkto.net
prointer.net.ua proposal-engine.com
prostitutki-tolyatti.org prostitutki-tolyatti.org
rada.ru putevka24.ru
rangoman.date ranksays.com
regionshop.biz rczhan.com
rfserial.net realting-moscow.ru
rique.host.sk recipedays.com
rosbalt.com.ua relatodelpresente.com.ar
s.lollypopgaming.com renewablewealth.com
sadaholding.com replica-watch.ru
saneitconsulting.com royal-betting.net
sanidumps.com rubanners.com
saugatuck.com runtnc.net
savetubevideo.com russian-postindex.ru
sbornik-zakonov.ru saitevpatorii.com
screentoolkit.com saletool.ru
searchwebknow-a.akamaihd.net salut-camp.ru
seo-2-0.com sankt-peterburg.nodup.ru
service.adtech.fr scanner-jess.top
sethrollins.net segol.tv
sevendays.com.ua seminarykansas904.ml
sex.hotblog.top serviporno.com
sexad.net sexkvartal.com
sharebutton.to sexvporno.ru
shmetall.com.ua site-speed-check.site
sicfor.bcu.cc siteimprove.com
sientalyric.co siteripz.net
sims-sims.ru sladkoevideo.com
sisi-go.ru slonechka.ru
siteexpress.co.il spywarenuker.com
specialfinanceoffers.com srdrvp.com
sport7777.net staff.prairiesouth.ca
stal-rulon.ru stanthonyscatholicchurch.org
standardchartered-forex.com start.myplaycity.com
stop-gepatit.te.ua stockspmb.info
strana-krasoty.ru strfls.com
superkanpo.com studworks.org
sureone.pro szucs.ru
svarkagid.com taranerymagesswa.blogspot.com
swiped.su tech4master.com
tizanidineformigraines.blogspot.com teguh.info
tnaionline.org telefonsexi.com
todohr.com telegraf.by
track.deriv.com texbaza.by
thaismartloan.com
thruport.com
timecrimea.ru
tizanidineinfo.blogspot.com
tizanidineshowupondrugtest.blogspot.com
tizanidinevscyclobenzaprine.blogspot.com
tizanidinewithdrawal.blogspot.com
tn811.us
torrent-to-magnet.com
torrentred.games
tourismvictoria.com
trafficjunky.net
trafficmonetize.org
traxdom.ru
tri-slona.org tri-slona.org
udayavani.com trustl.life
ukrobstep.com twiclub.in
upstore.me twodollarshows.com
uroki.net uac.net.au
usacasino.com udsgame.online
validdomain.xyz uytmaster.ru
vellings.info vgoloveboli.net
veopornogratis.xxx videogamesecrets.com
vesnatehno.ru videotuber.ru
vitoriacabos.com vilingstore.net
vizag.kharkov.ua vipps.com.my
vkonche.com viteonlusarezzo.it
webpromotion.ae voloslove.ru
webscouter.net vvon.co.uk
websiteexplorer.info watchmygf.net
white-truck.life webcamtalk.net
x-lime.net webshoppermac.com
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai website-audit.com.ua
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf whatzmyip.net
xn--80aikhbrhr.net worldis.me
xn--80ak6aa92e.com wowas31.ucoz.ru
xn--90acenikpebbdd4f6d.xn--p1ai wzgyyq.com
xxlargepop.com x-diesel.com
yes-com.com xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
yoopsie.com xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
yougotanewdomain.com xxxdatinglocal.us
youjizz.com xxxkaz.org
youtubologia.it yopoint.in
youtuhe.com your-bearings.com
zakonobosago.ru ytmnd.com
zeroredirect2.com yun56.co
zhongwenlink.com zakazfutbolki.com
zigarettenonlinekaufen2.drupalgardens.com zapatosenventa.info
zojirushi-products.ru zeroredirect.com
zirondelli.it
zvuker.net

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.1.156 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3021 ### Version: V4.2022.04.3022
### Updated: Sun Apr 3 22:01:30 UTC 2022 ### Updated: Mon Apr 4 10:03:37 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3021 ### Version: V4.2022.04.3022
### Updated: Sun Apr 3 22:01:30 UTC 2022 ### Updated: Mon Apr 4 10:03:37 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##