vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 11:10:47 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.04.3041 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-04-13 10:09:29 +00:00
parent 46d9eb3c65
commit e4f0365daf
47 changed files with 90421 additions and 90411 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3040 #### Version: V4.2022.04.3041
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3040 #### Version: V4.2022.04.3041
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3040 #### Version: V4.2022.04.3041
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11162
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3040 #### Version: V4.2022.04.3041
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11166
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11166
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11166
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11166
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 1; 10.1.0.160 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 0; 10.1.0.160 0;
127.0.0.1 0; 127.0.0.1 0;

11166
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 1; 10.1.0.160 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 0; 10.1.0.160 0;
127.0.0.1 0; 127.0.0.1 0;

11166
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 1; 10.1.0.160 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 0; 10.1.0.160 0;
127.0.0.1 0; 127.0.0.1 0;

11166
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3040 3041

11166
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11166
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.118.237.140 0; 40.77.5.123 0;

11166
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 1; 10.1.0.160 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 0; 10.1.0.160 0;
127.0.0.1 0; 127.0.0.1 0;

11166
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 1; 10.1.0.160 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 0; 10.1.0.160 0;
127.0.0.1 0; 127.0.0.1 0;

11166
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 1; 10.1.0.160 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 0; 10.1.0.160 0;
127.0.0.1 0; 127.0.0.1 0;

11166
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.118.237.140 0; 40.77.5.123 0;

11166
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.118.237.140 0; 40.77.5.123 0;

11166
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 1; 10.1.0.160 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
EasyDL Apexoo
Extreme Picture Finder CheTeam
MarkMonitor ECCP/1.0
Openfind IstellaBot
RankActive Lightspeedsystems
Turingos Majestic12
Web Fuck Navroad
arquivo.pt PHPCrawl
internetVista monitor check1.exe
trendiction.de facebookscraper

312
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker
404enemy
80legs 80legs
AIBOT
ASPSeek
Abonti Abonti
Aboundexbot AhrefsBot
AfD-Verbotsverfahren AiHitBot
Aipbot Aipbot
Anarchie Alligator
Ankit
Apexoo
Aspiegel
Asterias
Atomseobot Atomseobot
Attach
AwarioSmartBot AwarioSmartBot
BDCbot BDCbot
BDFetch BDFetch
BLEXBot
BackDoorBot BackDoorBot
Backlink-Ceck BatchFTP
BacklinkCrawler Bigfoot
BetaBot Blackboard
Bitacle
BlackWidow
Boardreader
Brandprotect Brandprotect
Buck Buddy
BuiltWith BuiltBotTough
BunnySlippers BunnySlippers
CATExplorador
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
ChinaClaw ChinaClaw
Chlooe
Citoid Citoid
Claritybot
Cliqzbot
Copyscape Copyscape
Crawling at Home Project Cosmos
DBLBot Craftbot
CrazyWebCrawler
CyotekWebCopy
DSearch DSearch
DTS Agent DTS Agent
DatabaseDriverMysqli Devil
Demon Discobot
Digincore DomCopBot
DigitalPebble
DittoSpyder
DomainAppender DomainAppender
DomainStatsBot DomainStatsBot
Dotbot Dotbot
EroCrawler Drip
Evil ECCP/1.0
Express WebPictures EMail Wolf
Fimap Ebingbong
Flunky Ecxi
FrontPage EirGrabber
Fuzz Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
Fyrebot
GT::WWW GT::WWW
GetRight GalaxyBot
Gotit GermCrawler
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet GrabNet
Grafula GrapeFX
GrapeshotCrawler GridBot
HEADMasterSEO
HMView HMView
HTTP::Lite HTTrack
HaosouSpider
Havij Havij
Hloader Heritrix
HonoluluBot
Humanlinks
IDBTE4M IDBTE4M
IDBot
IRLbot IRLbot
Id-search Iblog
IlseBot
Image Fetch Image Fetch
Indy Library InterGET
InfoTekies JamesBOT
Iskanie
JetCar JetCar
JikeSpider
Joomla Joomla
Jorgee Jorgee
Keybot Translation-Search-Machine Kinza
Keyword Density Kozmosbot
LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot
Larbin Larbin
Leap LeechFTP
LibWeb LexiBot
LieBaoFast LinkScan
Lightspeedsystems LinkextractorPro
LinksManager LinksManager
LinqiaScrapeBot LinqiaMetadataDownloaderBot
Lmspider LinqiaRSSBot
Litemage_walker
Ltx71
MIDown tool
MJ12bot MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO Majestic12
Mass Downloader
Masscan
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
Mediatoolkitbot Mediatoolkitbot
Metauri Microsoft Data Access
Moblie Safari Minefield
Mojolicious
MolokaiBot MolokaiBot
Mozlila Mozlila
Musobot Msrabot
NICErsPRO
NPbot
Nameprotect Nameprotect
Nessus NearSite
Net Vampire Net Vampire
NetLyzer
NetMechanic NetMechanic
NetSpider Netvibes
NetZIP NextGenSearchBot
NimbleCrawler Nimbostratus
Ninja Ninja
Nmap Nmap
Not Not
Nutch Nuclei
Offline Explorer Offline Explorer
Openvas Offline Navigator
OrangeSpider OrangeBot
OutclicksBot OutclicksBot
OutfoxBot
PECL::HTTP PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber
Pandalytics Pandalytics
Papa Foto Papa Foto
Pavuk
Picsearch Picsearch
Pimonster PictureFinder
PxBroker Pixray
PyCurl ProWebWalker
RSSingBot Probethenet
Psbot
Pu_iN
Quick-Crawler
Re-re
ReGet ReGet
RealDownload RealDownload
Reaper Reaper
RebelMouse
Recorder Recorder
RepoMonkey
RocketCrawler RocketCrawler
Rogerbot
SBIder SBIder
SEOkicks-Robot SEOstats
SEOlyticsCrawler SISTRIX
SEOprofiler ScanAlert
SMTBot
SalesIntelligent
Scanbot Scanbot
ScreenerBot ScoutJet
Scrapy
Searchestate
SearchmetricsBot SearchmetricsBot
Seekport
SemanticJuice
SemrushBot SemrushBot
SentiBot
SeoSiteCheckup SeoSiteCheckup
Seomoz SeobilityBot
Shodan Shodan
SiteCheckerBotCrawler Site Sucker
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
Sitebeam SiteSucker
SmartDownload SlySearch
Snake Snake
Sogou web spider Snapbot
SocialRankIOBot
Sosospider Sosospider
SpankBot SpaceBison
Spbot Spammen
Steeler Spanner
Stripper Spinn3r
SputnikBot
Sqlworm
Sucuri Sucuri
SuperBot
SuperHTTP
Surfbot Surfbot
Suzuran T0PHackTeam
Swiftbot
Szukacz
T8Abot
Teleport
TeleportPro TeleportPro
The Intraformant The Intraformant
TheNomad TheNomad
True_Robot TightTwatBot
TurnitinBot Titan
TwengaBot Toata
Typhoeus Trendiction
Trendictionbot
Turingos
Turnitin
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow Upflow
VB Project VoidEYE
VidibleScraper Voil
Virusdie
WASALive-Bot WASALive-Bot
WISENutbot WPScan
WWWOFFLE Wallpapers/3.0
WallpapersHD
WeSEE
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebAuto
WebCollage
WebFetch
Web Fuck Web Fuck
WebLeacher
Web Pix Web Pix
Web Sauger Web Sauger
WebBandit
WebCollage
WebFetch
WebGo IS
WebLeacher
WebPix
WebStripper WebStripper
WebSucker WebWhacker
WebZIP WebZIP
WebmasterWorldForumBot Wprecon
Webster Xaldon WebSpider
Whack
WiseGuys Robot
Xenu Xenu
Zade Zauba
ZoominfoBot ZoominfoBot
ZyBorg
adscanner
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo.pt
autoemailspider autoemailspider
check1.exe check1.exe
clark-crawler
coccocbot
com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot demandbase-bot
domainsproject.org evc-batch
facebookscraper facebookscraper
gopher heritrix
internetVista monitor instabid
ips-agent ips-agent
linkdexbot isitwp.com
lwp-request lwp-request
lwp-trivial
magpie-crawler magpie-crawler
muhstik-scan meanpathbot
netEstate NE Crawler plumanalytics
oBot
polaris version
ripz
s1z.ru
satoristudio.net
scan.lol scan.lol
seobility seobility
seocompany.store
seoscanners
seostar
serpstatbot serpstatbot
sysscan siteripz
webgains-bot spyfu
ubermetrics-technologies.com
webmeup-crawler
x22Mozilla x22Mozilla
xpymep1.exe
zauba.io zauba.io

326
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
360Spider
404enemy 404enemy
ASPSeek Aboundex
Aboundexbot Aboundexbot
Acunetix AfD-Verbotsverfahren
AhrefsBot AiHitBot
Alexibot Aipbot
Alligator AllSubmitter
AlphaBot
Anarchie
Anarchy Anarchy
Apexoo
Aspiegel Aspiegel
Atomseobot
Attach Attach
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BackStreet BackStreet
BackWeb Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Badass Barkrowler
Bitacle BatchFTP
Battleztar Bazinga
BetaBot
Black Hole Black Hole
Blackboard Boardreader
Blow Bolt
Brandprotect Buck
Brandwatch
Buddy
Bullseye Bullseye
BunnySlippers BuzzSumo
CATExplorador CSHttp
CODE87
Calculon
CazoodleBot CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect
CheTeam CheTeam
CheeseBot CheeseBot
Cliqzbot CherryPicker
Collector ChinaClaw
Copier Cocolyzebot
Copyscape
Cosmos Cosmos
Craftbot Craftbot
Crawling at Home Project CrunchBot
Custo Custo
CyotekWebCopy
DBLBot DBLBot
DIIbot
DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Digincore
DigitalPebble DigitalPebble
Discoverybot DnyzBot
DomCopBot DomCopBot
DomainCrawler DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project EMail Siphon
Dotbot Ebingbong
Drip
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot Exabot
Ezooms
FHscan FHscan
Fimap
Firefox/7.0
Flunky
Freeuploader Freeuploader
FrontPage Fuzz
FyberSpider
Fyrebot
GalaxyBot GalaxyBot
Getintent GermCrawler
GetWeb
Go-Ahead-Got-It
GoZilla GoZilla
Gotit Gotit
GrabNet
Grabber
Grafula Grafula
GrapeshotCrawler HEADMasterSEO
HMView
HTMLparser HTMLparser
Haansoft
HaosouSpider
Hloader
Humanlinks Humanlinks
IDBot
IRLbot IRLbot
Iblog Image Fetch
IndeedBot Image Sucker
Indy Library
Intelliseek Intelliseek
Internet Ninja
InternetSeer
Iria
Iskanie Iskanie
JamesBOT Jbrofuzz
JetCar JikeSpider
Jetty Joomla
Jorgee
Jyxobot Jyxobot
Keybot Translation-Search-Machine Keyword Density
Kinza Lanshanbot
Kozmosbot LeechFTP
LNSpiderguy LeechGet
Larbin Libwhisker
Leap Likse
LexiBot
Lftp
LieBaoFast
LinkScan LinkScan
LinkWalker
Linkbot Linkbot
LinkextractorPro LinksManager
LinkpadBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71 Ltx71
MFC_Tear_Sample MIIxpc
Mag-Net MSIECrawler
Magnet Majestic-SEO
Mail.RU_Bot Mass Downloader
MarkMonitor Mata Hari
Masscan MauiBot
Mb2345Browser Mb2345Browser
Meanpathbot MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
Metauri
MicroMessenger MicroMessenger
Microsoft URL Control Microsoft Data Access
Moblie Safari
Mojeek
MolokaiBot MolokaiBot
Mozlila Mr.4x3
NICErsPRO
NPbot
Name Intelligence
Nameprotect Nameprotect
Navroad Navroad
NearSite NetLyzer
Nessus NetMechanic
Net Vampire
NetSpider NetSpider
Netvibes NextGenSearchBot
Nibbler Niki-bot
NimbleCrawler Nuclei
Nimbostratus OnCrawl
Ninja
Not
Nutch
Offline Explorer
OpenLinkProfiler OpenLinkProfiler
Openfind OpenVAS
Openvas
OrangeBot
OrangeSpider OrangeSpider
PECL::HTTP
PageAnalyzer PageAnalyzer
PageScorer PageGrabber
PageThing.com
Pandalytics Pandalytics
Panscient Papa Foto
Pavuk
PeoplePal
Petalbot Petalbot
Picscout
Pimonster
PleaseCrawl PleaseCrawl
PyCurl Pockey
Probethenet
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2 RankingBot2
Rankivabot
ReGet
RealDownload RealDownload
Reaper Ripper
RocketCrawler RocketCrawler
SEOlyticsCrawler SBIder
SEOstats SEOprofiler
SISTRIX
SalesIntelligent
ScanAlert
Scanbot Scanbot
ScoutJet ScoutJet
Searchestate Searchestate
SearchmetricsBot
Seekport Seekport
SemanticJuice SemanticJuice
Semrush SemrushBot
SentiBot SeoSiteCheckup
Seomoz
Shodan
Siphon Siphon
Site Sucker
SiteExplorer SiteExplorer
SiteSucker SiteLockSpider
Siteimprove SiteSnagger
SlySearch Sitebeam
Sociscraper
Sosospider
SpaceBison
Spammen
SpankBot SpankBot
Spbot Spbot
Spinn3r Spinn3r
Sqlworm SputnikBot
Steeler Sqlmap
Sucker Stripper
SuperHTTP Sucuri
SuperBot
Swiftbot Swiftbot
Szukacz Szukacz
T0PHackTeam T0PHackTeam
Telesoft TeleportPro
Telesphoreo Telesphoreo
Telesphorep The Intraformant
TurnitinBot TheNomad
Typhoeus TightTwatBot
URLy Warning Trendiction
VCI Trendictionbot
Vagabondo Turingos
VelenPublicWebCrawler Turnitin
VeriCiteCrawler TwengaBot
VidibleScraper UnisterBot
Virusdie
VoidEYE VoidEYE
Voil WASALive-Bot
Voltron WWWOFFLE
Wallpapers Wallpapers/3.0
Web Fuck Web Collage
Web Sucker
WebEnhancer
Web Fetch Web Fetch
WebGo IS Web Sauger
WebAuto
WebBandit
WebCollage
WebFetch
WebFuck
WebImageCollector WebImageCollector
WebSucker WebLeacher
WebWhacker WebPix
WebmasterWorldForumBot WebReaper
Webshag WebSauger
WebsiteExtractor WebsiteExtractor
WebsiteQuester
Webster Webster
Whacker Whacker
Whatweb Widow
Who.is Bot Wprecon
Wonderbot
Xaldon WebSpider Xaldon WebSpider
Xenu
Zade
Zauba Zauba
Zeus Zermelo
ZoomBot Zitebot
ZmEu
ZoominfoBot
ZumBot
adscanner adscanner
arquivo.pt archive.org_bot
cah.io.community autoemailspider
coccocbot coccocbot
cognitiveseo crawler4j
crawler.feedback dataforseo.com
demandbase-bot eCatch
domainsproject.org
evc-batch evc-batch
facebookscraper
gopher
heritrix
instabid
ips-agent
isitwp.com isitwp.com
iubenda-radar
linkdexbot
lwp-request
mediawords mediawords
muhstik-scan
netEstate NE Crawler
oBot
page scorer page scorer
probe-image-size pcBrowser
s1z.ru plumanalytics
seocompany.store ripz
satoristudio.net
seostar seostar
sexsearcher sitechecker.pro
sp_auditbot webgains-bot
tAkeOut webmeup-crawler
trendiction.com
webpros.com
webprosbot webprosbot
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
adventureparkcostarica.com automobile-spec.com
beauty-bracelet.com comeondog.info
binaryoptionscops.info googst2.ru
camel-beach.com hledejvshopech.cz
izismile.com longgreen.info
kinohit1.ru printdirectforless.com
mhi-systems.ru raschtextil.com.ua
myhitmp3.club spacash.com
news-readers.ru vitalads.net
tubeoffline.com ws.ampower.me

954
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00go.com 01apple.com
08800.top 1001watch.com.ua
0lovespells0.blogspot.com 14b.info
1008.su 1bet.com
11235813.webzdarma.cz 2girls1cup-free.com
123movies.love 4istoshop.com
5tey7463.weebly.com 7search.com
883zy.com 8gold.com
8lufu.com 98oi.ru
a14download.com 991mostfm.co.id
activepr.ru aab94f698f36684c5a852a2ef272e031bb.com
adclickthru.net abctoppictures.net
adelly.bg absolute-s.ru
adinterax.com abwa.tk
adloads.net accessoires-mode.in
adnotbad.com acheterviagrafr24.com
adultactioncam.com actionnooz.com
advancedmassagebysara.com adf.ly
advokat-grodno.by adimmix.com
albumsuper.info admitad.com
alert-hgd.xyz adserver-e7.com
alice.it adult3dgames.com
allbizne.co.ua adzpower.com
allforminecraft.ru alfapro.ru
allnews.md all4invest.info
allwidewallpapers.com allesohnegirls.net
aloofly.com allnews24.in
amoi.tn alloysteel.ru
animebox.com.ua analnoeporno.tv
anonymizeme.pro anapa-inns.ru
apibatbrowsecom-a.akamaihd.net anniemation.com
apidigidocketnet-a.akamaihd.net apioasisspacenet-a.akamaihd.net
apiwoodensealcom-a.akamaihd.net arkkivoltti.net
appearance-cool.com artdeko.info
appfastplay.com artefakct.com
appfixing.space arvut.org
appsecurityr.com
aramaicmedia.org
ardimobileinfo.ml
artparquet.ru
artpicso.com
as5000.com as5000.com
asociatia-tipografilor-transilvania.ro asrvrep-a.akamaihd.net
auto4style.ru atley.eu.pn
ausergrubhof.info
automatic-seo.com automatic-seo.com
aviav.ru.com automobile-spec.com
avkzarabotok.info avon-severozapad.ru
azte.ch azartmsl.com
bablonow.ru b2b-lounge.com
baikaleminer.com babosas.com
baladur.ru bankofthewext.com
baltgem.com beachfix.co
barbourjackets.online beclean-nn.ru
barnfurnituremart.com best-deals-products.com
beachtoday.ru bestofupload.info
benchmarkcommunications.co.uk bezlimitko.xyz
bestbrainprod.win bget.ru
bestfortraders.com bikini-image.com
besthomemadepornsites.com bkns.vn
besthoro.ru blackle.com
bestplacetobuyeriacta.jw.lt blacktwhite.com
bestprofits-there.com blagovest-med.ru
bestssaker.com bmsco.co
bharatdefencekavach.com boazpower.com
bif-ru.info bobba.dzaba.com
bigcareer.info bolitgorlo.net
bloggers.nl bonvillan.com
blogs.rediff.com book-bets.com
bnt-team.com braindaily.xyz
bolezniorganov.ru brandedleadgeneration.com
brewdom.ru break-the-chains.com
brg8.com bristolhotel.com
bscodecs.com btnativenav.com
btc4u.ru buron.pw
buchananshardware.com bus-offer.com
buigas.00it.com business-suggested.tk
bumascloset.com buybest1.biz
business-made-fun.com buypillsorderonline.com
buy-cheap-online.info c1.onedmp.com
callcafe.info californianews.cf
capsderfudd.tk callstevens.com
cardsharp1.ru cand.jp
cartierlove.xyz candycrushshop.com
cartierlove2u.xyz candytiner.com
cartierring.xyz carfax.com.ua
cartujano-pre.de cartierreplica.xyz
centre-indigo.org.ua cbb1smartlist12.click
chcu.net cellfun.mobi
cheapjerseysa.com certifywebsite.win
cheapjerseysap.com cfcl.co.uk
cheapjerseysfootballshop.com chatroulette.online
cheatcode-lita12.rhcloud.com cheapmoncler.win
ciceros.co chinaelitecheapjerseys.com
cityadspix.com chocolateslim-original.com
cjs.com.ru cjmc.info
clean-start.net clean-start.net
cleanmypc.com
clickbanksites.info
clippingphotoindia.com
clknsee.com
clmforexeu.com
cmhomestayagency.com
coderstate.com
coldfilm.ru coldfilm.ru
comissionka.net colehaanoutlet.store
compliance-jess.top community.allhiphop.com
compliance-mary.top compliance-jack.top
confib.ifmo.ru conocer-sanabria.com
construmac.com.mx cool-wedding.net
contextualyield.com coprofam.org
coolbar.pro
copypaste.traderzplanet.in
copyrightclaims.org copyrightclaims.org
counterbot.com counciltally.com
covadhosting.biz crafthubs.com
cpabegins.ru crazyprotocol.com
cv.wallhade.co cutalltheshit.com
dailystrength.org cyclobenzaprinevstizanidine.blogspot.com
damasarenai.info dalavia.ru
daneshetabiat.com dangphoto.trade
darodar.com daooda.com
davidovic.info dealitright.click
dawlenie.com demon-tweeks.com
daymusam.com dentfidemountpreach.tk
deutschland123.de derevesendeco.com
digital-sale.su detective01.ru
dimkino.ru deutschehobbyhuren.net
discountliv.com dgfitness.co
dms-sw.ru dimaka.info
dnepr-avtospar.com.ua dirtpics.pw
donvito.unas.cz dispo.de
dotmass.top diy-handmade-ideas.com
dpihatinh.gov.vn doctissimo.fr
drivotracker.com dogsrun.net
eachdayisagift.review dokumentalkino.net
eaplay.ru drugspowerstore.com
easycommerce.cf dverimegapolis.ru
easyshoppermac.com dvrlists.com
ednorxmed.com ecxtracking.com
edudocs.net ekosmetyki.net.pl
eldiariodeguadalajara.com
electro-prom.com
elektrischezigarette1.blog.pl
elektronischezigarette2.mex.tl
elektrozigarettekaufen2.blogse.nl elektrozigarettekaufen2.blogse.nl
elidelcream.weebly.com empirepoker.com
enpolis.ru eng-lyrics.com
eonpal.com engines-usa.com
essay-edu.biz erotische-geschichten-xxl.com
essayservicewriting.org escortslet.net
etur.ru eugenevaultstorage.com
evidencecleanergold.com evehemming.blogspot.com.au
evogarage.com everypony.ru
executehosting.com exmasters.com
ezb.elvenmachine.com expolicenciaslatam.co
f5mtrack.com ezigarettenkaufen1.pagina.gr
facecup.top factorynightclub.com
faracontrol.ir faithe.top
fastcrawl.com favorcosmetics.com
femmesdenudees.com favornews.com
financepoints.eu faz99.com
find1friend.com fickkontaktehobbyhuren.com
findpik.com film-one.ru
findsexguide.com finstroy.net
fireads.men fitnesspiks.com
free-social-buttons.xyz flowwwers.com
free411games.com foodcrafts.website
freshsuperbloop.com forex.osobye.ru
fuckbuddybestgilf.info forexgb.ru
fullgirl.ru forms-mtm.ru
fun2cell.net formulaf1results.blogspot.com
gallerily.com fortwosmartcar.pw
gamebackyard.com forums.toucharcade.com
getaclueamerica.com forzeronly.com
getlamborghini.ga frankofficial.ru
getmyads24.com free-floating-buttons.com
getoutofdebtfree.org freemags.cc
ggiaro.com freenom.link
globalsurfari.com freesitetest.com
gnuetella.com freetangodownload.com
go2jump.org fuck-paid-share-buttons.xyz
goldandcard.ru fuel-gas.com
golfresa.lucania.se fungamelands.com
gonextmedia.com g33.org
goodprotein.ru game-top.su
gosreg.amchs.ru gameplexcity.com
gotorussia.com gameprimary.com
gratuitbaise.com gate5.co.za
greatzip.com gaypornmovie.net
greenzaim.ru gdzkurokam.ru
gilbertbanda.net
girlgamerdaily.com
glavtral.ru
globetrotting-culture.ru
gopixdatabase.com
growmyfunds.ca growmyfunds.ca
guarrasdelporno.xxx grtyi.com
guge.io gsasearchengineranker.pw
gz2.bbsoldes.fr gwebtools.com
hobbyhuren-datenbank.com harmonyglen.us
hopeonthestreet.co.uk havepussy.com
hoporno.com hd-film.pl
helvetia.com.ua
hotxnights.info
housekuba.org housekuba.org
howmuchdoestizanidinecost.blogspot.com howlongdoestizanidinestayinyoursystem.blogspot.com
hscsscotland.com howtoclean.club
htmlcorner.com humanorightswatch.org
iblogpress.xyz ideoworld.org
idegenvezeto.eu ihtec2019.org
ideibiznesa2015.ru imagecoolpub.com
iideaidekonkatu.info images-free.net
imagefinder.site imagui.eu
imk.com.ua inboundlinks.win
impisr.edunsk.ru indetiske.ya.ru
indo-export.ru infobabki.ru
inet-traffic.com infodocsportal.com
inspiring-desperate.tk infospot.pt
intelhdgraphicsgtdrive6w.metroblog.com interior-stickers.ru
interesnie-faktu.ru intermesh.net
investyb.com iplogger.org
ipostroika.ru ipostroika.ru
iqs.biz.ua istripper.com
izhevsk.zrus.org iwantmyfreecash.com
j-times.ru j33x.com
james13prix.info janettabridal.com
japan-bearings.ru javstock.com
javcoast.com jongose.ninja
jennyfire.ru journalhome.com
jose.mulinohouse.co junglenet-a.akamaihd.net
jovencitas.gratis jus0wil.pp.ua
juliadiets.com kakadu-interior.com.ua
kaac.ru karaganda.xkaz.org
katjimej.blog.fc2.com
kerwinandcariza.com kerwinandcariza.com
ketrzyn.pl ketoanhanoi.info
keyhantercume.com
keyword-suggestions.com
keywordspay.com keywordspay.com
kichenaid.ru keywordteam.net
kino2018.cc kidd.reunionwatch.com
kinofak.net klikbonus.com
kinogolos.ru kometars.xyz
kinozapas.com kursy-ege.ru
knowsitall.info labplus.ru
kostenlos-sexvideos.com landreferat.ru
krasnodar.ru law-check-two.xyz
lacapilla.info
lacasamorett.com
ladsup.com
laptoper.net
law-check-nine.xyz
lazy-z.com
ldrtrack.com ldrtrack.com
ledis.top lernur.net
life-instyle.com letslowbefast.site
lifehacĸer.com lezbiyanki.net
likesdesign.com liffa.ru
linkbolic.com linkwithin.com
littlesunraiser.com listiseltemournlan.gq
lkbennettoutlet.online lovasszovetseg.hu
locksmith.jp lutherstable.org
lonely-mature.com m.b00kmarks.com
losangeles-ads.com macfix.life
lostaruban.com madot.onlinewebshop.net
lsp-awak-perikanan.com
lyrics.home-task.com
m-google.xyz
macotool.com
makis.nu
maranbrinfo.com.br maranbrinfo.com.br
marktforschung-stuttgart.com marktforschung-stuttgart.com
massage-info.nl meduza-consult.ru
mathgym.com.au meetlocalchicks.com
mb140.ru memberty.com
mcar.in.ua metarip.ru
mecash.ru mezaruk.info
med-zdorovie.com.ua mhtr.be
medicinacom.ru microsearch.ru
medispainstitute.com.au microsoftportal.net
medosmotr-ufa.ru migente.com
mega-bony-2017.pl mixed-wrestling.ru
megaapteka.ru mlf.hordo.win
megagrabber.ru mmstat.com
menhealed.net morepoweronmac.trade
mini.7zap.com multgo.ru
miniature.io mural.co
missvietnam.org mxgetcode.com
mnimmigrantrights.net mycouponizemac.com
moi-glazki.ru myfreemp3.eu
mojpreskumanie.com myhydros.org
moneyzzz.ru myplaycity.com
monsterdivx.com naj-filmy24.pl
mossmesi.com naturalbreakthroughsresearch.com
moviemail-online.co.uk nevansk.ru
moviezbonkerssk.cf newyorkhotelsmotels.info
moyaterapiya.ru nikkiewart.ru
mrbojikobi4.biz njpalletremoval.com
mrvideospornogratis.xxx nordvpn.com
msk-diplomat.com novodigs.com
music.utrolive.ru o-o-11-o-o.com
music7s.me oakleyglassesonline.us
musicdaddy.net oballergiya.ru
musicspire.online offer.wpsecurity.website
musirc.com oil-td.ru
muz-baza.net okout.ru
mydearest.co one-gear.com
mygameplus.com onemactrckr.com
mymobilemoneypages.com openfrost.com
nagdak.ru orion-code-access.net
nalogovyy-kodeks.ru paleohub.info
naperehresti.info parajumpersjakkesalgnorge.info
naphukete.ru parajumpersoutlet.online
nash-krym.info park.above.com
neks.info parlament.biz
net-radar.com partnerads.men
newhairstylesformen2014.com pcads.ru
newstaffadsshop.club pdamods.ru
nfvsz.com perl.dp.ua
nullrefer.com php-market.ru
obsessionphrases.com picturesify.com
offtopic.biz pirateday.ru
okeinfo.online pixell.club
onefilms.net pizdeishn.com
onetravelguides.com pl-vouchers.com
online-zaymy.ru platinumdeals.gr
onlinewritingjobs17.blogspot.ru poems.com.ua
ooo-gotovie.ru pokemon-go-play.online
openmediasoft.com pomoc-drogowa.cba.pl
osagonline.ru popander.mobi
ownshop.cf popup-jdh.xyz
ozas.net pornhub-forum.ga
painting-planet.com porno-dojki.net
pandarastore.top pornogratisdiario.com
paparazzistudios.com.au pornohub.me
papasdelivery.ru powenlite24.ru
partnersafe.men printdirectforless.com
pathwhelp.org privacylocationforloc.com
patterntrader-en.com
picmoonco.pw
picsearch.com
picture-group.com
pijoto.net
piluli.info
pix24x7.com
pl.aasoldes.fr
playmsn.com
pornolook.net
pornophoto.xyz
portnoff.od.ua
preg.marketingvici.com
primedice.com
privetsochi.ru privetsochi.ru
prombudpostach.com.ua prizestohandle.club
pskcijdc.bloger.index.hr prosmibank.ru
pussyspace.net prostitutki-rostova.org
putitin.me prpops.com
quality-traffic.com purchasepillsnorx.com
questionmarque.ch push-ad.com
razorweb-a.akamaihd.net pushdata.sendpulse.com
registry-clean-up.net pussyfleet.com
reimageplus.com quelle.ru
replicalouboutin.xyz quickbuck.com
respublica-otel.ru quizzitch.net
rasteniya-vs-zombi.ru
rczhan.com
recipedays.com
redirectme.net
reklamuss.ru
remont-mobile-phones.ru
remontgruzovik.ru
renecaovillasale.online
rewardit.com
rfd-split.hr
rialp.getenjoyment.net rialp.getenjoyment.net
ric.info richinvestmonitor.com
royal-betting.net ringtonepartner.com
ru-dety.ru roma-kukareku.livejournal.com
rusoft-zone.ru rossanasaavedra.net
russintv.fr rucrypt.com
rusprostitute.com
russkie-gorki.ru
s-iwantyou.com s-iwantyou.com
s8-nowy-wygraj.comli.com safe-app.net
saletool.ru santasgift.ml
samo-soznanie.ru sax-sex.com
sankt-peterburg.nodup.ru sbprabooks.com
sape.top scanner-barak.top
sarm.tk scanner-don.top
saveindex.xyz screentoolkit.com
sbricur.com
scanmarine.info
scanspyware.net
schoolfiles.net
sdelai-prosto.ru
se-welding.ru se-welding.ru
searchinquire.com se.bnt-team.com
securesmrt-dt.com search-goo.com
sel-hoz.com searchinterneat-a.akamaihd.net
sendearnings.com secretscook.ru
seocheckupx.com seofied.com
seoheap.com seolab.top
seorank.info service-core.ru
serdcenebolit.com servingnotice.com
serving.adbetclickin.pink sexpornotales.net
sex-sex-sex5.com sexsaoy.com
sexphoto.site sextracker.be
sexvporno.ru sfd-chess.ru
shisha-swag.de shell-pmr.ru
shoesonlinebuy.xyz shitmovs.com
shoppingjequiti.com.br shtaketniki.kz
shopsellcardsdumps.com shymkent.xkaz.org
shtora66.ru signoredom.com
siteaero.com silvercash.com
slkrm.ru simple-image.com.ua
slowmac.tech simply.net
sitebeam.net
sitechecker.pro
sitopreferito.it
sixcooler.de
smichovbike.cz smichovbike.cz
smokewithrabbits.com social-buttons.xyz
smsactivator.ru space4update.pw
soblaznu.net spamnuker.com
social-s-hhh.xyz spb-plitka.ru
social-s-iii.xyz spb.afora.ru
soft-program.com spinnerco.ca
songoo.wz.cz sports-supplements.us
souvenir.cc strag-invest.ru
spasswelt.net styro.ru
srgwebmail.nl suggest-keywords.com
stanthonyscatholicchurch.org superfish.com
stretchingabuckblog.com supers.com.ua
stroyplus.ru susanholtphotography.com
studworks.org swagbucks.com
suchenindeutschland.com technopellet.gr
sunflowerdrawingpaintings.blogspot.com tecnoteakviareggio.it
superoboi.com.ua telefonsexi.com
survival.betteroffers.review themestotal.com
tam-gde-more.ru thetoiletpaper.com
teastory.co time-japan.ru
tech4master.com titangel-vietnam.com
telefonsex-ohne0900.net tizanidine4mgprice.blogspot.com
templates.radiodigital.co
thecounter.com
thewebsitetemplate.info
tilido.com
timer4web.com
timetorelax.biz
tizanidine4mgstreetvalue.blogspot.com
tizanidinecapsules.blogspot.com
tizanidinedosage.blogspot.com tizanidinedosage.blogspot.com
tizanidinehcl4mgtab.blogspot.com tizanidineingredients.blogspot.com
tizanidinehydrochloride2mg.blogspot.com tizanidineoral.blogspot.com
tizanidinenarcotic.blogspot.com tizanidinevsvalium.blogspot.com
tizanidineonline.blogspot.com tizanidinewithdrawal.blogspot.com
tizanidineshowupondrugtest.blogspot.com tksn.ru
tizanidinestreetprice.blogspot.com tmearegion26.com
toonfamilies.net token-lab.org
top-l2.com toon-families.com
topbestgames.com toondinsey.com
topads.men
topcasinoratings.ru
tourcroatia.co.uk tourcroatia.co.uk
track.deriv.com track-rankings.online
tracklead.net traffic2cash.org
trafaret74.ru traffic2money.com
trafficreceiver.club trafficgenius.xyz
tsan.net trailer.cinemaflix.website
tuberkuleznik.ru trk-4.net
tvand.ru trkdf.com
tvory.predmety.in.ua trucri.me
twodollarshows.com tzritel.tk
ukrobstep.com uchebavchehii.ru
ukrup.com ucsol.ru
umekana.ru uggsale.online
unmaroll.ya.ru uhodzalijami.ru
upupa.net ukkelberg.no
url-extractor.xyz ukrtvory.in.ua
url-img.link urlopener.blogspot.com.au
urll.eu utiblog.fr
vandrie-ict.nl utrolive.ru
vchulkah.net vavilone.com
vellings.info video-camer.com
vepad.com video-production.com
vesnatehno.ru videochat.life
vietimgy.pw vikistars.com
vip-file.com vinsit.ru
vipps.com.my vladimir.xrus.org
vitoriacabos.com volgograd.xrus.org
viven.host.sk voltrknc1.com
vzlomsn.org vostoktrade.info
vvpg.ru
vzube.com vzube.com
wapsite.me wahicbefa31.soup.io
wardreapptokone.tk webcamdevochka.com
wdrake.com webkeyit.com
web-betting.ru website-speed-up.site
webmasters.stackexchange.com website-speed-up.top
where-toget.com weburok.com
wineitudes.wordpress.com weclipart.com
wingsofrefuge.net weekes.biz.tc
word-vorlagen.net westen-v.life
worldinternetauthority.com westermarkanjou.se
worldis.me whatsupinfoley.com
wstroika.ru whatzmyip.net
x-lime.net whengirlsgowild.com
xblog.in white-truck.life
xclicks.net wholinkstome.com
xmlinde.com wiosenny-bon-1500.pl
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai witherrom55.eklablog.fr
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai woman-h.ru
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai wonderfulflowers.biz
xn--80ajbshivpvn2i.xn--p1ai wordpresscore.com
xn--90acenikpebbdd4f6d.xn--p1ai worldtraveler.world
xn--e1afanlbnfckd7c3d.xn--p1ai ww2awards.info
xn--h1aakne2ba.xn--p1ai www.888.com
xtraffic.plus www.jbetting.com
xtube.com www.kabbalah-red-bracelets.com
xxxasianporn.net www.labves.ru
xxxhdvideo.site x-diesel.com
yaoguangdj.com x-porno.video
yellowstonevisitortours.com xkaz.org
yhit.press xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
youghbould.wordpress.com xn----7sbifcamovvfggw9d.xn--p1ai
yourporn.com xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
zacreditom.ru xn--1-8sbcpb0bdm8k6a.xn--p1ai
zaim-pod-zalog-krasnodar.ru xn--80aikhbrhr.net
zastroyka.org xn--80atua3d.xn--p1ai
zdesoboi.com xn--d1abj0abs9d.in.ua
zeikopay.com xn--d1aifoe0a9a.top
zero1.it xnxx699.com
zigarettenonlinekaufen1.blox.pl xsfetish.org
zone-kev717.info xsion.net
xxxrus.org
yeartwit.com
yebocasino.co.za
yourothersite.com
ytmnd.com
z-master.ru
zajm-zalog-krasnodar.ru
zakazvzloma.com
zapiszto.pl
zeroredirect12.com
zona-aqua.ru
zoompegs.com zoompegs.com
zoosexart.com zscaler.net
zynax.ua

490
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
08800.top 12masterov.com
1001watch.com.ua 18ps.ru
4k-player.pl 3dracergames.com
aaa38852e886ac4af1a3cff9b47cab6272.com 8jn.dating-app.ru
98oi.ru
aad1f4acb0a373420d9b0c4202d38d94fa.com
abusora.com abusora.com
acc.eu.org addray.pro
adpremium.org adman.se
adultnet.in adprotect.net
air-edem.ru adsland.men
alekseevec.ru adsloads.com
alldownload.pw agardomains.com
aludecor.info aktivator-windows10.blogspot.com
animalrank.com allsilver925.co.il
ap.senai.br altamayoztourism.com
apccargo.com android-vsem.org
apessay.com angkortours.vn
apimossnetinfo-a.akamaihd.net apilinkswiftco-a.akamaihd.net
autobrennero.it asscenihotosidea.blogspot.co.za
autoseo-traffic.com atleticpharm.org
aviav.ru autoplate.info
avkzarabotok.com avtoarenda.by
awency.com avtolombard-krasnodar.ru
ayerbo.xhost.ro axbocz.net
backlink4u.net babs.com.ua
backuperwebcam.weebly.com bankmib.ru
balkanfarma.ru bannerbank.ru
battlecarnival.su bcmp.org
beauty-b0x.pl bestmouthwash.club
bingo8888.com betteroffers.review
blacktwhite.com bidbuy.co.kr
bluejays-jerseys.us bigcareer.info
boobsimge.com bizlist.com.de
bookmark4you.com.biz brainzpod.win
bpro1.top buydissertation.net
buscarfoto.com buzzzg.men
cactussoft.biz camsex.xxx-cam.webcam
callstevens.com capacitacionyaprendizaje.com
canvas.gloverid.site carapics.com
carloans.com cartierloveringreplica.xyz
cartierjusteunclou.xyz cartierreplica.top
casite-513049.cloudaccess.net cayado.snn.gr
cementaresearch.se chcu.net
centrdebut.ru clickhype.com
cfjump.com clicksotrk.com
cheapmoncler.xyz cmhomestayagency.com
check-host.net cocyq.inwtrade.com
cleansearch.net coldfilm.ru
compliance-donald.xyz communisave.co.za
contextualyield.com compliance-john.top
compliance-walter.top
constantaservice.net
cookie-law-enforcement-ff.xyz cookie-law-enforcement-ff.xyz
custom-electric-guitar.com cookie-law-enforcement-hh.xyz
customchocolate.business-for-home.com cosmeticswomens-womensports.rhcloud.com
customergrowthsystems.com czeshop.info
cutt.us dawlenie.com
daooda.com deadlinkchecker.com
data.vtc.pw dear-diary.ru
deniven.1bb.ru degerlund.net
detskie-zabavi.ru
dichvuvesinhhanoi.com
dimkino.ru dimkino.ru
dinosaurus.site divatraffic.com
docsportal.net domainsatcost.com
dominateforex.ml dprtb.com
duawitchrarato.tk drhomes.biz
eas-seo.com ec-file.info
education-cz.ru ecommerce-seo.com
elektrozigaretten1.webs.com elektroniksigaraankara.info
elexies.info essayservicewriting.org
estelight.ru extads.net
everytalk.tv fandlr.com
exci.ru fanpagerobot.com
expertblog.info fba-mexico.com
extractorandburner.com fealq.com
ezigarettekaufen2.mpbloggar.se fenoyl.batcave.net
failingmarriege.blogspot.com film-one.ru
fanrto.com financehint.eu
fillmewithhappiness.com foxydeal.com
filmbokep69.com freshberry.com.ua
financepoints.eu fun-mobi.pl
finemanteam.com galaxy-family.ru
finstroy.net gallictures.com
firma-legion.ru gamedayhouse.com
fiuxy.com geilehausfrauen.net
forensicpsychiatry.ru genetworx.com
foxweber.com gigapeta.com
freecamdollars.com gogalleryawesome.com
futbolkisales.ru goodwinmetals.co
galaxys6manual.info gunsvicceadadebt.tk
ge0ip.org hd-filmy.net
getresponse.com histats.com
girlporn.ru hobild.net
global-ics.co.za hotelcrocenzi.sm
gox.com.ua houtings.xyz
greatzip.com hunterboots.online
gwagka.com iflycapetown.co.za
heroz.fr imagez.co
highstairs-a.akamaihd.net imfamous.info
hkdiiohi.skyrock.com invitefashion.com
hobbyhuren24.net iqbazar.ru
homemade.gq irkutsk.zrus.org
hothot.ru james13prix.info
hoverboard360.se javatex.co.id
hvd-store.com je7.us
idealtits.net jo24news.com
ilovevitaly.ru kamagragelusa.net
images-free.net kiinomaniak.pl
imitex-plus.ru kinoplen.ru
import-sales.com kinostorm.net
inet-traffic.com kletkimehan.ru
itag.pw kliksaya.com
japan-bearings.ru kol-energo.ru
javspace.net kozhniebolezni.com
jimmychoosale.online kumuk.info
joessmogtestonly.com laapp.com
kanimage.com law-check-seven.xyz
kenaba.su laxdrills.com
kino-key.info leboard.ru
kirov.zrus.org link.ac
kndxbkdx.bloger.index.hr littlecity.ch
kountrylife.com livingroomdecor.info
kskjco.club lkbennettoutlet.online
kustanay.kz loadingpages.me
lasvegaslockandsafe.com lyrics.home-task.com
law-check-eight.xyz m5home.ru
laxob.com manipulyator-peterburg.ru
lazymanyoga.com mansparskats.com
limads.men maximilitary.ru
lion.snapmap.us medi-fitt.hu
localflirtbuddies.com medkletki.ru
lonerangergames.com mesbuta.info
mainlinehobby.net metaxalonevstizanidine.blogspot.com
managerpak204.weebly.com mikozstop.com
mansiondelrio.co mindbox.co.za
manualterap.roleforum.ru minecraft-rus.org
mb140.ru mini-modus.ru
mini.7zap.com mobilierland.com
mobplayer.ru mojowhois.com
mojpreskumanie.com monitorwebsitespeed.com
monclervests.xyz mundoaberrante.com
mrlmedia.net mustwineblog.com
mrwhite.biz mxgetcode.com
musezone.su myfreetutorials.com
muz-shoes.ru naj-filmy24.pl
mwtpludn.review negociosdasha.com
njpalletremoval.com nhl17coins.exblog.jp
nufaq.com nikkiewart.ru
o-dachnik.ru noclegonline.info
obiavo.com nonameread45.live
odesproperty.com o00.in
of-ireland.info obiavo.ru
offers.bycontext.com ooo-olni.ru
okmusic.jp orion-code-access.net
ostrovtaxi.ru orsonet.ru
owohho.com parajumpersoutlet.online
oyster-green.com partner-pop.men
partybunny.ru platezhka.net
pateaswing.com pornhive.org
pekori.to pregnant.guru
phrcialiled.com privat-girl.net
phuketscreen.com professionaldieselcare.com
picsearch.com progonrumarket.ru
pod-muzyku.club projectforte.ru
pogruztehnik.ru pronorm.fr
poiskzakona.ru rcb101.ru
popup-fdm.xyz remorcicomerciale.ro
pornoforadult.com resultshub-a.akamaihd.net
pornoplen.com retreatia.com
porto.abuilder.net rialp.getenjoyment.net
portside.xyz robot-forex.biz
poshiv-chehol.ru rusoft-zone.ru
pozvonim.com rustic-quiver.win
prefersurvey.net sabaapress.com
profitsport.club sad-torg.com.ua
projefrio.com.br safe-app.net
promoheads.com sarahmilne.top
prosmibank.ru sardinie.us
prosperent.com scanner-ivan.top
purplesphere.in scanner-olga.top
qexyfu.bugs3.com scanner-walt.top
quick-offer.com scanspyware.net
rankia.com search.xtconnect.com
realitykings.com searchengineranker.email
realmonte.net searchimpression.com
remybutler.fr seorussian.ru
replicaclub.ru sexad.net
restaurantlescampi.com sexblog.pw
ribieiendom.no sexxdate.net
ringporno.com shemale-sex.net
roleforum.ru shtaketniki.ru
saneyes.com signal03.ru
sanidumps.com simul.co
scanner-jess.top sisiynas.ru
scanner-nelson.top skylta.com
screpy.com sluganarodu.ru
sdelatmebel.ru smsactivator.ru
semprofile.com snomer1.ru
seogadget.ru soundfrost.org
seoprofiler.com souvenir.cc
sex-dating.co spbchampionat.ru
sexfreepornoxxx.com speeddream.xyz
sexspornotub.com spinazdrav.ru
sfd-chess.ru stackthatbucks.com
shoesonlinebuy.cn stretchmate.net
signoredom.com svarkagid.com
simon3.ru sweepstakes.rewardit.com
sinestesia.host.sk t-bygg.com
smartpet.ru taxi-v-eisk.ru
socialmediasuggest.com telegramdownload10.com
specialfinanceoffers.com threecolumnblogger.com
spidtest.org tiandeural.ru
starwars.wikia.com tksn.ru
students-cheapskate.ml toonfamilies.net
syndicate.fun tootoo.to
syvertsen-da.no topsiteminecraft.com
tehngr.ru traderzplanet.in
thecoral.com.br tuckermktg.com
tizanidinehcl2mgtablet.blogspot.com twittrading.com
topanasex.com udayavani.com
tracksurf.daooda.com ugogo.info
tradgardspartner.se umityangin.net
trkdf.com uogonline.com
tupper-shop.ru uptimebot.net
undergroundcityphoto.com usadacha.net
v-doc.co usbggettwku.ga
varikoz24.com ustion.ru
veopornogratis.xxx vapomnoncri.tk
viddyoze.com viandpet.com
video-hollywood.ru video-hollywood.ru
videochat.tv.br videochat.world
vids18.site w3javascript.com
virus-schutzmasken.de warning.or.kr
vodkoved.ru weblo.com
voloslove.ru webtherapy.ru
wardreapptokone.tk while.cheapwebsitehoster.com
web-analytics.date white-truck.life
webalan.ru www.wohnkabinen-shop.de
welcomeauto.ru x-true.info
wildnatureimages.com xn--80abgj3a5acid6ghs.top
wma-x.com xn--c1acygb.xn--p1ai
www.souvenirua.com xtubeporno.net
wzgyyq.com yellowproxy.net
xn--80ajbshivpvn2i.xn--p1ai your-bearings.com
xn--80atua3d.xn--p1ai yourads.website
xn--e1aggki3c.xn--80adxhks zeroredirect11.com
yatrk.xyz
youbloodyripper.com
zeroredirect12.com zeroredirect12.com
zeroredirect2.com zvooq.eu
znaniyapolza.ru
zona-aqua.ru
zscaler.net
zverokruh-shop.cz

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.232 0; 10.1.0.160 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3040 ### Version: V4.2022.04.3041
### Updated: Tue Apr 12 22:01:54 UTC 2022 ### Updated: Wed Apr 13 10:03:37 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3040 ### Version: V4.2022.04.3041
### Updated: Tue Apr 12 22:01:54 UTC 2022 ### Updated: Wed Apr 13 10:03:37 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##