vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2983 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-16 22:07:15 +00:00
parent 1cc5f14a07
commit b0a8072cbd
48 changed files with 86027 additions and 86010 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2982 #### Version: V4.2022.03.2983
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2982 #### Version: V4.2022.03.2983
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2982 #### Version: V4.2022.03.2983
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10616
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2982 #### Version: V4.2022.03.2983
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10620
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10620
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10620
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10620
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10620
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10620
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10620
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2982 2983

10620
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10620
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.42.13.41 0; 52.165.152.26 0;

10620
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10620
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10620
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10620
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.42.13.41 0; 52.165.152.26 0;

10620
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.42.13.41 0; 52.165.152.26 0;

10620
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Abonti Alexibot
Aboundex BatchFTP
CazoodleBot CrunchBot
GermCrawler DIIbot
MJ12bot HEADMasterSEO
PageThing.com Net Vampire
Seekport SEOkicks
SpaceBison Spammen
Widow Sucker
WinHTTrack VoidEYE

278
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
ADmantX Abonti
ALittle Client Acunetix
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot AiHitBot
Aipbot Anarchy
AlphaBot
Anarchy99
Ankit
Anthill
Apexoo Apexoo
Aspiegel Aspiegel
Atomseobot Atomseobot
Attach BDCbot
AwarioRssBot BLEXBot
BDFetch
BackStreet BackStreet
BackWeb BackWeb
BacklinkCrawler BacklinkCrawler
Badass Badass
Bandit
Barkrowler Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle Bitacle
BlackWidow Black Hole
Blow
BlowFish BlowFish
Boardreader BotALot
Bolt
Brandprotect
Brandwatch Brandwatch
Buck
Buddy Buddy
BuiltBotTough Bullseye
BuzzSumo BunnySlippers
CODE87 CODE87
CSHttp Calculon
CazoodleBot
CensysInspect CensysInspect
CheTeam CheeseBot
CherryPicker Chlooe
Citoid
Cocolyzebot Cocolyzebot
Cogentbot CopyRightCheck
Craftbot Cosmos
CrazyWebCrawler
Crescent
Curious Curious
CyotekWebCopy
DIIbot DIIbot
DSearch DSearch
DTS Agent
DatabaseDriverMysqli DatabaseDriverMysqli
Digincore Digincore
DigitalPebble DigitalPebble
Disco
Discobot Discobot
DnBCrawler-Analytics DomainAppender
DomCopBot
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Download Wonder EMail Wolf
Drip
EMail Siphon
EasyDL
Ecxi Ecxi
Evil Evil
Exabot Exabot
Express WebPictures Express WebPictures
ExtractorPro Extreme Picture Finder
EyeNetIE EyeNetIE
Ezooms FDM
Flunky Fimap
FrontPage Firefox/7.0
FlashGet
Fyrebot
GT::WWW
GermCrawler GermCrawler
GetRight GetRight
GetWeb
Gigabot Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
Gotit GoZilla
GrabNet
Grabber Grabber
GrapeFX GrapeFX
HEADMasterSEO GridBot
HTMLparser HTMLparser
HTTP::Lite HTTrack
Harvest Harvest
Hloader
HybridBot HybridBot
IDBot IRLbot
Iblog Iblog
Id-search Image Fetch
IndeedBot InfoNaviRobot
InfoTekies InfoTekies
Jbrofuzz Intelliseek
InterGET
InternetSeer
Iria
IstellaBot
Jetty Jetty
Jorgee Kinza
JustView Lanshanbot
Kenjin Spider LeechFTP
Keyword Density
LNSpiderguy
LWP::Simple
Leap
LeechGet LeechGet
LibWeb
Libwhisker Libwhisker
Lightspeedsystems LinkWalker
LinkScan
Linkbot Linkbot
Linkdexbot LinkextractorPro
LinksManager LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Ltx71 Ltx71
MIDown tool MFC_Tear_Sample
MSIECrawler MIIxpc
MSFrontPage
Mail.RU_Bot Mail.RU_Bot
MarkMonitor MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
Mata Hari
MauiBot
Mb2345Browser Mb2345Browser
MeanPath Bot Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri Metauri
MicroMessenger MicroMessenger
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Mozlila
Mr.4x3 Mr.4x3
Msrabot Msrabot
Name Intelligence Name Intelligence
Navroad Nameprotect
NetZIP NearSite
Nessus
NetAnts
NetMechanic
NetSpider
Netcraft Netcraft
Netvibes Netvibes
NextGenSearchBot
Nibbler
Nimbostratus
Ninja Ninja
Nmap Nmap
Not Nutch
Octopus Offline Explorer
OutclicksBot Offline Navigator
PECL::HTTP OpenLinkProfiler
POE-Component-Client-HTTP OpenVAS
PageGrabber OrangeBot
PageScorer OrangeSpider
OutfoxBot
PageAnalyzer
Pandalytics
Panscient
Pavuk Pavuk
PeoplePal Picsearch
Pi-Monster Pixray
PictureFinder Probethenet
Pimonster QueryN Metasearch
ProWebWalker
PxBroker
PyCurl
RankActive RankActive
RankFlex RankFlex
RankingBot2 RankingBot
Rankivabot
RankurBot RankurBot
RebelMouse RebelMouse
RedesScrapy
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler
SEOstats SEOstats
SISTRIX
SMTBot SMTBot
ScanAlert
ScoutJet
Scrapy Scrapy
ScreenerBot SearchmetricsBot
Seekport
Semrush Semrush
SeobilityBot SemrushBot
SeoSiteCheckup
Seomoz Seomoz
Siphon SiteSnagger
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker SiteSucker
Siteimprove Siteimprove
SlySearch SlySearch
Snake SocialRankIOBot
SpaceBison Sottopop
Spammen Spammen
Spanner
Spinn3r Spinn3r
Sqlworm Sqlworm
Sqworm Sucker
SuperHTTP SuperBot
Surfbot Szukacz
Swiftbot T8Abot
Telesphoreo
Telesphorep
TightTwatBot TightTwatBot
Titan Titan
Trendictionbot Trendictionbot
Turnitin True_Robot
Turingos
TurnitinBot TurnitinBot
URLy.Warning TwengaBot
UnisterBot
Upflow Upflow
VCI Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voil
Voltron Voltron
WASALive-Bot WBSearchBot
WISENutbot
WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers Wallpapers
Web Auto Wallpapers/3.0
Web Collage Web Collage
Web Fetch Web Fetch
Web Sauger
Web Sucker
WebAuto WebAuto
WebBandit WebBandit
WebCollage WebEnhancer
WebCopier WebGo IS
WebFetch WebLeacher
WebFuck WebSauger
WebWhacker WebStripper
WebZIP WebSucker
Webalta Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor WebsiteExtractor
Webster WebsiteQuester
Whacker
WiseGuys Robot WiseGuys Robot
Xaldon_WebSpider Woobot
Wprecon
Zade Zade
Zeus Zauba
Zitebot ZoomBot
ZmEu ZoominfoBot
ZumBot
ZyBorg
adscanner adscanner
arquivo.pt
backlink-check backlink-check
check1.exe check1.exe
coccocbot clark-crawler
cognitiveseo cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j crawler4j
dataforseo.com
domainsproject.org
evc-batch
heritrix
internetVista monitor
isitwp.com
iubenda-radar iubenda-radar
lwp-trivial lwp-trivial
meanpathbot meanpathbot
mediawords
netEstate NE Crawler netEstate NE Crawler
pcBrowser pcBrowser
ripz s1z.ru
satoristudio.net scalaj-http
scan.lol
seobility seobility
serpstatbot
sitechecker.pro sitechecker.pro
sp_auditbot spyfu
tAkeOut tAkeOut
webmeup-crawler voyagerx.com
x09Mozilla
x22Mozilla x22Mozilla
zauba.io
zgrab

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
80legs ALittle Client
ASPSeek ASPSeek
Abonti
Aboundex Aboundex
Acunetix Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot AiHitBot
Aipbot
AllSubmitter
Alligator Alligator
Anarchy99 Anarchie
Ankit
Apexoo
Aspiegel
Atomseobot
BBBike BBBike
BDFetch BDCbot
BLEXBot BLEXBot
BackDoorBot
BacklinkCrawler BacklinkCrawler
Badass Black Hole
Bitacle Blow
BlackWidow Boardreader
BlowFish Buck
Bolt
BotALot
Buddy Buddy
BuiltBotTough BuiltBotTough
BuiltWith BunnySlippers
Bullseye BuzzSumo
CCBot CODE87
CSHttp Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CheTeam
CherryPicker CherryPicker
Chlooe ChinaClaw
Citoid
Claritybot Claritybot
Cloud mapping Cliqzbot
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
Collector
Copier
Copyscape Copyscape
CrazyWebCrawler
Crescent
CrunchBot
Custo Custo
DSearch DIIbot
DTS Agent DTS Agent
DatabaseDriverMysqli Demon
Devil Devil
Discobot DigitalPebble
DomCopBot DomainSigmaCrawler
DomainCrawler
Domains Project Domains Project
Dotbot Dotbot
Download Wonder Download Wonder
Dragonfly
Drip Drip
EMail Siphon EMail Wolf
EasyDL
Ebingbong
EirGrabber EirGrabber
EroCrawler Exabot
Evil Express WebPictures
Extractor
Ezooms
FDM FDM
FHscan FHscan
FemtosearchBot FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
FlashGet Foobot
Flunky Freeuploader
G-i-g-a-b-o-t FrontPage
Fyrebot
GT::WWW
GalaxyBot GalaxyBot
Genieo Genieo
GermCrawler
GetRight GetRight
GetWeb GetWeb
Gigabot Grabber
Gotit Grafula
GrabNet GrapeFX
GrapeshotCrawler GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HTTrack
HaosouSpider HaosouSpider
Harvest Havij
Heritrix
Hloader Hloader
HybridBot
IDBTE4M IDBTE4M
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies InfoTekies
Jbrofuzz Intelliseek
JennyBot InterGET
InternetSeer
Iria
IstellaBot
JOC Web Spider
Joomla Joomla
JustView JustView
LWP::Simple Kinza
Larbin Larbin
LeechFTP LeechGet
Linkbot Libwhisker
LinkextractorPro LieBaoFast
LinkpadBot Lightspeedsystems
LinksManager Likse
LinqiaRSSBot LinkScan
LinqiaScrapeBot Linkdexbot
MFC_Tear_Sample LinqiaMetadataDownloaderBot
MSIECrawler MTRobot
Mag-Net
Majestic-SEO Majestic-SEO
MarkMonitor
MarkWatch MarkWatch
Mass Downloader
MeanPath Bot MeanPath Bot
Microsoft Data Access MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek Mojeek
Morfeus Fucking Scanner
NICErsPRO NICErsPRO
NPbot NPbot
Nameprotect Navroad
NearSite Needle
Net Vampire Net Vampire
NetAnts NetAnts
NetMechanic NetMechanic
NetSpider
Nettrack Nettrack
Netvibes NimbleCrawler
NextGenSearchBot
Nibbler
Nikto
Nimbostratus
Ninja
Nmap Nmap
Not Offline Explorer
OpenLinkProfiler Openfind
Openvas OrangeBot
OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
Papa Foto PageAnalyzer
PageScorer
Pandalytics
Panscient
PeoplePal PeoplePal
Pi-Monster
Picscout
Picsearch
PictureFinder PictureFinder
Piepmatz Piepmatz
Pixray Pimonster
Pump PleaseCrawl
RankActive Probethenet
RankActiveLinkBot Psbot
Re-re PxBroker
Reaper RankingBot2
Ripper RealDownload
RebelMouse
SEOkicks SEOkicks
SEOstats SEOkicks-Robot
SISTRIX
SMTBot SMTBot
SalesIntelligent ScanAlert
Scanbot ScoutJet
ScrepyBot Scrapy
Searchestate SearchmetricsBot
SemanticJuice SemanticJuice
SemrushBot SemrushBot
Shodan SeoSiteCheckup
Seomoz
Siphon
Site Sucker Site Sucker
SiteCheckerBotCrawler SiteExplorer
SiteSnagger Siteimprove
SiteSucker
Sitebeam
Snake
Snapbot Snapbot
SocialRankIOBot Sosospider
Sociscraper SpaceBison
Sottopop
Spammen Spammen
SpankBot
Spanner
Spinn3r
Sqlworm Sqlworm
SurveyBot Sqworm
T0PHackTeam Steeler
TeleportPro SuperHTTP
Suzuran
Teleport
Telesoft Telesoft
Telesphoreo Telesphoreo
The Intraformant The Intraformant
Toata Toata
Tracemyfile Tracemyfile
Trendiction Trendictionbot
Turingos TwengaBot
Turnitin
URLy.Warning
UnisterBot
Upflow Upflow
VCI VCI
VidibleScraper VoidEYE
Voil Voil
WBSearchBot WASALive-Bot
WEBDAV
WISENutbot WISENutbot
WPScan WWW::Mechanize
WWW-Collector-E Wallpapers
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto Web Auto
Web Collage Web Collage
Web Enhancer Web Enhancer
Web Pix
Web Sauger
WebAuto
WebCopier
WebEnhancer
Web Fetch Web Fetch
Web Sauger
Web Sucker
WebCollage
WebFuck WebFuck
WebImageCollector WebReaper
WebStripper WebSauger
WebSucker
WebZIP WebZIP
Webalta Webalta
Webshag
Website Quester
WebsiteQuester WebsiteQuester
Whack Whack
Whatweb Whacker
Widow Widow
WinHTTrack WiseGuys Robot
Wonderbot Wonderbot
Xenu Woobot
Zauba Zeus
ZoominfoBot ZmEu
ZoomBot
ZumBot
adscanner adscanner
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt autoemailspider
cah.io.community cognitiveseo
coccocbot
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
domainsproject.org domainsproject.org
eCatch eCatch
evc-batch
facebookscraper facebookscraper
instabid heritrix
ips-agent lwp-trivial
isitwp.com
magpie-crawler magpie-crawler
meanpathbot meanpathbot
muhstik-scan mediawords
oBot oBot
plumanalytics page scorer
probe-image-size probe-image-size
ripz ripz
satoristudio.net s1z.ru
scan.lol scalaj-http
seobility seobility
serpstatbot seocompany.store
sexsearcher
sitechecker.pro sitechecker.pro
siteripz spyfu
tAkeOut trendiction.com
voyagerx.com voyagerx.com
webgains-bot
webmeup-crawler
webpros.com webpros.com
xpymep1.exe webprosbot
x09Mozilla
x22Mozilla
zauba.io
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
best-businessman.ru all4wap.ru
customerguru.in dailyfinancefix.com
dosug-lux.ru eupornstar.info
filefilter.weebly.com iqs.biz.ua
getmyads24.com lol-smurfs.com
nfljerseyscheapbiz.us nvssf.com
notaria-desalas.com otbelivanie-zubov.com
pony-business.com partnerworkroom.men
regdefense.com poquoson.org
soundfrost.org video-hollywood.ru

916
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
08800.top
0c47f8422d3f.com
100searchengines.com
101flag.ru
10bet.com 10bet.com
14b.info 123movies.love
1adult.com 12u.info
2020iscoming.info 2itech.ru
4inn.ru 4inn.ru
4pp13.com 5kstore.com
4rent.ru
4ur.click
5tey7463.weebly.com 5tey7463.weebly.com
8si.ru 5u.com
98oi.ru 83net.jp
9icmzvn6.website aa625d84f1587749c1ab011d6f269f7d64.com
aa14ab57a3339c4064bd9ae6fad7495b5f.com
aad1f4acb0a373420d9b0c4202d38d94fa.com aad1f4acb0a373420d9b0c4202d38d94fa.com
aarbur.com abovetherivernc.com
absolute-s.ru absolutelyanalog.com
addtoadd.men acheterviagrafr24.com
adinterax.com ads.tremorhub.com
adprotect.net adsland.men
adsfresh.men advocatemsk.ru
advertex.info affrh2015.com
affiliate-fr.com ageofclones.com
afftrack001.com akama.com
allboard.xobor.de alert.scansafe.net
allesohnegirls.net allmarketsnewdayli.gdn
amt-k.ru allwidewallpapers.com
android-style.com alphaforum.ru
apidiamondatanet-a.akamaihd.net ameblo.jp
apiwoodensealcom-a.akamaihd.net amospalla.es
apple.com-cleaner.systems amyfoxfitness.com
arate.ru angel1777.kz
arcadepages.com animalrank.com
arcadeplayhouse.com antons-transporte.de
apidigidocketnet-a.akamaihd.net
apioasisspacenet-a.akamaihd.net
apiportalmorecom-a.akamaihd.net
apispringsmartne-a.akamaihd.net
apxeo.info
arendas.net arendas.net
arkartex.ru articlesdirectoryme.info
artel116.ru auto4style.ru
asrvvv-a.akamaihd.net autolombard-krasnodar.ru
asscenihotosidea.blogspot.co.za autoua.top
atlasvkusov.ru aviav.co
australia-opening-times.com avon-novosib.ru
auto.rusvile.lt
autodo.info
avek.ru
aviapanda.ru
aviav.ru.com
avon-ukraine.com
avtochehli.by avtochehli.by
azbukadiets.ru ayakino.net
azbukafree.com baixar-musicas-gratis.com
azlex.uz balkanfarma.ru
baltgem.com bangla-chat-uk-paralud.ga
baoxaydung.com.vn baoxaydung.com.vn
basisches-wasser.net
bcmp.org bcmp.org
beachtoday.ru bedcapdealers.com
bear.gotcher.us bet365.com
beclean-nn.ru
beetpics.pw
beget.tech
bestadbid.com
bestprofits-there.com
betterscooter.com
betune.onlinewebshop.net betune.onlinewebshop.net
bgviagrachrx.com beyan.host.sk
bigames.online bingo8888.com
bingoporno.com biznesrealnost.ru
blackle.com biznesschat.net
bloggerads.net blacktwhite.com
blogsfunky672.weebly.com blockety.co
bluejays-jerseys.us blockworld.ru
bonkers.name blogos.kz
bradleylive.xyz bocoarchives.org
btc4u.ru bodybuilding-shop.biz
business-made-fun.com boeuklad.com
butstrap.space bonvillan.com
buydissertation.net brg8.com
buyfriend.ru brus.city
buynorxx.com bryansk.zrus.org
buyviagraa.blogspot.com buigas.00it.com
buzzonclick.com burn-fat.ga
bvlgariring.xyz buttons-for-your-website.com
buy-cheap-online.info
buypanicdisorderpill.com
bytimedance.ru
cakesplus.com.au cakesplus.com.au
callejondelpozo.es callawaygolfoutlet.online
cardsdumps.com callmd5map.com
canvas.gloverid.site
canzoni.ru
cardiosport.com.ua
carfax.com.ua
cars-modification.net
carsplate.com carsplate.com
cashkitten-a.akamaihd.net cartechnic.ru
ccbill.com cartierlovebraceletreplica.xyz
cdncash.org cartierring.xyz
centraletermice.us cartujano-pre.de
centrumcoachingu.com cerev.info
cheapestjerseys-wholesale.com cfacarrosserie74.com
cheapwebsitehoster.com cheapwebsitehoster.com
chidporn.com checkpagerank.net
chinese-amezon.com checktext.org
choosecuisine.com chocolateslim-en-france.com
christianlouboutinsaleonline.us cindymatches.com
cialischsrx.com cinemaenergy-hd.ru
clarithromycin500mg.com civilwartheater.com
cntravelre.com co.lumb.co
codq.info coccoc.com
coindirect.io cocyq.inwtrade.com
collegerentals.com coinsspb.com
compliance-alexa.top compliance-alex.xyz
compliance-jack.top compliance-walt.top
compliance-jess.top coolgamechannel.com
conocer-sanabria.com coolyarddecorations.com
coolingoods.com copyrightclaims.org
copypaste.traderzplanet.in cosmeticswomens-womensports.rhcloud.com
cowlmash.com courtshipgift.com
crackguru.tk craftburg.ru
cs-passion.pl crafthubs.com
cvety24.by creams.makeforum.eu
crest3d.ru
cubook.supernew.org
cubs-jerseys.us
cupday.com
customerguru.in
daisye.top daisye.top
dame-ns.kz daooda.com
diegolopezcastan.com ddpills.com
dispo.de decoratinghomes.ga
diusyawiga.tk decorationspcs.com
dlya-android.org defenderxtactical.com
domainroam.win deluxedumps.com
domoysshop.ru dengi-pod-zalog-nedvizhimosti.ru
drugs-no-rx.info depositfiles-porn.ga
dscaas.website detskie-konstruktory.ru
dumuelave.xyz divku.ru
e-commerce-seo.com djstools.com
eachdayisagift.review dktr.ru
eaplay.ru doktoronline.no
easytuningshop.ru dolohen.com
ebooknovel.club domain-submit.info
efkt.jp domcran.net
electro-prom.com downloadkakaotalk.com
elektrischeziga.livejournal.com dpihatinh.gov.vn
elektrischezigarette1.onsugar.com drillsaw.ru
elektroniksigaraankara.info drunkmoms.net
elektrozigarette2.webs.com dtm-spain.com
elitepcgames.com e705.net
englate.com easyshoppermac.com
erectile.bid elektir.ru
elektrischezigarettekaufen2.cowblog.fr
elektronischezigarettekaufen1.myblog.de
eloxal.ru
eropornosex.ru eropornosex.ru
escort-russian.com erotiktreff24.info
es5.com
esnm.ru esnm.ru
essayassist.com etotupo.ru
etenininrade.ga eupornstar.info
euronis-free.com euronis-free.com
everypony.ru
everytalk.tv
exchanges-bet.com
exci.ru exci.ru
exct.net eyessurgery.ru
extrabot.com ezaz.info
facecup.top ezigaretteshop.webs.com
failingmarriege.blogspot.com f07.de
falllow.gq f5mtrack.com
fapgon.com falcoware.com
fast-wordpress-start.com fastcrawl.com
fatfasts-4tmz.com fba-mexico.com
fermersovet.ru femdom.twiclub.in
fetishinside.com fikasound.tk
fickluder69.com filmania-x.ru
filefilter.weebly.com filmci.pro
filmetricsasia.com flipper.top
filmgo.ru floridamhca.org
financetip.eu forex21.ru
finemanteam.com formseo.com
fivedwld.cf fortunejack.com
flex4launch.ru forum.doctissimo.fr
fodelsedagspresenter.nu forum20.smailik.org
food.dtu.dk forums.d2jsp.org
foodcrafts.website foto-telok.net
forexunion.net foxydeal.com
forpackningsutveckling.se fr-bearings.ru
foxinsocks.ru franch.info
free-share-buttons.blogspot.com free-today.com
free-share-buttons.com free411games.com
freelinkbuilding.website.tk froggytube.com
front.ru front.ru
front.to
frvo.alptandem.ru frvo.alptandem.ru
funtoonez.com fsakhalin.ru
fyxabomiw.ru fun-mobi.pl
g33.org fxtips.ru
ge0ip.com fym.com.ru
gelezki.com gabeshop.ru
glasof.es gardene.ru
goblacked.com gay.adultgalls.com
gobongo.info geckoandfly.com
goldandcard.ru genericlowlatencyasiodriverhq.aircus.com
goosefishpost.bid getoutofdebtfree.org
gopro-online.info gg.zzyjxs.com
gov.yanao.ru given2.com
glall.ru
global-ics.co.za
golaya.pw
golden-catalog.pro
goodhumor24.com
gotorussia.com
gourcy.altervista.org
gpms.org.my
greenshop.su
growboxbl.ru growboxbl.ru
habermetre.com gwagka.com
handicapvansarea.com gz2.bbsoldes.fr
hatedriveapart.com hao123.com
hdseriale.pl hasfun.com
hit-men.men hdpixent.com
hkdiiohi.skyrock.com hebr.myddns-flir.com
homedecoguide.info helpmymacfaster.trade
homik.pw hermesreplica.win
hoste.octopis.com highland-homes.com
hotcore.info highstairs-a.akamaihd.net
houseofgaga.ru homeinns.com
houston-vikings.com hornymatches.com
hoverboard360.at hotchatdate.com
howopen.ru hotenergy.ru
howtoclean.club hotloans.ru
hptwaakw.blog.fc2.com hotsocialz.com
huhn.altervista.org hut1.ru
humanelydrew.com i-service.kz
ideibiznesa2015.ru ideawheel.com
ihtec2019.org igadgetsworld.com
ilikevitaly.com ikritikimou.gr
images-free.net impisr.ru
import-sales.com inet-traffic.com
in-tandem.co inmate-locator.us
incep.imagine-ex.co instabid.tech
infektsii.com instasexyblog.com
intim-uslugi.info intermesh.net
invivo.hu intervsem.ru
iomoio.net investzalog.ru
iqoption.com iplusbit.blogspot.co.za
istizanidineanopiate.blogspot.com iqs.biz.ua
isotoner.com
itbc.kiev.ua
itch.io
itservicesthatworkforyou.com itservicesthatworkforyou.com
jackpotchances.com
janavibekken.no
japan-bearings.ru japan-bearings.ru
javrip.net javcoast.com
jjbabskoe.ru javstock.com
johnrobertsoninc.com jerseychinabizwholesale.com
junglenet-a.akamaihd.net jikoman.info
justbcause.com job.icivil.ir
kamorel.com kaliningrad.zrus.org
kchaxton.com kazka.ru
kemerovo.zrus.org kenaba.su
keywesthideaways.co
keywordglobal.co.za
keywordsking.com
keywordsuggest.org keywordsuggest.org
kinocccp.net kinotorka.ru
kinoflux.net kiskinhouse.com
kinohit1.ru ku6.com
kinozapas.com lalalove.ru
kladrus.ru larger.io
klejonka.info lashstudia.ru
kmd-pto.ru lecbter-relationships.ga
knogg.net ledpolice.ru
knowsitall.info lesbian.xyz
krasnodar.ru letmacwork.world
ks1234.com
kustanay.kz
labelwater.se
landoftracking.com
leftofcentrist.com
lerporn.info
lescinq.com
libertybilisim.com libertybilisim.com
linkarena.com likesuccess.com
linkbux.ru linkbux.ru
linkdebrideur.xyz lisque.batcave.net
liquimondo.com liver-chintai.org
loadingpages.me lob.com.ru
lottospring.com lollypopgaming.com
luchshie-topcasino.ru lomb.co
luciddiagnostics.in lonerangergames.com
m292.info lordzfilmz.me
mackeeper-center.club lostaruban.com
maglid.ru ltvperf.com
mail.allnews24.in mafcards.ru
malwareremovalcenter.com mainlinehobby.net
manipulyator-peterburg.ru maju.bluesalt.co
mansiondelrio.co malls.com
masserect.com mantramusic.ru
masterseek.com manuscript.su
matematikus.info maridan.com.ua
mcar.in.ua max-eclat.men
meddesk.ru mazda-roadsters.com
medicovi.com mediawhirl.net
medkritika.ru medictube.ru
meds-online24.com medmajor.ru
meetingrainstorm.bid mindbox.co.za
mega-bony-2017.pl
mexicosleevegastrectomy.com
milblueprint.com
minecraft-neo.ru minecraft-neo.ru
mobicover.com.ua minecraft-rus.org
mobifunapp.weebly.com minyetki.ru
mobplayer.net mixtapetorrent.com
moncleronline.xyz mlvc4zzw.space
montredemarque.nl mobsfun.net
moxo.com monclervests.xyz
mp3downloadhq.com moneyteam24.com
mp3ritm.top more-letom.ru
mrinsidesales.com moz.com
mrlmedia.net mriyadh.com
muztops.ru mrpornogratis.xxx
myanyone.net mural.co
musicstock.me
mybackgroundlandscape.blogspot.com mybackgroundlandscape.blogspot.com
mypornfree.ru myprintscreen.com
myxdate.info myseoconsultant.com
naperehresti.info
naphukete.ru naphukete.ru
netfacet.net narkologiya-belgorod.ru
new-apps.ru narutonaruto.ru
nationalbreakdown.com
networkad.net
new7ob.com new7ob.com
nextconseil.com newfilmsonline.ru
nicefloor.co.uk newsperuse.com
nisuturnetdgu.tk niki-mlt.ru
njkmznnb.ru no-rx.info
noclegonline.info
nofreezingmac.click
nonameread45.live nonameread45.live
notasprensa.info northfacestore.online
notfastfood.ru noscrapleftbehind.co
novodigs.com novodigs.com
novosti-hi-tech.ru novosibirsk.xrus.org
nowtorrents.com offtopic.biz
nzfilecloud.weebly.com oivcvx.website
oballergiya.ru okeinfo.online
oda.as
oddamzadarmo.eu
ohmyrings.com
onclkads.com onclkads.com
oneclickfiles.com online-sbank.ru
online-hit.info onlinebay.ru
online-x.ru optibuymac.com
onlineporno.site optikremont.ru
ontargetseo.us optom-deshevo.ru
ooo-olni.ru ossmalta.com
ooomeru.ru ozoz.it
openlibrary.org paleohub.info
ororodnik.goodbb.ru panamaforbeginners.com
ourtherapy.ru parajumpersjakkesalgnorge.info
panchro.xyz parfusale.se
parlament.biz
partnerline.men partnerline.men
pathwhelp.org pelfind.me
perso.wanadoo.es perederni.net
petedrummond.com perfectpracticeweb.com
photostudiolightings.com pics-group.com
pic2fly.com picturesify.com
picquery.com
picsforkeywordsuggestion.com
pictures-and-images.com
picurams.pw
pinapchik.com
pisanieprac.info
plastgranar.nu plastgranar.nu
plugingeorgia.com playmsn.com
pochemychka.net plohaya-kreditnaya-istoriya.ru
podshipniki-nsk.ru podshipniki-ntn.ru
pornhub-forum.ga pokemongooo.ml
pornhubforum.tk pornoelita.info
pornotubs.com pornokajf.com
prlog.ru pornoted.com
professionalwritingservices15.blogspot.ru powc.r.ca.d.sendibm2.com
profit-opportunity.com powenlite24.ru
progonrumarket.ru powitania.pl
projefrio.com.br prchecker.info
proxyradar.com priceg.com
psvita.ru prizesbook.online
quebec-bin.com promoforum.ru
rank-checker.online prosmibank.ru
rankscanner.com purchasepillsnorx.com
rcpmda.ikan1080.xyz randki-sex.com
realizmobi.com ranksignals.com
rebrand.ly razorweb-a.akamaihd.net
rebuildermedical.com registry-cleaner.net
recipedays.ru rent2spb.ru
refererx.com restorator-msk.ru
rentehno.ru rn-to-bsn.com
reyel1985.webnode.fr rocketchange.ru
rimedia.org
rospromtest.ru rospromtest.ru
rossanasaavedra.net royalads.net
rossmark.ru rubanners.com
royal-investments.net ruex.org.ua
royalcar-ufa.ru ruscoininvest.company
russian-postindex.ru russian-postindex.ru
sack.net rutor.group
sanyuprojects.com s8-nowy-wygraj.comli.com
sarahmilne.top sale-japan.com
savefrom.com sarafangel.ru
saveindex.xyz sardinie.us
sbprabooks.com saugatuck.com
sbricur.com sc-specialhost.com
scanmarine.info sdsjweb.com
schlampen-treffen.com searchinquire.com
schoolfiles.net seemoreresultshu-a.akamaihd.net
sdelai-prosto.ru seeresultshub-a.akamaihd.net
search-error.com seocheki.net
searchwebknow-a.akamaihd.net seryeznie-znakomstva.ru
seobility.net sexkontakteao.info
seoboxes.com sexkrasivo.net
seoholding.com sexvideo-sex.com
seomarketings.online sexyteens.hol.es
sergiorossistore.online shillyourcoins.com
serptehnika.ru sibdevice.ru
sexad.net sibecoprom.ru
sexflirtbook.com sirpornogratis.xxx
sextracker.be site-speed-checker.site
shmetall.com.ua site5.com
shopcheermakeup.info siteexpress.co.il
shoplvlv.us sklad-24.ru
sientalyric.co skuteczna-dieta.co.pl
silverage.ru smart-balancewheel.com
sitevalued.com soblaznu.net
skylta.com social-search.me
slavia.info softlinesolutions.me
social-buttons.com solicita.info
social-s-hhh.xyz spbchampionat.ru
spamnuker.com spidtest.space
speechfoodie.com spyfu.com
spravka130.ru spywareit.com
spy-app.info stal-rulon.ru
spywarenuker.com starpages.net
stefanbakosab.se streetfire.net
stopnarco.ru sukarame.net
strongholdsb.ru supermesta.ru
suchenindeutschland.com
summerlinhomes411.info
superinterstitial.com
superoboi.com.ua
superstarfloraluk.com superstarfloraluk.com
swinger-mobil.net supervesti.ru
tattooha.com swiped.su
tds-advert002.info
tds-advert005.info tds-advert005.info
telefonsexsofort.tk tedy.su
terraclicks.com terrafootwear.us
thaisamkok.com texbaza.by
thefarmergame.com thefds.net
thexart.club thegalerie.eu
tizanidinedruginteractions.blogspot.com thfox.com
tizanidinehcl4mgtab.blogspot.com tiandeural.ru
tizanidineingredients.blogspot.com ticketsys.inetwd.com
tizanidinevscyclobenzaprine.blogspot.com titan-ads.life
tootoo.to tizanidine4mg.blogspot.com
tizanidinecost.blogspot.com
tizanidineonline.blogspot.com
tizanidinerestlesslegsyndrome.blogspot.com
tomck.com
toondinsey.com
top-karkas.ru
top10-online-games.com top10-online-games.com
topsiteminecraft.com topappspro.com
torrents.cd toproadrunner5.info
trafficstars.com tour-line.net
traffpartners.com tozup.com
tramadolandtizanidine.blogspot.com traderzplanet.in
ttrraacckkrr.com trafficshaper.com
twittruth.com trailer.cinemaflix.website
twu.com.ua triumf-realty.ru
u17795.netangels.ru truck-rece.life
u555u.info trudogolik.net
uhodzalijami.ru tsan.net
umityangin.net turvgori.ru
unimodemhalfduplefw.pen.io tvoystartup.ru
urengoy.pro tx41tclega.ru
tytoona.com
udayavani.com
uptimebot.net
urlcut.ru
urlopener.com urlopener.com
urzedowski.eu usacasino.com
usbggettwku.ga usiad.net
valoresito.com v-doc.co
vancleefreplica.pw vbtracker.net
vektorpress.ru velen.io
video-woman.com venta-prom.ru
videojam.tv videochat.world
videtubs.pl videooko.weebly.com
viktoria-center.ru visionwell.com.cn
vksex.ru vltai.com
voloslove.ru voloslove.ru
vonradio.com vvon.co.uk
vpnhowto.info vzlomfb.com
vuclip.com wait3sec.org
vzlom-na-zakaz.com walkme.com
vzube.com webix.biz
w-journal.ru weblibrary.win
wanker.us webmasterhome.cn
web-analytics.date website-stealer.nufaq.com
whengirlsgowild.com weburlopener.com
wikes.20fr.com wedding-salon.net
winner7777.net wedding0venues.tk
winwotgold.pl welck.octopis.com
wordpresscore.com whipme.yopoint.in
world-mmo.com wieseversa.no
writingservices17.blogspot.ru word-vorlagen.net
wsgames.ru worldis.me
www.bookmaker-bets.com wrona.it
www.souvenirua.com wurr.voila.net
www.wohnkabinen-shop.de www.888.com
x-mix.info www.kabbalah-red-bracelets.com
xclicks.net wygraj-teraz.com
xcombear.ru xep.info
xedserver.com xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xn--80aafb2a.xn--p1ai
xn--d1abj0abs9d.in.ua
xn--hxazdsfy.blogspot.com xn--hxazdsfy.blogspot.com
xn--lifehacer-1rb.com xsfetish.org
xtube.com xxx-treker.ru
xxxtube69.com xxxguitars.com
yaaknaa.info yellowfootprints.com
yellowproxy.net youjizz.com
youandcredit.ru your-bearings.com
youradulthosting.com yousense.info
zeleznobeton.ru yun56.co
znaniyapolza.ru zetmaster.ru
zona-aqua.ru zhacker.net
zrizvtrnpale.tk zojirushi-products.ru
zverokruh-shop.cz

490
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1008.su 03e.info
123locker.com 08800.top
123movies.love 123kuma.com
2020iscoming.info 2pxg8bcf.top
2728fb936f0.com 4k-player.pl
28n2gl3wfyb0.ru 83net.jp
2girls1cup-free.com 8jn.dating-app.ru
3weekdiet.com adultfriendfinder.com
4replicawatch.net advancedmassagebysara.com
5forex.ru akusherok.ru
8xv8.com allproblog.com
adclickservice.com aloofly.com
afftrack001.com apartmentbay.ru
albuteroli.com apiallgeniusinfo-a.akamaihd.net
algarveglobal.com apimegabrowsebiz-a.akamaihd.net
alive-ua.com apple.com-webbrowsing-security.review
alkoravto.ru arclk.net
amanda-porn.ga arewater.com
amazon-adsystem.com artdestshop.eu
android4fun.org asiengirls.net
angkortours.vn autodo.info
anticrawler.org automatic-seo.com
arenda-yeisk.ru bcmp.org
artdeko.info beauty-things.com
asia-forum.ru best-seo-solution.com
autoplate.info best-way.men
avitocars.ru bikini-image.com
bablonow.ru biocn.dx.am
bad-stars.net bjanshee.ru
bagcionderlab.com blog-hits.com
beetpics.pw blogqpot.com
bestofpicture.com bnt-team.com
betterscooter.com bolegapakistan.com
bfz.biz brg8.com
bimmerpost.com btc4u.ru
bio-optomarket.ru buntube.net
bloggedporn.com buttons-for-website.com
bloggerads.net cand.jp
blogig.org candiceloves.us
brus.city capture-room.com
buqayy0.livejournal.com cartierbracelet.xyz
burkesales.com cb.iphantom.com
buypillsorderonline.com cdncash.com
cfacarrosserie74.com cdnnetwok.xyz
cialischmrx.com cenokos.ru
cleanallvirus.com centre-indigo.org.ua
clicksotrk.com centrumcoachingu.com
clothesforcash.com chelyabinsk.xrus.org
cocolyze.com coccoc.com
coin-hive.com codysbbq.com
com-cleaner.systems comeondog.info
compliance-jessica.top compliance-checker.info
compliance-josh.top confib.ifmo.ru
copypaste.traderzplanet.in contentsexpress.com
cosmetic.donna7753191.ru counter.yadro.ru
courtshipgift.com country-chic.ru
cscwtalkto.site credit-respect.ru
cutt.us customerpromos-a.akamaihd.net
dandiyabeats.in czat.wp.pl
datsun-do.com ddpills.com
detsky-nabytek.info dekorkeramik.ru
djonwatch.ru destinationrealestate.com
domination.ml dieswaene.com
easyshoppermac.com dinkolove.ya.ru
econom.co diusyawiga.tk
elektrozigaretten2.yn.lt djstools.com
emergencyneeds.org doctormakarova.ru
epicbrogaming.com dodlive.mil
evogarage.com easync.io
exchangeit.gq edge.sharethis.com
excitacao.com ekaterinburg.xrus.org
excitacion.info ekspertmed.com
exoneration-project.us electro-prom.com
f-online.de elektrozigarettekaufen1.devhub.com
familyholiday.ml erotag.com
famix.xyz erotiktreff24.info
filesdatabase.net eshop4u.jp
filmbokep69.com europeanwatches.ru
firma-legion.ru exmasters.com
ezigarettenkaufen1.deviantart.com
f5mtrack.com
fickkontakte.org
flex4launch.ru
flirt4free.com
fortunejack.com
free-deals.faith
free-traffic.xyz
freetangodownload.com
fugarif.ga fugarif.ga
fullgirl.ru getdot.ru
fusoradio.info getmyads24.com
gamblingnerd.com getoutofdebtfree.org
geile-lelly.eu girlsfuckdick.com
girlgamerdaily.com golden-praga.ru
glavtral.ru groupmoney.ru
googlemare.com guge.io
googlsucks.com gymi.name
goosefishpost.bid hidefiles.org
graphicwe.org
guardlink.org
gwhwpxbw.bloger.index.hr
habermetre.com
hanwei.us
havepussy.com
hdhc.ru
highspeed5.net
highstairs-a.akamaihd.net
hotdl.in
hoverboard360.nl
howtowhitenteethfast.xyz howtowhitenteethfast.xyz
inzn.ru ideibiznesa2015.ru
isistaylorporn.info ikritikimou.gr
isotoner.com imagecoolpub.com
jasonpartington.com imagerydatabase.com
imperia31.ru
in-tandem.co
itag.pw
javitas.info javitas.info
joyceblog.top jerseyswholesalechinalimited.com
kazinogames.lv journeydownthescale.info
ketoanhanoi.info juliaworld.net
kinosed.net jumptap.com
kvartira-sutochno.com kamen-e.ru
laptoper.net karachev-city.ru
law-check-nine.xyz katadhin.co
lazymanyoga.com kazrent.com
letto.by kellyonline.xyz
linksharingt.com kevblog.top
liveinternet.ru keywords-monitoring-success.com
lulea-auktionsverk.se kino-rating.ru
m292.info komp-pomosch.ru
macrotek.ru koral.se
mansparskats.com kvartiry-remont.ucoz.ru
mantramusic.ru ladsblue.com
maridan.com.ua languagecode.com
mearns-tractors.co.uk lenvred.org
medtherapy.ru letsart.ru
meteocast.net lincolntheatre.com
mindeyegames.com lineavabit.it
mnogabukaff.net linkrr.com
mobsfun.net linkwithin.com
moesexy.com lion.conboy.us
moesonce.com livingcanarias.com
moinozhki.com locimge.pw
mole.pluto.ro louboutinreplica.pw
monitorwebsitespeed.com lunamedia.co
moomi-daeri.com lunchrock.co
movies-in-theaters.net lyrics.home-task.com
mp3downloadhq.com m4ever.net
myhydros.org mac-shield.com
myphotopipe.com markjaybeefractal.com
mysexpics.ru massage-info.nl
naval.jislaaik.com mir-business-24.ru
nbsproject.ru mixx.com
nevansk.ru mmgq.ru
nightvision746.weebly.com mobot.site
odesproperty.com monetizer.com-01.site
ok-ua.info mrlmedia.net
optibuymac.com mturkcontent.com
parajumpersstore.online musicstock.me
pihl.se mygameplus.ru
pinkduck.ga na15.ru
platesauto.com nacap.ru
popup-jdh.xyz narkologiya-voronezh.ru
porno-transsexuals.ru new7ob.com
privatefx-in.ru nfljerseyscheapchinabiz.com
purchasepillsnorx.com okeinfo.online
puzo2arbuza.ru onclkads.com
qcstrtvt.bloger.index.hr onko-24.com
qwarckoine.com online-hd.pl
rabot.host.sk online7777.com
reklama1.ru onload.pw
remont-mobile-phones.ru origin-my.ru
retailwith.com ozoz.it
rogervivierforsale.com parfusale.se
rootandroid.org paydayloanslocal.com
rutor.group pcads.ru
s-iwantyou.com pictures-and-images.net
sammlungfotos.online pigrafix.at
saratov.xrus.org playmsn.com
sashagreyblog.ga pochtovyi-index.ru
sell-fb-group-here.com pokemon-go-play.online
servingnotice.com pons-presse.com
sexvporno.ru pornhub-ru.com
shoesonlinebuy.cn powitania.pl
shoesonlinebuy.xyz pregnant.guru
sinestesia.host.sk promover.org
slonechka.ru quick-offer.com
slowmac.tech raavidesigns.com
smart-scripts.com razorweb-a.akamaihd.net
snjack.info rcb101.ru
sobecjvuwa.com.ru remorcicomerciale.ro
softomix.net rimedia.org
solicita.info rn-to-bsn.com
songoo.wz.cz royal-investments.net
space2019.top rustic-quiver.win
space4updating.win sanatorrii.ru
sstroy44.ru scanner-andrew.top
startufa.ru scanner-julia.top
sterva.cc scanner-mary.top
stop-gepatit.te.ua scanner-willy.top
stpicks.com scmor.ilxc.cc
stroicol.net search-error.com
symphonyintegratedhealthcare.com search.alot.com
takeprofitsystem.com searchimage.co
template-kid.com seoheap.com
terraclicks.com sexkontakte-seite.com
thebluenoodle.com sexyali.com
thetoiletpaper.com shop-electron.ru
tjkckpytpnje.com shop.acim.org
tnaionline.org sientalyric.co
topcar-krasnodar.ru slavkokacunko.de
trion.od.ua smichovbike.cz
soheavyblog.com
songplanet.ru
spb.ru
steame.ru
superstarfloraluk.com
takeflyte.com
texbaza.by
tizanidine4mguses.blogspot.com
tizanidineinteractions.blogspot.com
tizanidineorflexeril.blogspot.com
top10registrycleaners.com
totu.us
traffic-club.info
trafficreceiver.club
truck-rece.life truck-rece.life
tsstcorpcddvdwshbbdriverfb.aircus.com tuckpointingmasonrysystems.com
tuckermktg.com tula.howotorg.ru
tvnewsclips.info turist-strani.ru
tvteleport.ru turvgori.ru
typimga.pw uptime-alpha.net
uac.net.au urccvfmc.bloger.index.hr
uhdtv.website valkiria-tk.ru
ultimateclassicrock.com vgoloveboli.net
usdx.us via-energy-order.com
v720hd.ru viagra-soft.ru
vapsy.com
vekzdorov.ru
vezuviy.su
video-woman.com
videochat.bz videochat.bz
videokrik.net videochat.cafe
vipms.ru videositename.com
viteonlusarezzo.it voloslove.ru
vykup-avto-krasnodar.ru vsdshnik.com
vzlomtw.com website-stealer.nufaq.com
vzubah.com wesharepics.site
w3javascript.com wheelchairliftsarea.com
waycash.net whiteelephantwellington.com
wdfdocando.com winner7777.net
wdrake.com www.labves.ru
webjam.com x-rates.ru
wiosenny-bon-1500.pl x-stars.ru
wleuaprpxuvr.ga xblog.in
www.event-tracking.com xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
x-mix.info xn--b1addnj3cah.xn--p1ai
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf yellowproxy.net
xn----9sbebi2bvzr7h.xn--p1ai yhit.press
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai yoursite.com
xn--b1agm2d.net zaimite.ru
xn--d1abj0abs9d.in.ua zatjmuzu.info
xtraffic.plus znakomstvaonlain.ru
xtremeeagles.net zoompegs.com
xxxmania.top
yachts-cruise.info
yellocloud.be
yellowstonevisitortours.com
youdesigner.kz
yourdesires.ru
zeroredirect12.com
zetgie.com.pl
zoodrawings.com
zverokruh-shop.cz
zynax.ua

27
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,16 +8,6 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>OCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -494,6 +484,13 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -584,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

12
dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,11 +1,21 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
ml><html> <html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.246 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2982 ### Version: V4.2022.03.2983
### Updated: Wed Mar 16 10:03:27 UTC 2022 ### Updated: Wed Mar 16 22:01:21 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2982 ### Version: V4.2022.03.2983
### Updated: Wed Mar 16 10:03:27 UTC 2022 ### Updated: Wed Mar 16 22:01:21 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##