vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 11:40:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.05.3078 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-05-01 10:09:21 +00:00
parent 335c61f0db
commit ec1bf7b3ed
47 changed files with 87906 additions and 87916 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3077 #### Version: V4.2022.05.3078
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3077 #### Version: V4.2022.05.3078
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3077 #### Version: V4.2022.05.3078
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10852
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3077 #### Version: V4.2022.05.3078
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10856
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10856
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10856
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10856
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 1; 10.1.0.21 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 0; 10.1.0.21 0;
127.0.0.1 0; 127.0.0.1 0;

10856
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 1; 10.1.0.21 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 0; 10.1.0.21 0;
127.0.0.1 0; 127.0.0.1 0;

10856
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 1; 10.1.0.21 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 0; 10.1.0.21 0;
127.0.0.1 0; 127.0.0.1 0;

10856
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3077 3078

10856
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10856
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.176.151.210 0; 20.245.49.2 0;

10856
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 1; 10.1.0.21 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 0; 10.1.0.21 0;
127.0.0.1 0; 127.0.0.1 0;

10856
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 1; 10.1.0.21 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 0; 10.1.0.21 0;
127.0.0.1 0; 127.0.0.1 0;

10856
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 1; 10.1.0.21 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 0; 10.1.0.21 0;
127.0.0.1 0; 127.0.0.1 0;

10856
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.176.151.210 0; 20.245.49.2 0;

10856
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.176.151.210 0; 20.245.49.2 0;

10856
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 1; 10.1.0.21 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Bullseye Black Hole
GridBot Cosmos
Minefield DnyzBot
NICErsPRO Gotit
OrangeBot Moblie Safari
Sqlmap NetLyzer
Tracemyfile Openvas
WWW::Mechanize Woobot
WebsiteExtractor Zeus
crawler4j trendiction.de

310
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404checker 404checker
80legs
AIBOT
ALittle Client ALittle Client
Abonti ASPSeek
Aboundexbot Acunetix
AfD-Verbotsverfahren AhrefsBot
Alligator Aipbot
Alexibot
Anarchie Anarchie
Anarchy Ankit
Apexoo Apexoo
Aspiegel Aspiegel
Asterias
Atomseobot
Attach Attach
AwarioRssBot BDFetch
BLEXBot BLEXBot
BackDoorBot
BackStreet
BacklinkCrawler BacklinkCrawler
Bandit
Barkrowler Barkrowler
Battleztar Bazinga
BetaBot BetaBot
Black Hole Bigfoot
Bitacle
Blackboard Blackboard
Blow Bolt
Brandwatch BotALot
Brandprotect
Buck
BuiltBotTough
BunnySlippers
CATExplorador
CCBot
CODE87 CODE87
Calculon Calculon
Cegbfeieh
CensysInspect CensysInspect
CheeseBot CheeseBot
ChinaClaw
Chlooe Chlooe
Claritybot Claritybot
Cliqzbot Cocolyzebot
Cogentbot Cogentbot
Copier
Copyscape
Cosmos Cosmos
CrazyWebCrawler Craftbot
Crescent Crescent
DTS Agent CrunchBot
Deusu Custo
Disco CyotekWebCopy
DSearch
Dirbuster
Discoverybot Discoverybot
DittoSpyder Dispatch
DnyzBot DomCopBot
Domains Project DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder Download Wonder
EMail Wolf ECCP/1.0
Ebingbong Exabot
EirGrabber ExtLinksBot
Extractor Extractor
Ezooms EyeNetIE
FDM FlashGet
Flunky Flunky
Fuzz Freeuploader
FrontPage
FyberSpider
Fyrebot
GT::WWW
GalaxyBot GalaxyBot
GetRight Genieo
Getintent GetWeb
Gigabot Go!Zilla
Go-Ahead-Got-It
GoZilla GoZilla
GrabNet
GrapeFX GrapeFX
GrapeshotCrawler HMView
HEADMasterSEO
HTTP::Lite
HTTrack
Haansoft
HaosouSpider HaosouSpider
Heritrix Harvest
HybridBot HonoluluBot
Humanlinks
IDBTE4M IDBTE4M
IDBot
IRLbot
Iblog
IlseBot
Image Fetch
Image Sucker Image Sucker
Intelliseek
InterGET
Internet Ninja
InternetSeer InternetSeer
Iria Iria
JamesBOT Iskanie
JennyBot JetCar
JikeSpider Jorgee
JustView JustView
Jyxobot Keyword Density
Kenjin Spider Kozmosbot
Kinza
LNSpiderguy LNSpiderguy
Lanshanbot Lanshanbot
Larbin Lftp
LeechFTP LinkScan
Lightspeedsystems Linkbot
LinkextractorPro LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
Litemage_walker MIIxpc
Lmspider
Ltx71
MIDown tool
MJ12bot MJ12bot
MSIECrawler MSIECrawler
MTRobot MTRobot
Mag-Net Magnet
Mail.RU_Bot
MarkMonitor
MarkWatch MarkWatch
Masscan Mass Downloader
MauiBot MauiBot
MeanPath Bot Mb2345Browser
Meanpathbot Meanpathbot
Mediatoolkitbot Mediatoolkitbot
Metauri Mozlila
Moblie Safari Mr.4x3
Mojeek Musobot
Mojolicious NPbot
MolokaiBot Nameprotect
Morfeus Fucking Scanner
Name Intelligence
Navroad Navroad
Needle NearSite
Net Vampire NetAnts
NetLyzer NetZIP
NetSpider Netcraft
Nettrack
Netvibes Netvibes
NextGenSearchBot
Nikto Nikto
Nmap Not
Nuclei Octopus
Offline Navigator OpenVAS
OpenLinkProfiler
Openfind Openfind
Openvas OrangeBot
OutclicksBot OrangeSpider
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageThing.com PageScorer
Pavuk Papa Foto
Petalbot Petalbot
Picscout Picscout
Picsearch
PictureFinder PictureFinder
ProWebWalker Piepmatz
Probethenet Pimonster
Pixray
Psbot Psbot
Pump Quick-Crawler
PxBroker RSSingBot
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex RankFlex
RankingBot
RankingBot2
Rankivabot Rankivabot
Re-re RankurBot
ReGet RebelMouse
RepoMonkey
Ripper Ripper
Rogerbot RocketCrawler
SBIder SBIder
SEOkicks SEOkicks
SEOkicks-Robot SEOlyticsCrawler
SEOstats
SISTRIX SISTRIX
ScanAlert SalesIntelligent
Scanbot
Screaming
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice SemanticJuice
SemrushBot Semrush
Snapbot SeobilityBot
SocialRankIOBot Siteimprove
Sociscraper
SpaceBison SpaceBison
SpankBot Spbot
Sqlworm Sqlworm
Steeler Sqworm
Sucuri
SuperBot SuperBot
SurveyBot SuperHTTP
Swiftbot Surfbot
Szukacz
T0PHackTeam
TeleportPro TeleportPro
Telesoft
Telesphoreo Telesphoreo
Telesphorep Thumbor
TheNomad
TightTwatBot TightTwatBot
Toweyabot
Trendictionbot Trendictionbot
True_Robot Turnitin
TwengaBot Twice
URLy Warning Upflow
V-BOT VB Project
Vacuum VCI
VeriCiteCrawler VeriCiteCrawler
VidibleScraper Virusdie
VoidEYE Voil
Voltron Voltron
WEBDAV WISENutbot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWW::Mechanize
WWWOFFLE
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD Web Auto
Web Collage Web Collage
Web Fetch Web Enhancer
Web Fuck Web Fuck
WebAuto
WebCollage
WebCopier
WebImageCollector
WebSauger WebSauger
WebFetch WebWhacker
WebGo IS WebZIP
WebLeacher Webalta
WebPix
WebSauger
Webshag Webshag
WebsiteExtractor WebsiteExtractor
WebsiteQuester Webster
Whack Who.is Bot
Whatweb
WiseGuys Robot WiseGuys Robot
Woobot
Wotbox Wotbox
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
YoudaoBot
Zade Zade
ZmEu Zeus
ZoominfoBot Zitebot
ZumBot ZumBot
adscanner archive.org_bot
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider autoemailspider
backlink-check
coccocbot coccocbot
cognitiveseo com.plumanalytics
crawler.feedback crawler.feedback
dataforseo.com crawler4j
evc-batch domainsproject.org
gopher gopher
internetVista monitor heritrix
ips-agent
isitwp.com isitwp.com
iubenda-radar iubenda-radar
magpie-crawler lwp-trivial
mediawords mediawords
muhstik-scan muhstik-scan
page scorer page scorer
pcBrowser plumanalytics
probe-image-size
ripz
scalaj-http
scan.lol
seobility
seocompany.store seocompany.store
seostar sexsearcher
siteripz spyfu
sp_auditbot sysscan
tAkeOut
trendiction.com trendiction.com
ubermetrics-technologies.com ubermetrics-technologies.com
webgains-bot webprosbot
webpros.com
x09Mozilla x09Mozilla
xpymep1.exe
zauba.io

310
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
404checker
ADmantX
ALittle Client ALittle Client
ASPSeek
Aboundexbot Aboundexbot
AfD-Verbotsverfahren
AiHitBot AiHitBot
Aipbot Alexibot
AllSubmitter AllSubmitter
Alligator
AlphaBot AlphaBot
Anarchy99 Anthill
Ankit Atomseobot
Asterias BBBike
BLEXBot BDCbot
BackStreet Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Badass Badass
Battleztar Bazinga BatchFTP
BetaBot
Bigfoot
Black Hole Black Hole
Blow
Bolt
Brandprotect Brandprotect
Brandwatch BunnySlippers
BuiltWith CATExplorador
CCBot Calculon
CODE87 CheTeam
CSHttp Claritybot
CensysInspect Cliqzbot
CheeseBot
Chlooe
Citoid
Cloud mapping Cloud mapping
Cocolyzebot Copier
Cogentbot Copyscape
CopyRightCheck DIIbot
Cosmos
Crescent
CrunchBot
Custo
DSearch DSearch
Disco DataCha0s
Deusu
Dispatch Dispatch
DittoSpyder DnBCrawler-Analytics
DomainStatsBot DomainAppender
Domains Project DomainCrawler
Dotbot Dragonfly
Download Wonder EMail Wolf
EasyDL
Ebingbong Ebingbong
EirGrabber EirGrabber
EroCrawler EroCrawler
Extractor Express WebPictures
ExtLinksBot
Extreme Picture Finder Extreme Picture Finder
FHscan FHscan
FemtosearchBot
Fimap Fimap
Firefox/7.0 Fuzz
FrontPage GermCrawler
FyberSpider
GetRight GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX GrapeFX
GridBot GridBot
Haansoft HTTrack
HaosouSpider Heritrix
Harvest
HonoluluBot HonoluluBot
Humanlinks Humanlinks
HybridBot HybridBot
IDBTE4M
IDBot IDBot
Iblog
Id-search
IlseBot IlseBot
Image Fetch Image Fetch
IndeedBot IndeedBot
Indy Library
InfoNaviRobot InfoNaviRobot
InterGET IstellaBot
Iria JOC Web Spider
Iskanie
JamesBOT JamesBOT
JennyBot
Jetty Jetty
JikeSpider
Joomla
Jorgee Jorgee
JustView Kenjin Spider
Jyxobot LWP::Simple
Kozmosbot
LeechFTP LeechFTP
LexiBot Lftp
Lightspeedsystems LieBaoFast
Likse LinkScan
LinksManager LinkWalker
LinqiaRSSBot Linkbot
LinkextractorPro
LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
Litemage_walker
Ltx71 Ltx71
MIDown tool MFC_Tear_Sample
MJ12bot MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler MSIECrawler
MTRobot Magnet
Majestic12 Majestic12
MarkMonitor
MarkWatch MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
Mediatoolkitbot Mediatoolkitbot
MicroMessenger Metauri
Microsoft URL Control
Minefield Minefield
Mister PiX Mister PiX
Mojeek
Mojolicious
MolokaiBot MolokaiBot
Mozlila Morfeus Fucking Scanner
Msrabot
Musobot
NICErsPRO
Name Intelligence Name Intelligence
Navroad
Needle
Nessus Nessus
Net Vampire NetAnts
NetLyzer NetSpider
NextGenSearchBot NetZIP
Netcraft
Nettrack
Netvibes
Nibbler Nibbler
Nikto Niki-bot
Ninja Nimbostratus
Nuclei
Nutch Nutch
Offline Explorer Offline Explorer
OnCrawl
OpenLinkProfiler
OrangeBot OrangeBot
OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP PageAnalyzer
PageGrabber PageGrabber
PageScorer
PageThing.com
Pandalytics
Panscient
Pi-Monster Pi-Monster
Picsearch Picscout
PictureFinder
Piepmatz
Pockey Pockey
ProWebWalker Psbot
PxBroker PxBroker
PyCurl
RSSingBot RSSingBot
RankFlex RankActive
Reaper RankurBot
RedesScrapy Ripper
RocketCrawler RocketCrawler
SEOlyticsCrawler SEOkicks-Robot
SEOprofiler SEOstats
SalesIntelligent SMTBot
ScoutJet ScanAlert
Scrapy Scanbot
Screaming Screaming
ScrepyBot
Searchestate Searchestate
Semrush SentiBot
SemrushBot SeobilityBot
SeoSiteCheckup Seomoz
SiteCheckerBotCrawler Siphon
SiteExplorer Site Sucker
SiteLockSpider SlySearch
Siteimprove Snoopy
Sitevigil Sosospider
Snapbot SpaceBison
SocialRankIOBot Spanner
Sogou web spider Spbot
SpankBot Sqlworm
Spinn3r Sucker
Sqworm
SuperBot SuperBot
SurveyBot Surfbot
Suzuran Suzuran
Swiftbot
T0PHackTeam T0PHackTeam
T8Abot T8Abot
Teleport
Telesoft Telesoft
Telesphoreo The Intraformant
TheNomad
TightTwatBot
Tracemyfile Tracemyfile
Trendiction True_Robot
Turingos
Turnitin Turnitin
TurnitinBot TurnitinBot
Upflow TwengaBot
VCI Typhoeus
UnisterBot
Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper Virusdie
VoidEYE VoidEYE
Voltron Voil
WASALive-Bot WPScan
WEBDAV WWW-Mechanize
WISENutbot Wallpapers
WWW::Mechanize WallpapersHD
WWWOFFLE WeSEE
Web Auto
Web Collage Web Collage
Web Fuck
WebCopier
Web Enhancer Web Enhancer
Web Sauger
Web Sucker
WebBandit
WebCollage
WebCopier
WebFetch WebFetch
WebFuck WebPix
WebReaper WebReaper
WebSauger WebSauger
WebWhacker WebStripper
WebSucker
WebZIP WebZIP
Webalta Webalta
Webshag WebmasterWorldForumBot
Website Quester WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster Webster
Whacker Who.is Bot
WinHTTrack Widow
WiseGuys Robot
Woobot Woobot
Wprecon
Xaldon WebSpider
Xenu
Zauba Zauba
Zermelo ZumBot
Zeus adscanner
ZoomBot cah.io.community
archive.org_bot
arquivo.pt
check1.exe check1.exe
clark-crawler
coccocbot
cognitiveseo cognitiveseo
com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler4j
dataforseo.com demandbase-bot
eCatch
facebookscraper
gopher
heritrix heritrix
instabid
internetVista monitor internetVista monitor
ips-agent iubenda-radar
isitwp.com
linkdexbot linkdexbot
lwp-request lwp-trivial
page scorer magpie-crawler
pcBrowser meanpathbot
probe-image-size mediawords
muhstik-scan
netEstate NE Crawler
oBot
ripz ripz
s1z.ru
scalaj-http scalaj-http
scan.lol
seostar seostar
serpstatbot sexsearcher
spyfu sitechecker.pro
tAkeOut tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com voyagerx.com
webmeup-crawler
webprosbot webprosbot
x09Mozilla xpymep1.exe
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
callawaygolfoutlet.online germes-trans.com
celebsopics.com impresagaia.it
ecxtracking.com keyhantercume.com
electricwheelchairsarea.com keywordsuggest.org
help.tpu.ru kostenlos-sexvideos.com
hermesbracelets.xyz labelwater.se
lifehacĸer.com lider-zhaluzi.kiev.ua
m5home.ru segol.tv
paydayonlinecom.com tiandeural.ru
softlinesolutions.me znakomstvaonlain.ru

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03e.info 007angels.com
0n-line.tv 00it.com
10bet.com 01apple.com
123locker.com 123kuma.com
214jaluwobapef.cf 1688.com
24videos.tv 1bet.com
4rent.ru 1pamm.ru
4ur.click 202ch.com
5-steps-to-start-business.com 273-fz.ru
5tey7463.weebly.com 2drittel.de
7yue.org 4ureyesonly.com
aa08daf7e13b6345e09e92f771507fa5f4.com 7search.com
abiente.ru a.frcls.fr
absolute-s.ru aac52006ec82a24e08b665f4db2b5013f7.com
adclickthru.net abctoppictures.net
adf.ly abwa.tk
adktrailmap.com activecampaign.dreamhosters.com
admitad.com adclickservice.com
affordablewebsitesandmobileapps.com adimmix.com
afmuseum.com admatic.com.tr
ahmedabadwebs.com adminshop.com
ahrefs.com adrenalin-stk.ru
ads-seo.men
adultfriendfinder.com
adverster.com
air-edem.ru air-edem.ru
aksonural.ru akama.com
alekseevec.ru alldubai.biz
alpharma.net allkrim.com
alta-realestate.com amigobulls.com
anonymous-redirect.com amoi.tn
amung.us
analnoeporno.tv
anatomiy.com
anniemation.com
apartamentwroclaw.eu apartamentwroclaw.eu
apiwoodensealcom-a.akamaihd.net appiq.mobi
appfixing.space arabsexxxtube.com
aproposde.com arquapetrarca.info
aramaicmedia.org aruplighting.com
arcteryxstore.online asophoto.com
arendatora.ru asrv-a.akamaihd.net
arendovalka.xyz asrv-a.akamoihd.net
arraty.altervista.org atout-energie-69.com
astrochicks.com autolombard-krasnodar.ru
australia-opening-times.com availit.weebly.com
auto4style.ru
automobile-spec.com
aversis.net aversis.net
azartmsl.com azazu.ru
bag77.ru b-styles.xyz
baladur.ru babs.com.ua
balook.com bala.getenjoyment.net
banki76.ru banan.tv
bannerbank.ru bankiem.pl
bannerspace.com bannerconnect.net
bard-real.com.ua basedecor.ru
beatifullandscape.co bavsac.com
beauty-b0x.pl best-businessman.ru
bedandbreakfast.com best-way.men
bestadbid.com bestchoice.cf
besthoro.ru bestpriceninja.com
bestplacetobuyeriacta.jw.lt binomo.com
bestserials.com
biglistofwebsites.com
binomo.kz
bio-market.kz bio-market.kz
bio-optomarket.ru bitnote.co
bizlist.com.de bjanshee.ru
bizzliving.com blackwitchcraft.ru
bjetjt.com boanonihaca.tk
blpmovies.com boeuklad.com
bolegapakistan.com bolezniorganov.ru
bonanza-fortune.men bonky.biz
brains2.biz bonzibuddi.com
bristolhostel.com bosman.pluto.ro
brandbucket.com
brus-vsem.ru brus-vsem.ru
buscarfoto.com buckspar.gq
cactussoft.biz buigas.00it.com
builtwith.com
bumascloset.com
bus-offer.com
businescoop.men
buttons-for-website.com
buyfriend.ru
buynorxx.com
buytizanidineonline.blogspot.com
c1.onedmp.com
calcularpagerank.com
californianews.cf
callawaygolfstore.online
cam-kontakte.org cam-kontakte.org
capacitacionyaprendizaje.com cannibalcheerleader.com
carsdined.org carapics.com
cartechnic.ru
cartierlovebracelet.xyz cartierlovebracelet.xyz
casablancamanor.co.za
cashonads.com
cdncash.net cdncash.net
cenokos.ru cenoval.ru
censys.io cgi2.nintendo.co.jp
cfjump.com cialischmrx.com
cheapbarbour.online clayvasedesigns.tk
check-this-out-now.online cleanpcnow.com
chelnytruck.ru coin-hive.com
christianlouboutinoutlet.win colobit.biz
cleanallvirus.com compliance-ivan.xyz
clickbanksites.info compliance-willy.top
clickcash.com connectionstrenth.com
clipartnew.com construmac.com.mx
community.allhiphop.com coolgamechannel.com
compliance-checker-7.info coolyarddecorations.com
compliance-donald.xyz cosmeticswomens-womensports.rhcloud.com
compliance-george.top crirussian.ru
confib.ifmo.ru culad.com
contextualyield.com custom-electric-guitar.com
cougfan.info customchocolate.business-for-home.com
counter.bloke.com cymbaltaandtizanidine.blogspot.com
covetnica.com daneshetabiat.com
crackguru.tk daretodonate.co
crazyboost.pro de.zapmeta.com
cyse.tk deanmoore.ie
dairyindia.in dekoration.us
danashop.ru dengi-pod-zalog-nedvizhimosti.ru
delitime.info detalizaciya-tut.biz
detective01.ru dfiles.me
detmebel.su dieswaene.com
digitalassetmanagement.site
diminishedvalueoforegon.com diminishedvalueoforegon.com
div.as dipstar.org
dktr.ru documentbase.net
dmmspy.com domain-submit.info
dnepropetrovsk.mistr-x.org domaincdn.xyz
documentsite.net
dojki-hd.com
domaincrawler.com domaincrawler.com
dood.live domainsatcost.com
doska-vsem.ru drugs-no-rx.info
downloaddy.net
dpihatinh.gov.vn
drugstoreforyou.com
dvrlists.com dvrlists.com
dyshagi.ru e-poker-2005.com
eduserver.net emailaccountlogin.co
elektrischezigarettekaufen2.cowblog.fr eonpal.com
enthuse.computernetworksonline.com eropho.com
ertelecom.ru event-tracking.com
euroskat.ru evidencecleanergold.com
evaashop.ru exchangeit.gq
evehemming.blogspot.com.au exchanges-bet.com
expertnaya-ocenka.ru exmasters.com
expresstoplivo.ru expertblog.info
extremez.net eyes-on-you.ga
extstat.com ezigarettekaufen2.mpbloggar.se
eyemagination.com falcoware.com
ezigarettekaufen1.hpage.com fatfasts-4tmz.com
f-loaded.de fefo.gdn
fakehandbags.xyz fetishinside.com
faptitans.com fifa-coins.online
feel-planet.com findpics.pw
femdom.twiclub.in firstsiteguide.com
fickenprivat.info fishtauto.ru
findpik.com fiuxy.com
fodelsedagspresenter.nu flashbannernow.com
food.dtu.dk florida-tourism.net
forex-procto.ru fm-upgrade.ru
forumprofi.de forum69.info
forums.toucharcade.com fototravel.eu
fr.netlog.com fr.netlog.com
free-gluten.ru free411games.com
free-traffic.xyz freetangodownload.com
freelinkbuilding.website.tk fres-news.com
freemags.cc frvo.alptandem.ru
freenom.link
freza-sverlo.ru
front.to
frustrated-favorable.gq
fuck-paid-share-buttons.xyz fuck-paid-share-buttons.xyz
fungamelands.com fuckingawesome.com
gallery.rennlist.com funnel.co.za
gamerscorps.com gamedayassist.com
gdzkurokam.ru gameonasia.com
gepezz.info gamezblox.com
ggiaro.com gaypornmovie.net
ghazel.ru gelezki.com
gheus.altervista.org gerhardhealer.com
gk-atlant.info gilsonchiro.xyz
globatur.ru girlsatgames.ru
globetrotting-culture.ru given2.com
glopages.ru glastecfilms.com.my
gok-kasten.net glavprofit.ru
googleseo.com.tr go2jump.org
grand-chlen.ru googst2.ru
graphics8.info greatdealshop.com
graphid.com grtyi.com
greatfind-a.akamaihd.net gsasearchengineranker.space
green-tea.tv gsou.cf
gsasearchengineranker.pw guidefs.ru
gsmtlf.ru guildebzh.info
guge.io gwebtools.com.br
gunsvicceadadebt.tk haikuware.com
guod.me
handicapbathtubarea.com handicapbathtubarea.com
healgastro.com harmonyglen.us
healing-dysplasia.ru hdpixent.com
helpmymacfaster.trade hdwallpapers-free.com
hentai-manga.porn headpress.ru
hermesbirkinhandbagoutlets.com healbio.ru
high-speed1.net help.tpu.ru
hitmuzik.ru hexpilot.com
hostingclub.lk himazin.info
housediz.com hobbyhuren-datenbank.com
huimin764128.com hotloans.ru
hulfingtonpost.com hspline.com
id-forex.com hybrid.ru
ifmo.ru ihc2015.info
igtools.club iideaidekonkatu.info
iinstalll-fii1leis.jus0wil.pp.ua
ikritikimou.gr
imagui.eu
imgarit.pw imgarit.pw
indetiske.ya.ru inboundlinks.win
infobanks.ru indo-export.ru
infospot.pt inet-traffic.com
integritylandscapeservices.com
intellekt21.ru
interesnie-faktu.ru interesnie-faktu.ru
intermesh.net
investpamm.ru
ipostroika.ru ipostroika.ru
iqoption-bin.com iqupdatetmz.win
isoveti.ru
istizanidineanarcoticdrug.blogspot.com istizanidineanarcoticdrug.blogspot.com
itbc.kiev.ua ivanovo.zrus.org
itservicesthatworkforyou.com ivearchenceinflu.cf
janettabridal.com jabimgo.pw
jasonpartington.com jacago.com
joessmogtestonly.com jav-fetish.site
jyvopys.com jav-way.site
javrip.net
javstock.com
jeremyeaton.co
jetsli.de
journeydownthescale.info
juliadiets.com
jurajskie.info
justprofit.xyz
jwss.cc
kambasoft.com kambasoft.com
kamen-e.ru kamen-e.ru
kchaxton.com karusel-market.ru
keywordhut.com kazinogames.lv
keywords-monitoring-success.com keenoutlet.online
kfon.eu kellyonline.xyz
kicknights.gq kinoflux.net
kihi.gdn kinoplen.ru
kinky-fetishes.com kiprinform.com
kinostorm.net klin3952.ru
kskjco.club kollesa.ru
lafriore.ru krasnodar.ru
lapolis.it kreativperlen.ch
laserpen.club kriokomora.info
laudit.ru ktotut.net
lawyers.cafe kurbappeal.info
lawyersinfo.org kvartir-remont.biz
leadn.pl landscaping.center
lennatin.info legalrc.biz
lenvred.org lernur.net
letslowbefast.today lexiangwan.com
lion.conboy.us lightinghomes.net
lion.misba.us lignofix.ua
lion.snapmap.us lineshops.biz
littlesunraiser.com linkarena.com
lonfon.xyz liquimondo.com
livejasmin.com
lombardfinder.ru
lonely-mature.com
lostaruban.com
lsp-awak-perikanan.com
luckyday.world luckyday.world
m-google.xyz macdamaged.tech
m1media.net magicalfind-a.akamaihd.net
m4ever.net mall.uk
mafcards.ru mansparskats.com
magda-gadalka.ru mantramusic.ru
mazda-roadsters.com matb3aa.com
mcnamaratech.com matsdale.com
mebel-vstroika.ru mbiologi.ru
mecash.ru mecash.ru
medmajor.ru meccadumps.net
meet-flirt-dating.com med-zdorovie.com.ua
michellblog.online medispainstitute.com.au
mikozstop.com megavolt.net.ua
militarysale.pro misswell.net
minharevisao.com mixx.com
miniads.ca mncrftpcs.com
minneapoliscopiers.com mobilemedia.md
mirobuvi.com.ua mobstarr.com
misterjtbarbers.com modnie-futbolki.net
mobifunapp.weebly.com mole.pluto.ro
moetomnenie.com monclerjacketsoutlet.pw
mokrayakiska.com mostantikor.ru
monarhs.info mozello.ru
monetizer.com-01.site mulberryoutletonlineeu.com
morf.snn.gr
muschisexbilder.com muschisexbilder.com
musicspire.online musicspire.online
mybinaryoptionsrobot.com muz-baza.net
mydoctorok.ru my-floor.in.ua
myhitmp3.club myliveblog.ru
myonigroup.com mymercy.info
mzdish.site myperiod.club
naphukete.ru namenectar.com
naturtreenspicerx.pw naperehresti.info
nevansk.ru net-radar.com
new-post.tk netallergy.ru
nightvision746.weebly.com networkcheck.xyz
nodding-passion.tk newyorkhotelsmotels.info
novatech.vn nonews.co
nucia.biz.ly nvssf.com
obiavo.by oakleyglassesonline.us
oneclickfiles.com obiavo.in
onlinewritingjobs17.blogspot.ru odoratus.net
ons-add.men of-ireland.info
ooo-gotovie.ru ofanda.com
ostrovtaxi.ru offers.bycontext.com
ourtherapy.ru ohmyrings.com
ourville.info okroshki.ru
paccohichetoti.ml okuos.com
partner-host.men online-podarki.com
partner-pop.men online-zaymy.ru
pertlocogasilk.tk onlineku.com
pic-re.blogspot.com onthemarch.co
picquery.com ops.picscout.com
pics-group.com orion-code-access.net
pierrehardysale.online osnova3.ru
pinwallpaper.top ossmalta.com
pistonclasico.com page2rss.com
paphoselectricianandplumber.com
paydayloanslocal.com
pc-test.net
pcboa.se
pictures-and-images.net
picturesboss.com
piluli.info
pintattoos.com
piski.top
pix24x7.com
pl-vouchers.com
platesauto.com platesauto.com
platezhka.net poem-paying.gq
plusnetwork.com
podshipniki-ntn.ru
poisk-zakona.ru
pokemongooo.ml
porno-dojki.net porno-dojki.net
pornodojd.ru pornosee.info
pornohub.me pricheskaonline.ru
pornoplen.com privatbank46.ru
pornpost.in
porodasobak.net
powenlite24.ru
prefersurvey.net
printingpeach.com
privetsochi.ru privetsochi.ru
proftests.net prodess.ru
prohoster.info productarium.com
projefrio.com.br prosmibank.ru
promgirldresses.xyz prospekt-st.ru
proprostatit.com prostitutki-almata.org
pshare.biz push-ad.com
putitin.me pussyfleet.com
pwwysydh.com qor360.com
qwarckoine.com quickcashlimited.com
r-control.ru r-e-f-e-r-e-r.com
rapidsites.pro
razamicroelectronics.com
realitykings.com realitykings.com
realting-moscow.ru reeyanaturopathy.com
redirect.trafficreceiver.club regdefense.com
relatodelpresente.com.ar relax.ru
remorcicomerciale.ro remedyotc.com
renhacklids.tk remontgruzovik.ru
rep-am.com rennlist.com
retailwith.com richinvestmonitor.com
rfd-split.hr robertefuller.com
roleforum.ru rockma.se
rozalli.com rome2rio.com
rumamba.com royal-betting.net
rus-teh.narod.ru ruscopybook.com
rustic-quiver.win sa-live.com
sady-urala.ru sabaapress.com
sajatvelemeny.com salutmontreal.com
samo-soznanie.ru sayyoethe.blogspot.co.za
sarahmilne.top scanhub.ru
saratov.xrus.org scanner-andrew.top
sarf3omlat.com scanner-viktor.top
savefrom.com
scanner-george.top
scanner-jess.top
scanner-jessica.top
scenicmissouri.us
school-diplomat.ru school-diplomat.ru
search-error.com searchwebknow-a.akamaihd.net
searchencrypt.com seinterface.com
searchimpression.com seoheap.com
searchinquire.com seorankinglinks.us
secretscook.ru seorankinglinks.xyz
seoanalyses.com service.adtech.us
seofirmreviewsus.info serviporno.com
seogadget.ru sexspornotub.com
seojokes.net shlyahten.ru
seokicks.de si-unique.com
sex-dating.co sibvitr.ru
sexcamamateurchat.com simple-image.com.ua
sexkontakteao.info sitebeam.net
sexphoto.site siteimprove.com
sexstream.pl
sextracker.com
share-buttons-for-free.com
sharebutton.to
shemalegalls.blogporn.in
shikiso.info
shiksabd.com
shohanb.com
sientalyric.co
siha.de
sinestesia.host.sk
sixcooler.de
sizeplus.work
sk.golden-praga.ru
skutecznetabletkinaporostwlosow.pl skutecznetabletkinaporostwlosow.pl
skylta.com smartadserver.com
smallseotools.com snowplanes.com
snip.to snworks.com
snjack.info social-s-ggg.xyz
snyatie-lomki-v-stacionare.ru social-s-hhh.xyz
social-buttons.xyz socialmonkee.com
socialseet.ru sortthemesitesby.com
socialtrade.biz sosdepotdebilan.com
soserfis.com sovinsteel.ru
soviet-portal.do.am spinazdrav.ru
spb-plitka.ru spitfiremusic.com
spin2016.cf spravka130.ru
spy-app.info spy-sts.com
spywarenuker.com spywarenuker.com
stairliftsarea.com stairliftsarea.com
standardchartered-forex.com stariy-baku.com
stats-public.grammarly.io starpages.net
stickers-market.ru stathat.com
stroiminsk.org stats-collector.org
stroymonolit.su sterva.cc
sugarlyflex.pw stevemonsen.com
sukirgenk.dvrlists.com stoki.ru
sundrugstore.com stopnarco.ru
svetodiodoff.ru store-rx.com
sweepstakes.rewardit.com susanholtphotography.com
suture.co
svarbit.com
swagbucks.com
swingerseiten.com
swsociety.se swsociety.se
telefonsexsofort.tk sygraem.com
testbotprocessor44.com symphonyintegratedhealthcare.com
texbaza.by takeflyte.com
thebestweightlosspills.ovh tandvardshuset.net
thecounter.com taranerymagesswa.blogspot.com
theheroes.ru tds-advert005.info
thetattoohut.com telefonsex-ohne0900.net
thewebsitetemplate.info templates.franklinfire.co
titangel-vietnam.com theendivechronicles.com
tizanidineandgabapentin.blogspot.com thegamerznetwork.com
tizanidinedosageforsleep.blogspot.com tizanidine6mg.blogspot.com
tizanidineduringpregnancy.blogspot.com tizanidineforopiatewithdrawal.blogspot.com
tizanidinehcl2mgtablet.blogspot.com todohr.com
tizanidinenarcotic.blogspot.com tovaroboom.vast.ru
tizanidinepain.blogspot.com toxicwap.com
tizanidinerestlesslegsyndrome.blogspot.com toyota.7zap.com
tizanidineshowupondrugtest.blogspot.com tradgardspartner.se
tizanidineusedfor.blogspot.com traffic2cash.org
tizanidinevscyclobenzaprine.blogspot.com traffictrade.life
toolsky.com tri-slona.org
topflownews.com triumf-realty.ru
topkarkas.com ukkala.xyz
toproadrunner5.info ukkelberg.no
torrentgamer.net unisexjewelry.org
track.deriv.com urlopener.com
tracksurf.daooda.com usswrite.com
trafficjunky.com vabasa.inwtrade.com
trafficreceiver.club valmetrundan.se
tramadolandtizanidine.blogspot.com video-chat.cn
turbodsp.com videochat.bz
twittrading.com videochat.life
uchetunet.su videochat.tv.br
uchil.net visa-pasport.ru
ugguk.online vitoriacabos.com
ultramart.biz vkontaktemusic.ru
unimodemhalfduplefw.pen.io vksaver-all.ru
uogonline.com
usacasino.com
usbggettwku.ga
v24s.net
vadimkravtcov.ru
vavilone.com
vbtracker.net
vereo.eu
viagra-soft.ru
videotuber.ru
vintontech.info
vip-file.com
vip.51.la
vipps.com.my
voditeltrezviy.ru voditeltrezviy.ru
voloomoney.com voluumtrk.com
vsesubwaysurfers.com vsdshnik.com
vzlomfb.com vzube.com
wardreapptokone.tk w3javascript.com
warning.or.kr wallpaperaccess.com
waterefficiency.co warningzscaler.heraeus.com
we-are-gamers.com webadvance.club
webcamdevochka.com webtherapy.ru
webmasterhome.cn weburlopener.com
webradiology.ru wedding-salon.net
website-speed-checker.site wejdz-tu.pl
weclipart.com wemarketing.se
wingsofrefuge.net whengirlsgowild.com
wjgony.com while.cheapwebsitehoster.com
worldoffiles.ru whipme.yopoint.in
worst-sites.online wikes.20fr.com
wtsindia.in winner7777.net
www.event-tracking.com womama.ru
www.jbetting.com www.souvenirua.com
wyniki-lista.pl x-diesel.com
wzgyyq.com x-stars.ru
x-lime.com xchat26.myfreecams.com
x69ty.ru xedserver.com
xboxster.ru xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xcc24.pl xn--80aanaardaperhcem4a6i.com
xchangetrak.com xn--80ajbshivpvn2i.xn--p1ai
xclicks.net
xfire.com
xgames-04.com
xingzi-vision.com
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
xn--80ak6aa92e.com xn--80ak6aa92e.com
xtube.com xn--e1afanlbnfckd7c3d.xn--p1ai
xz618.com xn--l1aengat.xn--p1ai
yaaknaa.info xn--oogle-wmc.com
yellocloud.be xxx-treker.ru
yogamatsexpert.com xxxsiterips.xyz
yourmovies.pl xxxtube69.com
yourtemplatefinder.com yes-com.com
za-music.mymobiplanet.com youbrainboost.asia
zdesformula.ru yourothersite.com
zeg-distribution.com youtuhe.com
zeroredirect12.com yuweng.info
zeroredirect2.com zacreditom.ru
zooggames.com zaobao.com.sg
zreloeporno.tv zapiszto.pl
zarabotat-na-sajte.ru
zeroredirect1.com
zeroredirect6.com
zona-aqua.ru
zrus.org
zverokruh-shop.cz

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
03e.info 3-letter-domains.net
123locker.com 3weekdiet.com
76brighton.co.uk 40cg.com
991mostfm.co.id a.frcls.fr
abclauncher.com aac500b7a15b2646968f6bd8c6305869d7.com
academiacsmendoza.org acgs.tk
actulite.com activepr.ru
adtech.de adidas.frwebs.fr
adult-shop.com.ua adsfresh.men
adultmeetonline.info adultfriendfinder.com
adverster.com advancedsoftwaresupport.com
agapovdg.ru aibolita.com
ahrefs.com akvamaster.dp.ua
all4invest.ru alert.scansafe.net
alt-servis.ru angigreene.com
apartamentwroclaw.eu apiadanaknet-a.akamaihd.net
apioutoboxnet-a.akamaihd.net atlant-auto.info
apple.com-webbrowsing-security.review audiobangout.com
aproposde.com ayanaspa.com
arenda-yeisk.ru b-styles.xyz
arpelsreplica.xyz baikaleminer.com
b00kmarks.com bangla-chat-uk-paralud.ga
bannerads.de bannerspace.com
bannerconnect.net berdasovivan.ru
baoxaydung.com.vn best-games.today
bavsac.com billiard-classic.com.ua
bdsmgalls.net bmw-ark.ru
bestfortraders.com bolezniorganov.ru
bg6s0.com bonkers.name
biteg.xyz bpro1.top
blackplanet.com brandedleadgeneration.com
blog.koorg.ru
bloke.com
bookmark4you.com
buchananshardware.com buchananshardware.com
bumskontakte.org businesn.men
buyk.host.sk buzzonclick.com
buyscabiescream.com byme.se
cannibalcheerleader.com
cartierjusteunclou.xyz
cartierloveringreplica.xyz cartierloveringreplica.xyz
chiblackhawks-jerseys.com cartierlovestore.xyz
cialischsrx.com cejewelry.xyz
chocolateslim-en-espana.com
christianlouboutinsaleoutletonline.us
clarithromycin500mg.com clarithromycin500mg.com
clevernt.com clash-clans.ru
clickcash.com classicakuhni.ru
cognitiveseo.com clips.ua.ac.be
com-onlinesupport.host co.lumb.co
compliance-john.top coin-hive.com
concealthyself.com compliance-don.top
counterbot.com cookie-law-enforcement-aa.xyz
dailyrank.net copyrightclaims.org
dangphoto.trade crynet.cc
datadepths.com cs-passion.pl
dekoration.us cupday.com
detalizaciya-tut.biz dengi-pod-zalog-nedvizhimosti.ru
dgfitness.co deshevo-nedorogo.ru
diamond-necklace.info deutschland123.de
diffbot.com dinkolove.ya.ru
discovertreasure-a.akamaihd.net domik-derevne.ru
djonwatch.ru e-biznes.info
dkvorota.ru election.interferencer.ru
dogclothing.store
doktoronline.no
domain2008.com
doxyporno.com
edge.sharethis.com
elektrischeziga.livejournal.com
elektrozigaretten1.tumblr.com
eloconcream.blogspot.com eloconcream.blogspot.com
energydiet-info.ru expolicenciaslatam.co
f0815.de fanpagerobot.com
fable.in.ua filerockstar298.weebly.com
fashion.stellaconstance.co filmi-onlain.info
fettefrauen.net findacheaplawyers.com
filesmonster.porn finemanteam.com
findpik.com fireads.men
folowsite.com flavors.me
footbalive.org flex4launch.ru
flowersbazar.com
forex.osobye.ru
forexgb.ru
forum.poker4life.ru
foxtechfpv.com foxtechfpv.com
freecamdollars.com
friendflnder.com friendflnder.com
gael-s.ru front.to
gay-file.com gameprimary.com
generousdeal-a.akamaihd.net gateway.zscalertwo.net
getmyads24.com gigapeta.com
globatur.ru goatse.ru
gogps.me golaya.pw
gosmeb.ru gowreckdiving.com
greamimgo.pw guigyverpo.cf
growmyfunds.ca guruofcasino.com
gsasearchenginerankerhelp.com hdxnxxtube.mobi
hamacapty.com headpress.ru
hd-filmy.net
healing-dysplasia.ru healing-dysplasia.ru
hol.es hentaiheroes.com
hoste.octopis.com highland-homes.com
hotchatdate.com historichometeam.com
housekuba.org homeart.space
houseofrose.com huimin764128.com
hptwaakw.blog.fc2.com husky-shop.cz
investmac.com iboss.com
investsuccess.org icaseclub.ru
iqs.biz.ua ideoworld.org
james13prix.info ilovevitaly.com
javxxx18.com investingclub.ru
jerseywholesaleelitestore.com isitwp.com
juliadiets.com istizanidineacontrolledsubstance.blogspot.com
kalb.ru istizanidineanopiate.blogspot.com
kchaxton.com javcoast.com
javitas.info
justucalling32211123456789.tk
kakablog.net
kanimage.com
kazrent.com
keenoutlet.online
keywords-monitoring-your-success.com
keywordsdoctor.com keywordsdoctor.com
kino-fun.ru kino-rf.ru
kinocccp.net kino2018.club
kinozapas.com kinozapas.org
kosynka-games.ru kiwe-analytics.com
krasivye-devushki.net kmgamex.cf
lafourmiliaire.com kostenloser-sex.com
law-check-nine.xyz kskjco.club
letmacwork.world lakomka.com.ua
lexixxx.com laparfumotec.com
lightinghomes.net laptoper.net
locustdesign.co lashstudia.ru
lost-alpha.ru lasvegaslockandsafe.com
lottospring.com lecbter-relationships.ga
love-baby.cz lida-ru.com
luckyday.world lietaer.com
macrotek.ru likesuccess.com
magiadinamibia.blogspot.com limtu.ifmo.ru
makenahartlin.com linkarena.com
mantramusic.ru linkpulse.com
marketingtechniques.info livefixer.com
medicinacom.ru longadventure.com
meds-online24.com longlifelomilomi.info
meget.co.za losangeles-ads.com
members.ghanaweb.com magazin-pics.ru
menhealed.net magicplayer-s.acestream.net
minharevisao.com mailemedicinals.com
minyetki.ru medicines-choice.com
misswell.net medizinreisen.de
mnogabukaff.net meendo-free-traffic.ga
moivestiy.biz megakino.net
moonci.ru metafilter.com
mosrif.ru mini-modus.ru
moviezbonkerssk.cf mirobuvi.com.ua
mug-na-chas-moscow.ru monclercoats.xyz
musicspire.online montazhnic.ru
mydearest.co mrinsidesales.com
mypets.by msk.afora.ru
mywallpaper.top muizre.ru
naturtreenspicerx.pw musezone.ru
net-radar.com musicktab.com
netvouz.com musirc.com
newstudio.tv mydirtyhobby.com
nippon-bearings.ru mylovelibrabry.com
nikitsyringedrivelg.pen.io
northfacestore.online northfacestore.online
olvanto.ru npoet.ru
one.net.in o333o.com
onlyporno.ru ochistka-stokov.ru
optom-deshevo.ru office2web.com
orsonet.ru openmediasoft.com
paleohub.info owohho.com
pcgroup.com.uy pandarastore.top
petedrummond.com paphoselectricianandplumber.com
phelissota.xyz pc-test.net
photostudiolightings.com perso.wanadoo.es
pijoto.net petsblogroll.com
pila.pl picquery.com
pk-pomosch.ru popugaychiki.com
pkr1hand.com pornogig.com
ploenjitmedia.azurewebsites.net
plohaya-kreditnaya-istoriya.ru
porno-dojki.net
pornosemki.info
pornotubexxx.name pornotubexxx.name
proekt-gaz.ru prostitutki-astana.org
projectforte.ru prostitutki-odessa.org
purchasepillsnorx.com pshare.biz
qor360.com push-ad.com
r-e-f-e-r-e-r.com registrationdomainsite.com
recipedays.com reimageplus.com
refererx.com rep-am.com
rfserial.net resultshub-a.akamaihd.net
s.lollypopgaming.com retailwith.com
sack.net rightenergysolutions.com.au
sammlungfotos.online roll123.com
sashagreyblog.ga rossanasaavedra.net
scanhub.ru royalcar-ufa.ru
secret.xn--oogle-wmc.com royalvegascasino.com
see-your-website-here.com rumamba.com
seo-smm.kz rus-pornuha.com
seo18.su rusexy.xyz
service.adtech.fr rutor.vip
sexkrasivo.net sankt-peterburg.nodup.ru
shlyahten.ru sc-specialhost.com
schoolfiles.net
seadragonherbery.com
search.pch.com
searchencrypt.com
searchlock.com
seoanalyses.com
servingnotice.com
sevendays.com.ua
si-unique.com si-unique.com
slim.sellany.ru site3.free-share-buttons.com
sms2x2.ru siteonomy.com
soc-proof.su skanninge.se
spb-plitka.ru slomm.ru
stroymonolit.su soda.media
superkanpo.com softomix.com
svarkagid.com sortthemesitesby.com
svbur.ru spywareit.com
telesvoboda.ru stackthatbucks.com
stairliftstrue.com
startufa.ru
streha-metalko.si
strfls.com
stroimajor.ru
studiofaca.com
szucs.ru
taqplayer.info
tattooha.com
telegramdownload10.com
thefotosgratis.eu thefotosgratis.eu
thegameriders.com threecolumnblogger.com
thegamerznetwork.com tizanidineandhydrocodone.blogspot.com
tiandeural.ru tizanidinestreetvalue.blogspot.com
tizanidine6mg.blogspot.com top-karkas.ru
tonerbox.kz topsy.com
toon-families.com tour-line.net
top-study.work track2.shop
topquality.cf tracksz.co
tracklead.net triumf-realty.ru
trafaret74.ru u17795.netangels.ru
ttrraacckkrr.com ugogo.info
turizmus.us urccvfmc.bloger.index.hr
tvory.predmety.in.ua vasileostrovsky-rayon.ru
twu.com.ua vekzdorov.ru
udsgame.online videochat.life
umaseh.com vladhistory.com
umnovocaminho.com wieseversa.no
unitygame3d.com x-musics.com
unrealcommander.biz xep.info
uvozdeckych.info xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
vancleefreplica.pw xn--d1acah0c.xn--p1ai
vandrie-ict.nl yebocasino.com
vertaform.com yellocloud.be
viberdownload10.com yellowstonevisitortours.com
video-chat.in youradulthosting.com
videochat.world zakazfutbolki.com
vigrx-original.ru zarepta.com
vodkoved.ru zigarettenonlinekaufen1.bloog.pl
voloomoney.com
w3javascript.com
watchmyfb.pl
weblo.com
webstatsdomain.org
womensterritory.ru
worldoffiles.ru
www.kabbalah-red-bracelets.com
x-diesel.info
xchat26.myfreecams.com
xclicks.net
xn--80aanaardaperhcem4a6i.com
xn--80ajbshivpvn2i.xn--p1ai
xn--80aodinpgi.xn--p1ai
youtuhe.com
zawyna.ua
zigarettenonlinekaufen1.blox.pl
zionstar.net
zirondelli.it
znaturaloriginal.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.248 0; 10.1.0.21 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3077 ### Version: V4.2022.05.3078
### Updated: Sat Apr 30 22:01:22 UTC 2022 ### Updated: Sun May 1 10:03:30 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3077 ### Version: V4.2022.05.3078
### Updated: Sat Apr 30 22:01:22 UTC 2022 ### Updated: Sun May 1 10:03:30 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##