vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.07.3230 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-07-15 22:07:11 +00:00
parent f2a42795a8
commit 9c41477eac
46 changed files with 93428 additions and 93428 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3229 #### Version: V4.2022.07.3230
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3229 #### Version: V4.2022.07.3230
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.07.3229 #### Version: V4.2022.07.3230
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11540
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.07.3229 #### Version: V4.2022.07.3230
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11544
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11544
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11544
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11544
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 1; 10.1.0.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 0; 10.1.0.69 0;
127.0.0.1 0; 127.0.0.1 0;

11544
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 1; 10.1.0.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 0; 10.1.0.69 0;
127.0.0.1 0; 127.0.0.1 0;

11544
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 1; 10.1.0.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 0; 10.1.0.69 0;
127.0.0.1 0; 127.0.0.1 0;

11544
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3229 3230

11544
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11544
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.227.117 0; 20.7.33.251 0;

11544
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 1; 10.1.0.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 0; 10.1.0.69 0;
127.0.0.1 0; 127.0.0.1 0;

11544
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 1; 10.1.0.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 0; 10.1.0.69 0;
127.0.0.1 0; 127.0.0.1 0;

11544
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 1; 10.1.0.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 0; 10.1.0.69 0;
127.0.0.1 0; 127.0.0.1 0;

11544
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.227.117 0; 20.7.33.251 0;

11544
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.227.117 0; 20.7.33.251 0;

11544
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 1; 10.1.0.69 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Apexoo Aipbot
HonoluluBot AlphaBot
Minefield HaosouSpider
PeoplePal InfoTekies
PictureFinder Jorgee
RankurBot Ninja
Shodan Steeler
V-BOT TeleportPro
crawl.sogou.com Zermelo
scalaj-http adscanner

320
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404enemy 01h4x.com
360Spider
80legs
ALittle Client ALittle Client
ASPSeek AfD-Verbotsverfahren
Aboundexbot
AhrefsBot AhrefsBot
Alligator
AlphaBot
Anarchy Anarchy
Anarchy99 AwarioRssBot
Ankit BBBike
Anthill
Aspiegel
Atomseobot
BackDoorBot BackDoorBot
BackWeb
Backlink-Ceck Backlink-Ceck
Badass
BatchFTP
BetaBot
Bigfoot
BlackWidow BlackWidow
Blackboard Blackboard
BlowFish Boardreader
Bolt
BotALot
Brandprotect Brandprotect
Buck
BuiltBotTough BuiltBotTough
Bullseye BuiltWith
BuzzSumo BuzzSumo
CATExplorador CCBot
CODE87 CODE87
Calculon CSHttp
CazoodleBot CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot CheeseBot
CherryPicker CherryPicker
Chlooe
Claritybot Claritybot
CopyRightCheck Cliqzbot
Copyscape Cogentbot
Cosmos Collector
Copier
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent Crescent
CrunchBot
Custo
DIIbot
DTS Agent
DataCha0s
Demon Demon
Digincore Deusu
Dirbuster DigitalPebble
DnBCrawler-Analytics Discobot
DnyzBot Dispatch
DomainCrawler DomainAppender
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Drip Download Wonder
ECCP/1.0
Ebingbong Ebingbong
EirGrabber Ecxi
ExtLinksBot EroCrawler
Extractor Evil
Exabot
Extreme Picture Finder
EyeNetIE EyeNetIE
FemtosearchBot Ezooms
Firefox/7.0 FDM
FlashGet FHscan
Fimap
Freeuploader
Fuzz
G-i-g-a-b-o-t G-i-g-a-b-o-t
Genieo GT::WWW
GetRight
GetWeb GetWeb
Go-Ahead-Got-It Getintent
Gigabot
GoZilla
Gotit Gotit
GrabNet
Grafula Grafula
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
Harvest
Heritrix Heritrix
Humanlinks Hloader
HonoluluBot
HybridBot HybridBot
IRLbot IlseBot
Iblog Image Fetch
Image Sucker Indy Library
InfoTekies
Intelliseek
Iria Iria
IstellaBot Iskanie
JOC Web Spider JamesBOT
JennyBot
Joomla Joomla
Jorgee
Jyxobot
Kenjin Spider Kenjin Spider
Keyword Density Keyword Density
Kinza
LNSpiderguy
Lanshanbot Lanshanbot
Lftp Larbin
LieBaoFast Leap
LeechGet
LexiBot
Libwhisker
Likse
LinkScan LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Ltx71 Litemage_walker
MIIxpc
MTRobot
Mag-Net Mag-Net
Mail.RU_Bot MarkMonitor
Majestic SEO
Masscan
Mata Hari Mata Hari
Mb2345Browser MegaIndex.ru
Mediatoolkitbot
Metauri
MicroMessenger MicroMessenger
Microsoft URL Control
Minefield Minefield
Mister PiX Nameprotect
Moblie Safari NearSite
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
Name Intelligence
Nessus Nessus
NetLyzer NetMechanic
NetSpider
NetZIP NetZIP
Nettrack Nettrack
Netvibes Netvibes
Nibbler Niki-bot
Nikto
Nimbostratus
Ninja Ninja
Nuclei Not
Nutch Nutch
Octopus
Offline Navigator
Openvas Openvas
OrangeSpider OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP PECL::HTTP
PageGrabber POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com PageThing.com
Papa Foto Papa Foto
Pavuk
PeoplePal PeoplePal
Petalbot Pi-Monster
Picscout Picscout
Piepmatz Picsearch
Pimonster Pixray
PleaseCrawl PleaseCrawl
ProPowerBot
Probethenet Probethenet
PyCurl Pu_iN
Pump
QueryN Metasearch QueryN Metasearch
RSSingBot RSSingBot
RankActive RankActive
RankFlex RankingBot2
RankingBot RankurBot
Rankivabot
Re-re Re-re
RealDownload RealDownload
RebelMouse
Rogerbot Rogerbot
SEOlyticsCrawler SBIder
SEOkicks
SEOprofiler SEOprofiler
SEOstats
SISTRIX SISTRIX
SalesIntelligent Scrapy
Scanbot
ScreenerBot ScreenerBot
Searchestate
Semrush
SemrushBot SemrushBot
SentiBot SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteSnagger SiteExplorer
SiteSucker SiteLockSpider
SmartDownload Siteimprove
Sitevigil
SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider
Sosospider Sosospider
SpaceBison SpaceBison
SpankBot
Spanner Spanner
Spbot Sqworm
Spinn3r
Sucker Sucker
Sucuri
SuperBot
Surfbot Surfbot
Swiftbot SurveyBot
T8Abot Suzuran
Telesphorep Szukacz
Telesphoreo
TheNomad
TightTwatBot TightTwatBot
Titan Titan
Tracemyfile Turnitin
Trendiction UnisterBot
Trendictionbot Upflow
Turingos VCI
TurnitinBot
TwengaBot
Twice
URLy Warning
V-BOT
VB Project
Vacuum Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VeriCiteCrawler
Voltron VoidEYE
WBSearchBot WASALive-Bot
WEBDAV WWW-Collector-E
WPScan WWW::Mechanize
WWWOFFLE Wallpapers
Wallpapers/3.0 WeSEE
WallpapersHD Web Sauger
Web Fuck Web Sucker
WebBandit WebBandit
WebFuck WebFetch
WebLeacher WebImageCollector
WebStripper WebReaper
WebSucker WebSucker
WebmasterWorldForumBot WebWhacker
Webalta
Website Quester Website Quester
Whatweb Whack
Whacker
Who.is Bot
Widow Widow
WinHTTrack Woobot
Wonderbot Wprecon
Xaldon WebSpider Zeus
Xaldon_WebSpider ZmEu
Xenu arquivo-web-crawler
ZoominfoBot
ZumBot
adscanner
arquivo.pt
backlink-check backlink-check
cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback crawler.feedback
crawler4j crawler4j
dataforseo.com
domainsproject.org
eCatch eCatch
evc-batch gopher
facebookscraper isitwp.com
heritrix iubenda-radar
internetVista monitor
ips-agent
lwp-request
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler netEstate NE Crawler
oBot pcBrowser
polaris version plumanalytics
satoristudio.net probe-image-size
seobility ripz
s1z.ru
scalaj-http
seocompany.store seocompany.store
serpstatbot seoscanners
siteripz sp_auditbot
spyfu
sysscan sysscan
webpros.com tAkeOut
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot webprosbot
x22Mozilla x09Mozilla
zauba.io
zgrab zgrab

320
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker
404enemy 404enemy
80legs 80legs
ALittle Client ADmantX
Abonti AIBOT
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Alexibot
Alligator
AlphaBot AlphaBot
Anthill Anarchie
Aspiegel Anarchy99
BackWeb AwarioRssBot
Backlink-Ceck AwarioSmartBot
Battleztar Bazinga BackDoorBot
Bitacle BackStreet
Blow BacklinkCrawler
Badass
Bandit
BlackWidow
BlowFish
BotALot
Brandwatch Brandwatch
Buck BuiltBotTough
Buddy
CATExplorador
CCBot
CODE87 CODE87
CazoodleBot Calculon
Cegbfeieh Cegbfeieh
CensysInspect
CherryPicker
Chlooe Chlooe
Citoid Cloud mapping
Cogentbot Cogentbot
CopyRightCheck Crawling at Home Project
Craftbot
CrazyWebCrawler CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy CyotekWebCopy
DBLBot
DIIbot
DTS Agent
Demon Demon
Dirbuster Deusu
Dispatch Devil
DnBCrawler-Analytics Disco
DnyzBot Discoverybot
DomainSigmaCrawler DomainCrawler
DomainStatsBot
Domains Project Domains Project
Download Wonder Download Wonder
Dragonfly
Drip
ECCP/1.0 ECCP/1.0
EasyDL EMail Siphon
ExtLinksBot EMail Wolf
ExtractorPro Ebingbong
Ecxi
Evil
Extractor
EyeNetIE EyeNetIE
Ezooms FDM
FHscan FHscan
Fimap FemtosearchBot
Firefox/7.0 Freeuploader
Flunky G-i-g-a-b-o-t
Foobot GT::WWW
FrontPage GermCrawler
Fyrebot
GetRight GetRight
GetWeb Go!Zilla
Getintent Go-Ahead-Got-It
Gotit Grabber
Grafula HMView
GrapeFX
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
Haansoft
HaosouSpider HaosouSpider
Heritrix Havij
Hloader Hloader
HonoluluBot
Humanlinks Humanlinks
Image Fetch
Image Sucker
IndeedBot IndeedBot
Indy Library Indy Library
Intelliseek Intelliseek
Internet Ninja
InternetSeer
Iria Iria
IstellaBot
JOC Web Spider JOC Web Spider
JennyBot Jbrofuzz
JetCar
Jetty Jetty
JikeSpider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Kozmosbot Kozmosbot
LeechGet Lanshanbot
Libwhisker Larbin
LeechFTP
LibWeb
LieBaoFast LieBaoFast
LinkScan Lightspeedsystems
LinqiaRSSBot Likse
LinkextractorPro
LinkpadBot
LinksManager
Lipperhey Spider Lipperhey Spider
MIDown tool Lmspider
MIIxpc MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler MSIECrawler
MTRobot Magnet
Mag-Net Majestic12
Majestic-SEO MarkWatch
Mass Downloader Mass Downloader
Masscan Masscan
Mb2345Browser
Mediatoolkitbot Mediatoolkitbot
MicroMessenger Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Minefield Moblie Safari
MolokaiBot Mojeek
Mozlila Msrabot
Mr.4x3
NICErsPRO
NPbot
Name Intelligence
Nameprotect Nameprotect
Navroad NearSite
Needle Nessus
Net Vampire NetAnts
NetMechanic NetMechanic
NetZIP Nettrack
Netcraft
Nibbler
Niki-bot Niki-bot
Nimbostratus Nikto
Nmap NimbleCrawler
Octopus Not
Offline Navigator Offline Explorer
OnCrawl OpenVAS
OpenLinkProfiler Openvas
Openfind OutclicksBot
OrangeBot
OutfoxBot OutfoxBot
PageGrabber PECL::HTTP
PageScorer PageScorer
Picscout Pandalytics
Panscient
Petalbot
Picsearch Picsearch
Piepmatz Pixray
Pimonster Pockey
PleaseCrawl ProPowerBot
ProWebWalker ProWebWalker
Pump Probethenet
PxBroker
PyCurl
Quick-Crawler Quick-Crawler
RSSingBot RankActiveLinkBot
RankingBot
Rankivabot
RankurBot RankurBot
ReGet ReGet
Reaper Reaper
RebelMouse
RedesScrapy
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler
Rogerbot Rogerbot
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats
SMTBot SMTBot
Scanbot ScoutJet
Scrapy
Screaming Screaming
ScrepyBot
Searchestate Searchestate
Seekport Seekport
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Site Sucker Seomoz
SiteLockSpider Shodan
Sitebeam SiteSnagger
Siteimprove
Sitevigil Sitevigil
SmartDownload Snapbot
Snake
SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
SpaceBison Spbot
Spinn3r SputnikBot
Sqlmap
Steeler Steeler
SuperHTTP Stripper
Surfbot Surfbot
Suzuran Swiftbot
Szukacz
T0PHackTeam T0PHackTeam
Teleport T8Abot
TeleportPro TeleportPro
Telesoft Telesphoreo
Thumbor The Intraformant
Titan Toata
Toweyabot
Tracemyfile
Turingos Turingos
TurnitinBot Turnitin
Twice TwengaBot
URLy Warning VelenPublicWebCrawler
UnisterBot VoidEYE
V-BOT
VB Project
VCI
Vacuum
VeriCiteCrawler
Voil
Voltron
WASALive-Bot WASALive-Bot
WEBDAV WISENutbot
WWW-Collector-E WPScan
WWW::Mechanize WWW-Mechanize
Wallpapers/3.0 WeSEE
WallpapersHD Web Pix
Web Enhancer
Web Fuck
Web Sucker Web Sucker
WebAuto
WebBandit WebBandit
WebCollage WebCollage
WebEnhancer
WebFetch WebFetch
WebFuck
WebImageCollector WebImageCollector
WebLeacher WebReaper
WebSauger
WebStripper
Webalta
WebmasterWorldForumBot
Webshag Webshag
Website Quester Webster
Whack
Whatweb Whatweb
WiseGuys Robot WiseGuys Robot
Wotbox Wonderbot
Xenu Woobot
Zade Wprecon
Zeus Xaldon WebSpider
YoudaoBot
Zitebot
ZoomBot ZoomBot
ZumBot
ZyBorg ZyBorg
arquivo.pt autoemailspider
cognitiveseo backlink-check
demandbase-bot check1.exe
eCatch clark-crawler
crawler.feedback
domainsproject.org
evc-batch evc-batch
facebookscraper gopher
heritrix
instabid
ips-agent ips-agent
linkdexbot linkdexbot
lwp-trivial lwp-trivial
magpie-crawler
meanpathbot meanpathbot
muhstik-scan mediawords
netEstate NE Crawler netEstate NE Crawler
oBot oBot
page scorer
pcBrowser pcBrowser
plumanalytics plumanalytics
polaris version
ripz
s1z.ru s1z.ru
satoristudio.net scalaj-http
scan.lol seostar
seoscanners serpstatbot
sp_auditbot sexsearcher
tAkeOut siteripz
sogouspider
sysscan
trendiction.de trendiction.de
voyagerx.com
webgains-bot
webmeup-crawler webmeup-crawler
x09Mozilla x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
amateurlivechat.org alphavisions.net
babosas.com bedcapdealers.com
gallery.rennlist.com brandedleadgeneration.com
indiasourcemart.in customcollegeessays.net
oneclickfiles.com igru-xbox.net
site5.com mrinsidesales.com
spitfiremusic.com softomix.net
textads.men tversvet.ru
unrealcommander.org whiteproduct.com
znakom.sibtest.ru winx-play.ru

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101billion.com 00author.com
123kuma.com
1688.com
1bet.com
1stat.ru
24x7-server-support.site 24x7-server-support.site
2drittel.de 5forex.ru
300richmond.co.nz 66cpwgln.space
4replicawatch.net 7minuteworkout.com
76brighton.co.uk 999webdesign.com
aaa38852e886ac4af1a3cff9b47cab6272.com aac500b7a15b2646968f6bd8c6305869d7.com
abcguru.xyz abclauncher.com
abctoppictures.net absolutelyanalog.com
absugars.com actulite.com
acheterviagrafr24.com adcash.com
actionnooz.com addbin.men
acunetix-referrer.com adman.se
adsref.men agecheckadult.com
adtiger.tk
adultactioncam.com
advancedcleaner.com
affiliate-fr.com
ageofclones.com ageofclones.com
agreda.pluto.ro
agysya.ru agysya.ru
alfa-medosmotr.ru alekseevec.ru
all4invest.info ameblo.jp
allesohnegirls.net amt-k.ru
ameblo.top anatomiy.com
apibrowsesmartne-a.akamaihd.net angel1777.kz
apiitsthirteende-a.akamaihd.net anime.dougasouko.com
app-ready.xyz animenime.ru
apper.de antons-transporte.de
apple.com-cleaner.systems apifasterlightin-a.akamaihd.net
approvedlocal.co.za apilinkswiftco-a.akamaihd.net
arate.ru apimountainbikei-a.akamaihd.net
arquapetrarca.info apioasisspacenet-a.akamaihd.net
as5000.com asociatia-tipografilor-transilvania.ro
asdfg.pro astana.xxxkaz.org
asseenontv.ru autogrep.ru
atlant-auto.info autonew.biz
ausmepa.org.au
autoloans.com
autoplate.info autoplate.info
avek.ru autotop.com.ua
autowebmarket.com.ua
avtocredit-legko.ru
avtolombard-krasnodar.ru avtolombard-krasnodar.ru
azazaporn.com awency.com
b2b-lounge.com balkanfarma.org
bagcionderlab.com balkanfarma.ru
baixar-musicas-gratis.com baltgem.com
banki76.ru bavsac.com
banksrf.ru beachdriveblog.com
bausparen.bz.it
beachtoday.ru beachtoday.ru
belinka.com.ua bedcapdealers.com
best-mam.ru belsetirehafi.tk
bestdooz.com best-seo-solution.com
bigpenisguide.com bestbrainprod.win
biketank.ga bestchoice.cf
binomo.kz bestdraws.com
bioca.org bestfortraders.com
bioscorp.ru bestimagecoollibrary.com
blackcurranthumidifiers.site bif-ru.info
blog.axant.it bimatoprost-careprost.com.ua
bobinoz.com bitcoinpile.com
bpro1.top bitporno.sx
brandbucket.com bizzliving.com
brokergid.ru blackle.com
bugof.gq blogrankers.com
buy-cheap-pills-order-online.com bonkers.name
bycontext.com bradleylive.xyz
carapics.com breastaugmentation.co.za
cartierlove2u.com brimstonehillfortress.org
cartierreplica.top briomotor.co
bumascloset.com
buybest1.biz
buydissertation.net
buyessaynow.biz
buyfriend.ru
buyparajumpers.online
bvlgariwallet.xyz
californianews.cf
callmd5map.com
candiceloves.us
canoncdriverq3.pen.io
canzoni.ru
cardsharp1.ru
carloans.com
cashkitten-a.akamaihd.net cashkitten-a.akamaihd.net
caulderwoodkennels.com catalogs-parts.com
cctva.tv caveavins.fr
certifywebsite.win cbcseward.com
cfsrating.sonicwall.com cbox.ws
cheapjerseysbizwholesale.us cdncash.net
cheapmoncler.xyz cenokos.ru
checkhit.com changde.58.com
choosecuisine.com cheapjerseysfootballshop.com
choice-credit.ru
ci.ua
clean-start.net
clickaider.com clickaider.com
clickintext.net
clickso.com
clicksor.net
clksite.com clksite.com
club-lukojl.ru com-cleaner.systems
co.lumb.co com-onlinesupport.site
cometorussia.net commoncrawl.org
compliance-andrew.top compliance-josh.top
compliance-don.top connectingsingles.com
compliance-julia.top connectionstrenth.com
concordexoticrentals.com coolyarddecorations.com
cookie-law-enforcement-ff.xyz copblock.org
coolgamechannel.com copro.pw
copenergo.ru cowblog.fr
countbertwistdisp26.soup.io credit.co.ua
counter.yadro.ru creditnation.ru
cpabegins.ru customchocolate.business-for-home.com
crackguru.tk customcollegeessays.net
creativehutindia.com dairyindia.in
credit-online.ws daretodonate.co
crest-poloski.ru date-withme.com
cutalltheshit.com dealighted.com
cymbaltaandtizanidine.blogspot.com dear-diary.ru
deadlinkchecker.com deda-moroza-zakaz.ru
degerlund.net designdevise.com
dekoration.us divci-hry.info
depositfiles-porn.ga dlya-android.org
dickssportinggoods.com
diusyawiga.tk
dodlive.mil
dojki365.online dojki365.online
domain-submit.info domainsatcost.com
domain.webkeyit.com domoysshop.ru
domini.cat dotmass.top
dostavka-v-ukrainu.ru doxyporno.com
doublepimp.com draniki.org
driving.kiev.ua drpornogratisx.xxx
drugstoreforyou.com dvrlists.com
dscaas.website
dyshagi.ru dyshagi.ru
ebonyporn.site eager-nash.188-93-233-196.plesk.page
election.interferencer.ru eaplay.ru
elektrozigarette2.webs.com ecommerce-seo.com
elektrozigaretten1.webs.com education-cz.ru
elvenar.com eduinfosite.com
empathica.com ekn-art.se
energydiet24.ru elektrischezigaretten1.blogse.nl
englishdictionaryfree.com elektronischezigarette2.mex.tl
eorogo.top elektrozigaretten1.tumblr.com
erot.co emerson-rus.ru
erotik-kostenlos.net enge-fotzen.info
essay-edu.biz ero-advertising.com
etenininrade.ga es5.com
estelight.ru
eu-cookie-law.blogspot.com eu-cookie-law.blogspot.com
eugenevaultstorage.com european-torches.ru
everypony.ru expertblog.info
excitacion.info extlabs.io
expertnaya-ocenka.ru extractorandburner.com
extads.net
extremez.net extremez.net
ezrvrentals.com eyemagination.com
facecup.top eywords-monitoring-your-success.com
falcoware.com fable.in.ua
familyholiday.ml familyphysician.ru
fashionavenuegame.com famix.xyz
film-one.ru filmania-x.ru
filunika.com.ru firstsiteguide.com
financepoints.eu fishingwholesale.us
findpics.pw fitfloponline.store
fireads.men fitnesspiks.com
flagcounter.me fiverr.com
food.dtu.dk flex4launch.ru
forodvd.com flipper.top
fortevidyoze.net forum69.info
foxweber.com foto-basa.com
free-today.com foxinsocks.ru
freeuploader.ml foxjuegos.com
freevpn.space free-fbook-traffic.com
freewareseek.com freeseedsonline.com
fullgirl.ru freshdz.com
fun2cell.net fullfileaccess.com
fxtips.ru fxgallery.com
fyxabomiw.ru gabeshop.ru
gazoblok.net.ua galeon.com
geileweiber.tk gavuer.ru
generousdeal-a.akamaihd.net gaygalls.net
get-seo-domain.com gazporno.com
ghazel.ru geilehausfrauen.net
glasof.es geoads.com
globetrotting-culture.ru gepezz.info
google-liar.ru getlaid-xxxhookupdirect.com
gosmeb.ru getlamborghini.ga
gosreg.amchs.ru getyourimage.club
gotwebsite1.com gg.zzyjxs.com
gribokstop.com goatse.ru
grtyi.com gobongo.info
gungamesz.com gok-kasten.net
guod.me googlepositions.com
habermetre.com gpms.org.my
hasshe.com greenidesign.co
hdimagegallery.net gta-club.ru
headpharmacy.com gta-top.ru
health-medical-portal.info gtopstats.com
heliko.no guardlink.org
highstairs-a.akamaihd.net guge.io
hobbyhuren-datenbank.com gwagka.com
homeandhealth.ru gymi.name
homedo.fabpage.com hamacapty.com
homeinns.com hchha.com
homemature.net hd720kino.ru
homik.pw hdfreeporno.net
hornymatches.com heartofpayne.xyz
host-tracker.com heatpower.ru
hosting-tracker.com hebr.myddns-flir.com
hoterika.com helicalpile.us
hoverboard360.at hermesbracelets.xyz
hoverboard360.nl hjaoopoa.top
hystersister.com hully.altervista.org
i-service.kz i-service.kz
ideoworld.org ideashome.id
ifirestarter.ru ifmo.ru
iflycapetown.co.za ihc2015.info
igtools.club impisr.edunsk.ru
ilmen.net inclk.com
ilovevitaly.ru innodgfdriverhm.aircus.com
iminent.com int.search.tb.ask.com
import-sales.com internetartfair.com
incanto.in.ua
informatiecentro.be
intellego.info
intellekt21.ru
interesnie-faktu.ru
interior-stickers.ru
intimshop-fantasy.ru intimshop-fantasy.ru
ipornox.xxx ipchicken.com
iptool.xyz irkutsk.online-podarki.com
itch.io iusstf.org
izoll.ru iwantedmoney.com
jackwolfskinoutlet.online jacago.com
javxxx18.com japan-bearings.ru
jerseyschinabizwholesale.us jaxcube.info
jjbabskoe.ru je7.us
journeydownthescale.info jeremyeaton.co
justbcause.com jestr.org
jwss.cc jo24news.com
kandidos.com justdating.online
kanimage.com kanimage.com
karpun-iris.ru keywordbasket.com
kaz.kz keywordspay.com
keywesthideaways.co keywordteam.net
kfon.eu khafre.us
khadastoafarde.tk kinoflux.net
kimcurlrvsms.com kinotorka.ru
kinobaks.com kiwi237au.tk
kinofak.net kollesa.ru
kinoplen.ru komputers-best.ru
koopilka.com
kosmetyki.tm.pl kosmetyki.tm.pl
kountrylife.com kwzf.net
krasivye-devushki.net lanadelreyfans.us
krassh.ru lecbter-relationships.ga
kurwa.win lemon-ade.site
laexotic.com letslowbefast.today
lankarns.com
lashstudia.ru
laudit.ru
lawyersinfo.org
lechenie-gemorroya.com
ledpolice.ru
lidoradio.com lidoradio.com
linerdrilling.com listiseltemournlan.gq
lirunet.ru lolnex.us
live-sexcam.tk lombia.co
loadopia.com lost-alpha.ru
localmatchbook.com lostfilm-online.ru
lonely-mature.com love-baby.cz
longlifelomilomi.info lubetube.com
lotto6888.com m-google.xyz
magiadinamibia.blogspot.com macdamaged.tech
malwareremovalcenter.com magicdiet.gq
manualterap.roleforum.ru manualterap.roleforum.ru
marcogrup.com mapquestz.us
marketland.ml marsgatan.com
martlinker.com
massage-info.nl massage-info.nl
matchpal-a.akamaihd.net masserect.com
mbiologi.ru maxthon.com
mcadamssupplyco.com medi-fitt.hu
meddesk.ru medicinacom.ru
mediafresh.online medicines-choice.com
medkletki.ru merryhouse.co.uk
meendo-free-traffic.ga mesbuta.info
methodsmarketing.com mir-betting.ru
mhtr.be misandesign.se
micasainvest.com mixtapetorrent.com
mir-business-24.ru mmoguider.ru
mirzonru.net mobot.site
misterjtbarbers.com mobstarr.com
mncrftpcs.com
mojpreskumanie.com mojpreskumanie.com
mrpornogratis.xxx moncleroutletonline.win
musirc.com monetizationking.net
movies-in-theaters.net
moyaterapiya.ru
moz.com
muznachas-service.ru
mydirtystuff.com
myfreetutorials.com myfreetutorials.com
mypets.by mylida.org
mysexpics.ru mymercy.info
najaden.no mywallpaper.top
narkologiya-penza.ru myxdate.info
naturalpharm.com.ua mzdish.site
naturtreenspicerx.pw nakozhe.com
neodownload.webcam namecrumilchlet.tk
nerudlogistik.ru nardulan.com
net-profits.xyz newstaffadsshop.club
news-readers.ru next-dentists.tk
newsperuse.com ningessaybe.me
novgorod.xrus.org nippon-bearings.ru
o00.in no-fuel.org
okmusic.jp no-rx.info
oksrv.com nodding-passion.tk
olympescort.com nootrino.com
onko-24.com noumeda.com
online-podarki.com novosibirsk.xrus.org
ons-add.men nudejapan.net
ooo-gotovie.ru nvformula.ru
nyfinance.ml
o-o-8-o-o.ru
okuos.com
onclkads.com
onetravelguides.com
online7777.com
onlineporno.site
onlinetvseries.me
orel-reshka.net orel-reshka.net
orion-v.com
oyster-green.com oyster-green.com
paidonlinesites.com painting-planet.com
partybunny.ru panchro.xyz
pathwhelp.org paradontozanet.ru
pattersonsweb.com parajumpersoutlet.online
pdfprof.com partnersafe.men
perfectpracticeweb.com partnerworkroom.men
phpdevops.com pastaleads.com
piccdata.com pcimforum.com
pl.aasoldes.fr pewit.pw
plaff-go.ru photo-clip.ru
playfortuna-play.ru pics-group.com
playtap.us pogruztehnik.ru
podshipniki-ntn.ru popcash.net
pokemon-go-play.online pornhub-forum.ga
pokemongooo.ml pornoelita.info
pontiacsolstice.info pornoklad.net
poppen-nw.net pornokorol.com
poquoson.org pornotubs.com
pornpost.in portside.cc
potolokelekor.ru poshiv-chehol.ru
predmety.in.ua postclass.com
profit-opportunity.com preparevideosafesystem4unow.site
progress-upakovka.ru printingpeach.com
prointer.net.ua privetsochi.ru
purchasepillsnorx.com prohoster.info
putitin.me promgirldresses.xyz
quick-seeker.com prosperent.com
raavidesigns.com pussysaga.com
rankscanner.com py100.ru
rarbg.to r-e-f-e-r-e-r.com
rasteniya-vs-zombi.ru rada.ru
rcb101.ru ragecash.com
realresultslist.com rapidgator-porn.ga
remontvsamare.su razamicroelectronics.com
rent2spb.ru realitykings.com
realnye-otzyvy.info
registratciya-v-moskve.ru
reining.lovasszovetseg.hu
relatodelpresente.com.ar
remont-fridge-tv.ru
remontbiz.ru
remorcicomerciale.ro
remote-dba.de
rennlist.com
rentehno.ru rentehno.ru
responsinator.com respublica-otel.ru
restorator-msk.ru robotixix.com
romhacking.ru ros-ctm.ru
rootandroid.org rostov.xrus.org
royalvegascasino.com runstocks.com
rozalli.com rvtv.ru
rukino.org sack.net
runofilms.ru sajatvelemeny.com
rutor.vip salutmontreal.com
saddiechoua.com satoristudio.net
samoiedo.it sc-specialhost.com
samolet.fr scanner-alex.top
saneitconsulting.com scanner-brian.top
sanyuprojects.com searchinquire.com
sax-sex.com semrush.com
scanner-alexa.top
scanner-jess.top
scanner-viktor.top
screpy.com
sdrescher.net
seccioncontrabajo.com
secretscook.ru
seeresultshub-a.akamaihd.net
seinterface.com
selectads.men
semp.net
seolab.top seolab.top
seorankinglinks.com seomarketings.online
seryeznie-znakomstva.ru seonetwizard.com
sexad.net sex-tracker.com
sexkvartal.com
sexs-foto.com sexs-foto.com
shell-pmr.ru sexs-foto.top
shikiso.info sexyali.com
ship-marvel.co.ua sexyebonyteen.com
shmetall.com.ua shareyards.com
shop-electron.ru shlyahten.ru
shop.xz618.com sibtest.ru
shopwme.ru signoredom.com
sicfor.bcu.cc skanninge.se
siha.de skutecznetabletkinaporostwlosow.pl
sildenafil-tadalafil.info slkrm.ru
sims-sims.ru sloopyjoes.com
site5.com smichovbike.cz
sitopreferito.it snowplanes.com
slujbauborki.ru snts.shell-pmr.ru
smadihome.com sodexo.com
soaksoak.ru solicita.info
socialbookmarksubmission.org
softomix.net
songplanet.ru
sophang8.com
sosdepotdebilan.com sosdepotdebilan.com
speechfoodie.com specialfinanceoffers.com
sport-video-obzor.ru
sports-supplements.us sports-supplements.us
spy-sts.com spywarespy.com
srecorder.com sr-rekneskap.no
steebook.com startwp.org
stmassage.ru strag-invest.ru
stop-zavisimost.com stroyhelp-dv.ru
storehouse.ua supervesti.ru
stroimajor.ru swagbucks.com
studworks.org swinger-mobil.net
sugarlyflex.pw swiped.su
sugvant.ru szamponrevita.pl
supermama.top t-bygg.com
superstats.com taaaak.com
surgut.zrus.org tattooreligion.ru
svarbit.com thebestweightlosspills.ovh
svtrd.com thebluffs.com
swingerseiten.com thecoolimages.net
swinon.site thedownloadfromwarez.blogspot.com
taboola.com theguardlan.com
tagil.zrus.org theporndude.com
tds-advert005.info thetoiletpaper.com
technika-remont.ru thin.me.pn
technopellet.gr threecolumnblogger.com
tecspb.ru timeallnews.ru
telegraf.by tizanidinecapsules.blogspot.com
templates.radiodigital.co tizanidinehcl4mgtab.blogspot.com
theplacetoupdating.pw tizanidinevssoma.blogspot.com
thetardistimes.ovh top-deal.com.pl
tizanidineformigraines.blogspot.com topcar-krasnodar.ru
tizanidineforopiatewithdrawal.blogspot.com torrents.life
tizanidinehcl2mgsideeffects.blogspot.com traderzplanet.in
tizanidinehcl4mgtabinfo.blogspot.com trafaret74.ru
tizanidinesleepaid.blogspot.com trafficgenius.xyz
tizanidinevsvalium.blogspot.com traffixer.com
tn811.us truck-land.life
tongkatmadura.info trumpetedextremes.com
torrents.cd tuberkulezanet.ru
tradgardspartner.se turkeyreport.tk
tri-slona.org tvand.ru
ttsq.fr twojebook.pl
tv-spoty.info typimga.pw
tvoystartup.ru uggbootsoutletsale.us
twodollarshows.com uginekologa.com
uac.net.au uhodzalijami.ru
ukkala.xyz ukrup.com
ukkelberg.no unisexjewelry.org
ukr-lit.com upupa.net
um-razum.ru urldelivery.com
umekana.ru urll.eu
unacittaconte.org ussearche.cf
uroffer.link vacuumscleaner.com
valuado.com vepad.com
vandrie-ict.nl via-energy-order.com
vapomnoncri.tk video-chat.in
vclicks.net video-chat.love
ventelnos.com videonsk.com
vereo.eu vip-parfumeria.ru
vgoloveboli.net vipromoffers.com
via-gra.webstarts.com vitalads.net
videochat.cafe vk-mus.ru
videochat.life
videogamesecrets.com
viel.su
vitanail.ru
viteonlusarezzo.it
vksex.ru
vladimir.zrus.org vladimir.zrus.org
voloomoney.com
voronezh.xrus.org voronezh.xrus.org
vykupavto-krasnodar.ru vote-up.ru
web.cvut.cz vseigry.fun
weblo.com vzlomfb.com
webpromotion.ae wardreapptokone.tk
websites-reviews.com watchdogs-2.ru
webstatsdomain.org watchinf.com
whatistizanidinehclusedfor.blogspot.com waterefficiency.co
whatsappbot.flyland.ru waysbetter.cn
whiteproduct.com webix.biz
whosonmyserver.com webmonetizer.net
winx-play.ru webnode.me
wordkeyhelper.com websiteaccountant.de
wttavern.com welck.octopis.com
wufak.com wikes.20fr.com
www.solartek.ru wildnatureimages.com
x-diesel.com win-spy.com
x-mix.info worldlovers.ru
x-musics.com wpthemedetector.co.uk
xitjw.info wrz0iuebwhp5fg.freeddns.com
www.event-tracking.com
x-true.info
xbaboon.com
xcombear.ru
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn--1-8sbcpb0bdm8k6a.xn--p1ai xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xn--d1aifoe0a9a.top xn--d1abj0abs9d.in.ua
xsfetish.org xn--e1aggki3c.xn--80adxhks
xtraffic.plus xn--oogle-wmc.com
xvideospornoru.com yes-com.com
xxxasianporn.net youghbould.wordpress.com
y8games-free.com youporn-forum.ga
yellocloud.be yourtemplatefinder.com
yourdesires.ru zeroredirect10.com
zhuravlev.info zeroredirect11.com
zoogdinsney.com zeroredirect5.com
zoosexart.com zetmaster.ru
zootoplist.com zixizop.net.ru
zygophyceous.womanstars.site zkjovpdgxivg.ga
zophim.me
zvuker.net
zynax.ua

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
03p.info 007angels.com
1hwy.com 01apple.com
2kata.ru 0c47f8422d3f.com
2pxg8bcf.top 101lesbian.xyz
4pp13.com 123cha.com
70casino.online 404.mn
888.com 4kpics.rocks
aa9bd78f328a6a41279d0fad0a88df1901.com 8gold.com
adbetclickin.pink aarbur.com
adman.gr adf.ly
adultfriendfinder.com advertisingtag.net
alienwheels.de advokat-grodno.by
amung.us afslankpillen2017nl.eu
android4fun.org aktobe.xkaz.org
anlimebel.kiev.ua anabolics.shop
anal-acrobats.hol.es
anapa-inns.ru
apartmentbay.ru
appmsr.org appmsr.org
asrv-a.akamaihd.net arclk.net
atelielembrancaqueencanta.com.br astana.xxxkaz.org
aviav.co atleticpharm.org
battlecarnival.su atley.eu.pn
beremenyashka.com babyfactory.fr
bizru.info bayareaaeroclub.org
blockety.co bestofferswalkmydogouteveryday.gq
bombla.org betteroffers.review
bonzybuddy.com bezlimitko.xyz
brainboosting.club bfz.biz
brainboostingsupplements.org bingoporno.com
break-the-chains.com biocn.dx.am
brewdom.ru bloggerads.net
brianhenry.co blpmovies.com
builtwith.com bonky.biz
burn-fat.ga bscodecs.com
bvlgariwallet.xyz bugshoot.cn
callejondelpozo.es buzzurl.jp
camsex.xxx-cam.webcam c-english.ru
casite-513049.cloudaccess.net californianews.cf
chimiver.info candcstuccoandstone.com
chocolateslim-en-espana.com canrole.com
cigarpass.com cardul.ru
clickcash.com cartujano-pre.de
clknsee.com cementaresearch.se
cntravelre.com clickso.com
comissionka.net compliance-george.xyz
construmac.com.mx coolingoods.com
creams.makeforum.eu creatives.adbetclickin.pink
credit.co.ua customchocolate.business-for-home.com
damedingel.ya.ru customerpromos-a.akamaihd.net
darkbooks.org cv.wallhade.co
digital-video-processing.com danashop.ru
dildofotzen.net danschawbel.com
dkvorota.ru ddpills.com
dojki-hd.com dentfidemountpreach.tk
dolohen.com design-ideas.info
domcran.net dieswaene.com
dosugrostov.site diffbot.com
downloads-whatsapp.com divci-hry.info
e705.net doska-vsem.ru
energy-ua.com dptaughtme.com
errorfixing.space dynainbox.com
eshop4u.jp earncash.com.ua
exci.ru editmedios.com
ezigarettekaufen2.yolasite.com elektrischezigarette1.blog.pl
f-online.de elektrozigaretten2.yn.lt
falllow.gq elidelcream.weebly.com
fast-torrent.ru enternet.ee
fermersovet.ru envaseslotusama.com
fetlifeblog.com esopini.com
fickenprivat.info exoneration-project.us
filmi-v.online extlinks.com
findpics.pw faithe.top
fitness-video.net faracontrol.ir
fitnesspiks.com fashion.stellaconstance.co
foodcrafts.website faz99.com
forensicpsychiatry.ru ferieboligkbh.dk
free-stock-illustration.com finstroy.net
freegamesplay.online fix-website-errors.com
fullgirl.ru forodvd.com
galaxyflowers.ru frcls.fr
gay.adultgalls.com freecamdollars.com
gaygalls.net freenom.link
getmiro.com freeuploader.com
gettpromos.com freshwallpapers.info
gg-arena.ru frustrated-favorable.gq
goldadpremium.com fuckmill.com
gribkovye-zabolevaniya.com g7m.pl
guod.me gardene.ru
havepussy.com geilehausfrauen.net
help.tpu.ru getmyads24.com
hitmuzik.ru glavtral.ru
hollywoodactress.info gotwebsite1.com
honyaku.yahoofs.jp greenidesign.co
ideoworld.org gsasearchengineranker.site
ilovevitaly.xyz gwagka.com
iminent.com hawaiisurf.com
immigrational.info hoterika.com
import-sales.com hothor.se
insider.pro ifirestarter.ru
insurple.com iideaidekonkatu.info
integritylandscapeservices.com imk.com.ua
isitwp.com immobiliaremassaro.com
istizanidineanopiate.blogspot.com indiakino.net
japfm.com insta-add.pro
journalhome.com interferencer.ru
jpcycles.com internetartfair.com
justucalling32211123456789.tk investsuccess.org
katjimej.blog.fc2.com juliadiets.com
kimcurlrvsms.com kareliatobacco.ru
kinky-fetishes.com kazrent.com
kinofak.net keywordspay.com
kinomaniatv.pl konkursowo-24.pl
konturkrasoty.ru konoplisemena.com
kosmetyki.tm.pl kosova.de
kreativperlen.ch krynica.info
kuzinsp.ru ladov.ru
labafydjxa.su leboard.ru
laptop-4-less.com lechtaczka.net
lenvred.org lionking-1994.blogspot.com
letsart.ru lirunet.ru
live-cam6.info live-sexchat.ru
liveshoppersmac.com liverpool.gsofootball.com
lob.com.ru m.b00kmarks.com
lookingglassemb.com mackeeper-land-672695126.us-east-1.elb.amazonaws.com
macdamaged.space manipulyator-peterburg.ru
maxxtor.eu matsdale.com
mbiologi.ru mezaruk.info
medicines-choice.com milblueprint.com
megaindex.ru misandesign.se
mejoresfotos.eu mobplayer.net
methodsmarketing.com monclerjacketsoutlet.win
microsearch.ru moncleroutletonline.win
mir-business-24.ru money-for-placing-articles.com
missclub.info moneyzzz.ru
mobile-appster.ru music7s.me
monclerboots.xyz my-aladin.com
moxo.com
musicktab.com
my-bc.ru my-bc.ru
mykings.pw my-floor.in.ua
mylovelibrabry.com myra.top
mypornfree.ru naphukete.ru
myseoconsultant.com nevansk.ru
new-post.tk obuv-kupit.ru
nikkiewart.ru officedocuments.net
nrjmobile.fr onlyporno.ru
obnal.org openstat.com
oconto.ru osoznanie-narkotikam.net
odoratus.net palocco.it
onlinadverts.com photosaga.info
online-x.ru picanalyzer.data-ox.com
onlineserialy.ru piratecams.com
onlyforemont.ru pixelrz.com
ooo-gotovie.ru playboyfiles.xblog.in
ordernorxx.com playlott.com
origin-my.ru pogodnyyeavarii.gq
pacificair.com pornoforadult.com
paleohub.info pornolook.net
papasdelivery.ru pregnant.guru
partnerads.men privatefx.all4invest.info
phobia.us prlog.ru
picsfair.com prodvigator.ua
pisanieprac.info proekt-mos.ru
pornhub-ru.com profitkode.com
porno-play.net prostitutki-novgoroda.org
pornogratisdiario.com prostitutki-yaroslavlya.org
portside.xyz quality-traffic.com
powc.r.ca.d.sendibm2.com qwertty.net
propranolol40mg.blogspot.com ratemodels.net
prosperent.com rating-bestcasino.com
proxyradar.com reklamuss.ru
radiogambling.com remontbiz.ru
recinziireale.com retreatia.com
redirectme.net rewardit.com
relayblog.com riralmolamsaca.tk
remote-dba.de robertefuller.com
renhacklids.tk rogervivierforsale.com
rep-am.com russian-postindex.ru
rfd-split.hr russkie-gorki.ru
royalvegascasino.com sale-japan.com
running-line.ru santasgift.ml
ruspdd.com semalt.com
s.lollypopgaming.com seoboxes.com
samo-soznanie.ru seorankinglinks.com
sanjosestartups.com serptehnika.ru
sardinie.us service.adtech.us
sbdl.no seryeznie-znakomstva.ru
sbricur.com sexblog.pw
scanspyware.net sexreliz.com
school-diplomat.ru sexvideo-sex.com
security60-e.com shoesonlinebuy.xyz
selectads.men sinel.info
serpstat.com skachat-besplatno-obrazcy.ru
sextracker.de skyway24.ru
shtaketniki.ru
simple-share-buttons.com
sims-sims.ru
site3.free-share-buttons.com
slim.sellany.ru slim.sellany.ru
socialseet.ru slujbauborki.ru
sohoindia.net softonicads.com
stardevine.com softtor.com
start.myplaycity.com softxaker.ru
stefanbakosab.se sogimlecal.tk
stpolice.com sosdepotdebilan.com
stroy-portal22.ru spywareit.com
students-cheapskate.ml stal-rulon.ru
support.nopeas.sk stroyplus.ru
t3chtonic.com survival.betteroffers.review
taaaak.com syndicate.fun
tabakur77.com taximytishi.ru
tabletkinaodchudzanie.com.pl telemetryverification.net
tfxiq.com teslathemes.com
theautoprofit.ml thedownloadfreeonlinegames.blogspot.com
ticketsys.inetwd.com thedownloadfromwarez.blogspot.com
timhost.ru tiandeural.ru
titan-cloud.life timeallnews.ru
tivolibasket.it tizanidineforopiatewithdrawal.blogspot.com
tizanidine4mg.blogspot.com tonerbox.kz
tizanidinehcl4mgtab.blogspot.com ukkala.xyz
tizanidineinfo.blogspot.com ukrtvir.com.ua
trafficcentr.xyz
truck-addzilla.life
truebeauty.cc
turbabitload.weebly.com
ugogo.info
uhodzalijami.ru
urldelivery.com urldelivery.com
usacasino.com usdx.us
vasileostrovsky-rayon.ru vegan-foods.us
vchulkah.net vegascosmetics.ru
via-gra.webstarts.com verymes.xyz
videochat.ph video--production.com
videositename.com vladimir.xrus.org
visionwell.com.cn voloslove.ru
voloomoney.com vzlomtw.com
voluumtracker1.com watchmyfb.pl
webpromotion.ae westum.se
wikes.20fr.com wheelchairliftsarea.com
word-vorlagen.net while.cheapwebsitehoster.com
workle.website wordkeyhelper.com
www.solartek.ru worldmusicfests.com
xblognetwork.com worldoffiles.ru
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai www.souvenirua.com
xn--c1acygb.xn--p1ai wzgyyq.com
yougame.biz x-diesel.org
youporn-forum.ga xjlottery.com
yourothersite.com xjrul.com
zagadki.in.ua xn----ctbigni3aj4h.xn--p1ai
zazagames.org xn--80ak6aa92e.com
xn--b1adccaf1bzj.xn--p1ai
xsfetish.org
ynymnwbm.bloger.index.hr
youdesigner.kz
yougotanewdomain.com
youporn-ru.com
youtoner.it
zolotoy-lis.ru zolotoy-lis.ru
zoominfo.com zoominfo.com
zootravel.com
zverokruh-shop.cz

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.201 0; 10.1.0.69 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3229 ### Version: V4.2022.07.3230
### Updated: Fri Jul 15 10:03:42 UTC 2022 ### Updated: Fri Jul 15 22:01:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3229 ### Version: V4.2022.07.3230
### Updated: Fri Jul 15 10:03:42 UTC 2022 ### Updated: Fri Jul 15 22:01:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##