vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.05.3090 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-05-07 10:09:19 +00:00
parent f340190ade
commit 4bafba4d2c
46 changed files with 96923 additions and 96923 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3089 #### Version: V4.2022.05.3090
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3089 #### Version: V4.2022.05.3090
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.05.3089 #### Version: V4.2022.05.3090
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11980
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.05.3089 #### Version: V4.2022.05.3090
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11984
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11984
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11984
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11984
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 1; 10.1.0.234 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 0; 10.1.0.234 0;
127.0.0.1 0; 127.0.0.1 0;

11984
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 1; 10.1.0.234 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 0; 10.1.0.234 0;
127.0.0.1 0; 127.0.0.1 0;

11984
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 1; 10.1.0.234 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 0; 10.1.0.234 0;
127.0.0.1 0; 127.0.0.1 0;

11984
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3089 3090

11984
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11984
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.66.122.102 0; 20.150.151.228 0;

11984
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 1; 10.1.0.234 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 0; 10.1.0.234 0;
127.0.0.1 0; 127.0.0.1 0;

11984
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 1; 10.1.0.234 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 0; 10.1.0.234 0;
127.0.0.1 0; 127.0.0.1 0;

11984
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 1; 10.1.0.234 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 0; 10.1.0.234 0;
127.0.0.1 0; 127.0.0.1 0;

11984
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.66.122.102 0; 20.150.151.228 0;

11984
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.66.122.102 0; 20.150.151.228 0;

11984
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 1; 10.1.0.234 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
360Spider ASPSeek
Id-search AfD-Verbotsverfahren
IndeedBot Alexibot
Leap BuiltBotTough
Mediatoolkitbot Express WebPictures
Meanpathbot
Nameprotect Nameprotect
Sqworm NetLyzer
Toweyabot Netcraft
Upflow Sociscraper
VidibleScraper

298
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker
404enemy 404enemy
80legs AIBOT
Aboundexbot
Acunetix Acunetix
AhrefsBot AhrefsBot
Aipbot AllSubmitter
Alexibot
AlphaBot AlphaBot
Anarchy Anarchy99
Ankit Anthill
Asterias Aspiegel
AwarioSmartBot BBBike
BDCbot BDCbot
BLEXBot BDFetch
BackDoorBot
BackStreet
BackWeb BackWeb
Badass Backlink-Ceck
BetaBot BacklinkCrawler
Bigfoot Bandit
Black Hole Barkrowler
Blow
BotALot BotALot
BuiltBotTough BuiltBotTough
Bullseye BuiltWith
BunnySlippers BunnySlippers
CATExplorador
CCBot CCBot
CODE87 CSHttp
CazoodleBot Calculon
Cegbfeieh
CheTeam
CheeseBot CheeseBot
ChinaClaw ChinaClaw
Chlooe Chlooe
Cliqzbot Cogentbot
Cloud mapping Collector
Copyscape
Cosmos Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
Curious Curious
Custo Custo
DIIbot DBLBot
DSearch DSearch
Devil DTS Agent
DigitalPebble Demon
Dirbuster Digincore
Discobot
DittoSpyder DittoSpyder
DomainAppender DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dragonfly Domains Project
Drip Download Wonder
EMail Siphon
EasyDL
Ecxi Ecxi
EroCrawler Express WebPictures
Evil Extractor
ExtLinksBot ExtractorPro
FDM Extreme Picture Finder
EyeNetIE
FHscan FHscan
Fimap FemtosearchBot
Firefox/7.0
Flunky
Foobot Foobot
Freeuploader Freeuploader
FrontPage G-i-g-a-b-o-t
FyberSpider GT::WWW
GalaxyBot
Genieo Genieo
GetRight GetRight
GetWeb GetWeb
Gigabot Gigabot
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
Grabber GoZilla
GrapeFX Gotit
GrapeshotCrawler GrapeshotCrawler
GridBot GridBot
Harvest HEADMasterSEO
Hloader HTTP::Lite
Humanlinks Haansoft
IDBTE4M Havij
IDBot
Iblog
Id-search Id-search
IlseBot IlseBot
IndeedBot
Indy Library Indy Library
InfoNaviRobot
InfoTekies InfoTekies
Internet Ninja Intelliseek
InterGET
InternetSeer
Iskanie Iskanie
IstellaBot
JOC Web Spider JOC Web Spider
Jbrofuzz Jbrofuzz
JennyBot JikeSpider
Jetty Joomla
JustView Jyxobot
Keyword Density Kenjin Spider
Kozmosbot Kozmosbot
LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot
Larbin
Leap Leap
LeechGet LeechGet
LexiBot Lftp
Libwhisker Lightspeedsystems
LieBaoFast LinkextractorPro
LinkScan LinqiaScrapeBot
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider Lmspider
MIDown tool MIDown tool
Magnet MIIxpc
MJ12bot
MSIECrawler
MTRobot
Majestic SEO Majestic SEO
Majestic12 Majestic-SEO
Masscan MarkMonitor
Mata Hari Mass Downloader
MeanPath Bot Meanpathbot
MegaIndex.ru MicroMessenger
Minefield
Mister PiX
Moblie Safari Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Mozlila
Mr.4x3
Name Intelligence
Navroad
Needle Needle
Net Vampire Nessus
NetMechanic
NetSpider NetSpider
NetZIP Netcraft
Nettrack Nettrack
Netvibes Netvibes
Nutch Nikto
Offline Navigator NimbleCrawler
Nimbostratus
Nuclei
OnCrawl OnCrawl
Openfind
OrangeSpider OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PageScorer PECL::HTTP
Papa Foto PHPCrawl
Pavuk Pandalytics
Panscient
PeoplePal
Petalbot Petalbot
Pi-Monster
Picscout Picscout
Picsearch
PictureFinder
Piepmatz Piepmatz
Pimonster Pimonster
Pixray ProPowerBot
Pockey PyCurl
Psbot RankActive
Pump RankFlex
Quick-Crawler RankurBot
RankActiveLinkBot RealDownload
RebelMouse RepoMonkey
RocketCrawler
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler SEOstats
SISTRIX SISTRIX
SMTBot SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming Screaming
ScrepyBot ScrepyBot
SearchmetricsBot Seekport
SemanticJuice SemrushBot
SentiBot SeoSiteCheckup
SeobilityBot SeobilityBot
Shodan
Siphon
Site Sucker
SiteSnagger
SiteSucker SiteSucker
Sitebeam Sitebeam
Snoopy SlySearch
Sociscraper Snapbot
Sogou web spider Sogou web spider
Sosospider SpaceBison
SpankBot SpankBot
Spanner Sqlmap
Spinn3r Sucker
Sqworm
Stripper
Sucuri
SuperHTTP SuperHTTP
Surfbot Surfbot
Suzuran T0PHackTeam
Szukacz
TeleportPro TeleportPro
Telesoft Telesoft
Telesphoreo Telesphoreo
The Intraformant The Intraformant
TheNomad TheNomad
Thumbor Thumbor
Turnitin TightTwatBot
Toweyabot
True_Robot
TurnitinBot TurnitinBot
TwengaBot
Twice Twice
Typhoeus Typhoeus
URLy.Warning
Upflow Upflow
VidibleScraper V-BOT
VCI
Virusdie
Voil Voil
WBSearchBot WBSearchBot
WEBDAV WEBDAV
WISENutbot WISENutbot
WPScan WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWWOFFLE WWWOFFLE
Wallpapers Web Collage
Wallpapers/3.0 Web Pix
Web Auto
Web Enhancer
Web Sauger Web Sauger
WebFetch WebBandit
WebCopier
WebFuck
WebGo IS WebGo IS
WebImageCollector WebPix
WebLeacher
WebReaper WebReaper
WebSauger WebStripper
Website Quester WebZIP
WebsiteQuester Whack
Whacker Whacker
Widow
WinHTTrack WinHTTrack
Woobot Woobot
Wotbox
Wprecon Wprecon
Xaldon_WebSpider YoudaoBot
Xenu Zauba
Zermelo Zeus
ZumBot Zitebot
ZyBorg ZmEu
archive.org_bot ZoominfoBot
arquivo-web-crawler adscanner
backlink-check autoemailspider
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j crawler4j
domainsproject.org eCatch
heritrix facebookscraper
instabid internetVista monitor
ips-agent
isitwp.com isitwp.com
linkdexbot
lwp-request lwp-request
magpie-crawler magpie-crawler
meanpathbot meanpathbot
muhstik-scan oBot
netEstate NE Crawler polaris version
s1z.ru probe-image-size
satoristudio.net
seocompany.store
sexsearcher sexsearcher
sp_auditbot sitechecker.pro
tAkeOut sogouspider
voyagerx.com spyfu
x09Mozilla ubermetrics-technologies.com
x22Mozilla webmeup-crawler
zgrab webpros.com
xpymep1.exe

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 360Spider
404enemy
ADmantX ADmantX
AIBOT ASPSeek
Abonti Abonti
Aboundexbot Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AiHitBot
Alexibot
Alligator
AlphaBot AlphaBot
Anarchy Anarchie
Anarchy99
Anthill
Apexoo Apexoo
Aspiegel Atomseobot
Asterias Attach
AwarioRssBot AwarioRssBot
BBBike
BLEXBot BLEXBot
BackDoorBot Barkrowler
BackStreet BatchFTP
BackWeb Battleztar Bazinga
Backlink-Ceck BlackWidow
BacklinkCrawler Blackboard
Badass Boardreader
CATExplorador Bolt
CSHttp BuiltWith
Bullseye
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CensysInspect CensysInspect
CheTeam CheTeam
ChinaClaw
Chlooe
Citoid
Cliqzbot Cliqzbot
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project Crawling at Home Project
Crescent CrazyWebCrawler
DIIbot CrunchBot
Custo
CyotekWebCopy
DBLBot
DSearch DSearch
DatabaseDriverMysqli
Demon Demon
Deusu Deusu
Dirbuster Digincore
DnyzBot Dispatch
DomCopBot
DomainCrawler
DomainStatsBot
Dotbot Dotbot
Download Wonder
Dragonfly Dragonfly
ECCP/1.0 EasyDL
Ecxi Ebingbong
EirGrabber EirGrabber
Exabot Evil
Express WebPictures Express WebPictures
ExtLinksBot Extractor
ExtractorPro Extreme Picture Finder
EyeNetIE
FDM
FHscan FHscan
FemtosearchBot
Firefox/7.0
Flunky Flunky
Freeuploader
FrontPage FrontPage
Fuzz Fuzz
G-i-g-a-b-o-t
GT::WWW GT::WWW
GalaxyBot
Genieo Genieo
Gotit GetRight
Gigabot
Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot HEADMasterSEO
HMView HMView
HaosouSpider
Harvest Harvest
Heritrix
Hloader
HonoluluBot HonoluluBot
Humanlinks
IDBTE4M IDBTE4M
IDBot
IRLbot IRLbot
Iblog Iblog
IlseBot
Image Fetch Image Fetch
InfoNaviRobot Indy Library
InterGET InfoTekies
Internet Ninja Internet Ninja
InternetSeer InternetSeer
Iskanie Iskanie
Jbrofuzz Jetty
JikeSpider Jorgee
Keybot Translation-Search-Machine JustView
Keyword Density Kenjin Spider
Kinza
Kozmosbot Kozmosbot
Lanshanbot Lanshanbot
Leap Larbin
LexiBot
LibWeb LibWeb
LieBaoFast Likse
LinkScan LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
LinksManager LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Spider Lipperhey
Lmspider Lmspider
Ltx71 Ltx71
MIDown tool MQQBrowser
MIIxpc
MSIECrawler MSIECrawler
Magnet MTRobot
Mail.RU_Bot Majestic SEO
Majestic12
MarkMonitor MarkMonitor
MarkWatch Mb2345Browser
Mass Downloader Meanpathbot
Masscan Mediatoolkitbot
MeanPath Bot MegaIndex.ru
MicroMessenger
Microsoft Data Access Microsoft Data Access
Minefield Microsoft URL Control
Mister PiX Moblie Safari
Mojolicious MolokaiBot
NICErsPRO Morfeus Fucking Scanner
Nameprotect Name Intelligence
Needle Needle
NetAnts NetAnts
NetSpider NetMechanic
NetZIP NetZIP
Netcraft Nettrack
NextGenSearchBot Netvibes
Nibbler Niki-bot
NimbleCrawler Nimbostratus
Octopus Not
OnCrawl Nutch
OpenLinkProfiler OpenLinkProfiler
Openvas OpenVAS
Openfind
OrangeBot OrangeBot
OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot
Page Analyzer Page Analyzer
PageAnalyzer PageScorer
PeoplePal Petalbot
Picscout
PictureFinder PictureFinder
Pimonster PleaseCrawl
Pixray Pockey
ProPowerBot ProWebWalker
Psbot PyCurl
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive RSSingBot
RankFlex RankFlex
RankingBot RankingBot
Rankivabot RankingBot2
RankurBot
ReGet ReGet
RebelMouse RealDownload
Recorder
RedesScrapy RedesScrapy
Rogerbot RocketCrawler
SBIder SBIder
SEOkicks SISTRIX
SEOprofiler
SEOstats
ScanAlert
Scanbot Scanbot
ScoutJet Screaming
Scrapy
ScreenerBot ScreenerBot
Seekport ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
Semrush Semrush
SemrushBot
SentiBot
Seomoz
Shodan
Site Sucker Site Sucker
SiteExplorer SiteLockSpider
SiteSnagger
Sitebeam Sitebeam
Sitevigil
Snapbot Snapbot
SocialRankIOBot Snoopy
Sociscraper Spammen
Sosospider SpankBot
Spanner Spbot
Spinn3r Stripper
SputnikBot Sucker
Steeler Sucuri
SuperHTTP
Surfbot
Suzuran
Teleport
Telesoft Telesoft
Telesphorep Thumbor
TightTwatBot TightTwatBot
Titan Titan
Trendictionbot
True_Robot
Turingos Turingos
Turnitin
TurnitinBot TurnitinBot
TwengaBot
Twice Twice
URLy Warning
URLy.Warning URLy.Warning
VB Project VB Project
Vacuum
Vagabondo Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
Virusdie
VoidEYE VoidEYE
Voltron WASALive-Bot
Web Collage WEBDAV
WPScan
WWW-Mechanize
Wallpapers/3.0
WeSEE
Web Enhancer
Web Pix Web Pix
Web Sauger Web Sucker
WebBandit WebBandit
WebCollage WebLeacher
WebEnhancer WebReaper
WebGo IS WebStripper
WebImageCollector
WebPix
WebSucker
WebWhacker
WebZIP WebZIP
WebmasterWorldForumBot
WebsiteQuester WebsiteQuester
Whacker Whack
Widow
Wonderbot Wonderbot
Woobot
Wprecon Wprecon
Zade YoudaoBot
Zauba Zeus
Zitebot
ZoomBot ZoomBot
ZoominfoBot
ZumBot ZumBot
adscanner arquivo-web-crawler
archive.org_bot
arquivo.pt arquivo.pt
cah.io.community check1.exe
coccocbot
cognitiveseo cognitiveseo
crawl.sogou.com crawler.feedback
crawler4j demandbase-bot
domainsproject.org domainsproject.org
facebookscraper
gopher
heritrix
isitwp.com
iubenda-radar iubenda-radar
linkdexbot
lwp-request lwp-request
meanpathbot
muhstik-scan muhstik-scan
oBot plumanalytics
polaris version polaris version
ripz
s1z.ru
satoristudio.net satoristudio.net
scalaj-http seoscanners
scan.lol seostar
seocompany.store
serpstatbot
sitechecker.pro sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu spyfu
trendiction.de trendiction.com
webpros.com webpros.com
webprosbot xpymep1.exe
x09Mozilla
x22Mozilla
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
atout-energie-69.com bscodecs.com
findacheaplawyers.com cigarpass.com
integritylandscapeservices.com conocer-sanabria.com
kellyonline.xyz goldandcard.ru
krassh.ru mansparskats.com
manualterap.roleforum.ru mega-bony2017.pl
otbelivanie-zubov.com onlinefilmz.net
rating-casino2021.ru roma-kukareku.livejournal.com
taihouse.ru sell-fb-group-here.com
viven.host.sk zocaparj.kz

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1000n1.ru 0n-line.tv
101raccoon.ru 10bet.com
123locker.com 1flag.co.za
1kinobig.ru 404.mn
1webmaster.ml 4istoshop.com
2pxg8bcf.top 4k-player.pl
2x2fan.ru 4rent.ru
3weekdiet.com 4ureyesonly.com
4replicawatch.net 76brighton.co.uk
4webmasters.org 7search.com
6128786.com 8gold.com
7makemoneyonline.com DomainStatsBot
aa8b68101d388c446389283820863176e7.com abcdefh.xyz
aab94f698f36684c5a852a2ef272e031bb.com abclauncher.com
abbanreddy.com abctoppictures.net
abcguru.xyz absugars.com
absolutelyanalog.com academia-nsk.org
adanih.com actionnooz.com
adhome.biz addblueoff.com.ua
adpremium.org adf.ly
adtech.us adloads.com
adviceforum.info adman.se
alevinefesleri.com ads.tremorhub.com
allblogroll.com adultfullhd.com
allkrim.com advertex.info
allornamenti.com advocatemsk.ru
allproblog.com advokateg.xyz
alphahoverboards.com aerogo.com
afora.ru
aibolita.com
airmaxshoes-2016.com
alekseevec.ru
alert-hgd.xyz
alfa9.com
alif-ba-ta.com
allbizne.co.ua
allknow.info
altamayoztourism.com
amung.us amung.us
android4fun.org andpolice.com
apimountainbikei-a.akamaihd.net apiadanaknet-a.akamaihd.net
apioasisspacenet-a.akamaihd.net apiitsthirteende-a.akamaihd.net
app-ready.xyz approved.su
apple.com-cleaner.systems approvedlocal.co.za
apxeo.info appsaurus.com
articlesdirectoryme.info arius.tech
asrvrep-a.akamaihd.net arraty.altervista.org
asrvvv-a.akamaihd.net
auto4style.ru
autoblogger24.info
autobrennero.it autobrennero.it
aviav.ru.com autodo.info
avkzarabotok.com autotrends.today
avon-novosib.ru avitocars.ru
avon-severozapad.ru ayerbo.xhost.ro
azazaporn.com baditri.com
azazu.ru
azbukafree.com
backgroundpictures.net
bag77.ru bag77.ru
balois.worldbreak.com balook.com
baltgem.com barbourjackets.online
battle.net battlecarnival.su
beauby.ru beatifullandscape.co
beauty-bracelet.com berdasovivan.ru
belstaffstore.online best-deals-products.com
best-seo-solution.com bestofupload.info
bestadbid.com big-boards.info
bestbuy.ca bildsuche.ru
bestwebsiteawards.com biznesluxe.ru
beta.hotkeys.com blackwitchcraft.ru
bgviagrachrx.com brainxs.us
big-cash.net brandedleadgeneration.com
bikini-image.com brokergid.ru
bitcoins-live.ru brus.city
bitporno.sx btnativenav.com
bjetjt.com bukleteg.xyz
blacktwhite.com buron.pw
blobar.org buy-cheap-pills-order-online.com
bloggen.be calstaterealty.us
bloggerads.net candcstuccoandstone.com
boeuklad.com
bonky.biz
boobsimge.com
brianhenry.co
btc4u.ru
buigas.00it.com
buqayy0.livejournal.com
businesn.men
buttons-for-website.com
buzz-porno.info
bvlgariwallet.xyz
call-of-duty.info
callejondelpozo.es
callmd5map.com
callstevens.com
cand.jp
capacitacionyaprendizaje.com capacitacionyaprendizaje.com
carina-sy.de carabela.com.do
cartierlovebracelet.xyz cardsharp1.ru
cbb1smartlist12.click carstrends2015.com
cbcseward.com cartierreplica.xyz
cbozhe.com cartierwatch.xyz
cdncash.com cayado.snn.gr
cementaresearch.se celejihad.info
cenoval.ru
censys.io
centre-indigo.org.ua
ceotrk.com
cheapbarbour.online cheapbarbour.online
cheapestjerseysonwholesale.com checkhit.com
cheapjerseysap.com christianlouboutinsaleonline.us
checktext.org christianlouboutinshoes.xyz
chimiver.info ci.ua
chocolateslim-en-espana.com circlesl.com
christianlouboutinreplica.win
cialischsrx.com
cialisovercounteratwalmartusa.com
clash-clans.ru clash-clans.ru
classicakuhni.ru clmforexeu.com
clickcash.com coindirect.io
clicksor.net comissionka.net
clipartnew.com companies-catalog.com
clothesforcash.com compliance-alex.xyz
coaching-netz.info compliance-barak.top
collegerentals.com compliance-fred.top
compliance-barak.xyz
compliance-mary.top
conboy.us conboy.us
converse.ddsoldes.fr consorzioilmosaico.org
cookielawblog.wordpress.com cookie-law-enforcement-aa.xyz
coolwallpapers4k.info copblock.org
coolyarddecorations.com credit-online.ws
corta.co credit-respect.ru
costablue.xyz custom-electric-guitar.com
cracksplanet.com customcollegeessays.net
credit.co.ua cvety24.by
crest3d.ru d-black.bz
crystalslot.com damedingel.ya.ru
customcatchcan.com danashop.ru
darmebel.com.ua date-withme.com
dataloading.net ddpills.com
destinationrealestate.com deda-moroza-zakaz.ru
dieta-personalna.pl den-noch24.ru
diffbot.com descargar-musica-gratis.net
dispo.de designdevise.com
djonwatch.ru deutschland123.de
dkvorota.ru discountliv.com
doctissimo.fr discovertreasurenow.com
doctormakarova.ru divku.ru
documentsite.net docsportal.net
domainsatcost.com dollartree.info
dominateforex.ml domaincdn.xyz
dostavka-v-ukrainu.ru domaincheck.io
download-walpaperhd.blogspot.com domznaniy.ru
druzhbany.ru dorratex.tn
eachdayisagift.review download-wallpaper.net
edge.sharethis.com downloads-whatsapp.com
editmedios.com drev.biz
ekn-art.se drupa.com
ekobata.ru dumpsmania24.com
ekspertmed.com dvd-famille.com
electrik-avenue.com earthmagic.info
elektrozigarette2.webs.com eleimgo.pw
elektrozigaretten1.postbit.com elektrischezigaretten2.beeplog.com
empis.magix.net elexies.info
engines-usa.com encodable.com
enhand.se energydiet24.ru
erectile.bid erotische-geschichten-xxl.com
eredijovon.com escort-russian.com
eu-cookie-law.blogspot.com esfchat.tk
europages.com.ru essay-writing.work
exoneration-project.us eu-cookie-law.info
ezaz.info euronis-free.com
ezigarettenkaufen2.dreamwidth.org euroskat.ru
ezigaretteshop2.mywapblog.com executehosting.com
ezigaretteshop2.vefblog.net expdom.com
f07.de extlinks.com
facecup.top eyes-on-you.ga
factorynightclub.com f012.de
falllow.gq facebook-mobile.xyz
familyholiday.ml fanrto.com
farm26.ru fastfixing.tech
fashionindeed.ml fatmaelgarny.com
fba-mexico.com fba-mexico.com
femmesdenudees.com femdom.twiclub.in
fenoyl.batcave.net fenoyl.batcave.net
ferrotodo.com ferieboligkbh.dk
filesvine.com fifa-coins.online
filmidivx.com fishtauto.ru
filunika.com.ru floating-share-buttons.com
findpik.com fodelsedagspresenter.nu
fireads.men forex.osobye.ru
fitfloponline.store forsex.info
footbalive.org forum-engineering.ru
forexgb.ru forums.toucharcade.com
forum.poker4life.ru foto-weinberger.at
forum20.smailik.org foxjuegos.com
foxinsocks.ru free-traffic.xyz
free-floating-buttons.com free411games.com
free-laptop-reward.com freewareseek.com
free-video-tool.com funnypica.com
freevpn.space galaxys6manual.info
fxund.us
galleryawesome.com galleryawesome.com
gambarxkata.co gameprimary.com
gamedayassist.com gamesprite.me
gamedayhouse.com get-seo-domain.com
gamerextra.com glastecfilms.com.my
gaypornmovie.net
geckoandfly.com
gigapeta.com
gk-atlant.info
glall.ru
glass-msk.ru
glcomputers.ru glcomputers.ru
glicol.kz gogalleryawesome.com
globalscam.ga goodhumor24.com
go2mike.ru goodwriterssales.com
goldadpremium.com googlefeud.com
goldpanningtools.com greatgrace.ru
goodhousekeeping.com haikuware.com
gopro-online.info hawaiielectriclight.com
grizzlysgrill.com hermesreplica.pw
grtyi.com homegardenlova.com
grupografico-pilar.com.ar homemature.net
gsasearchenginerankerdiscount.com host-tracker.com
guardlink.com hotshoppymac.com
gunsvicceadadebt.tk houtings.xyz
hdwalls.xyz hoverboard360.nl
hem.passagen.se humbmosquina.tk
hermesbracelets.xyz ibb.com.ua
histock.info ico.re
homeinns.com ihc2015.info
homemade.gq ilikevitaly.com
homik.pw infostatsvc.com
host-protection.com inome.com.ua
hotblognetwork.com int.search.tb.ask.com
hotloans.ru internet-apteka.ru
hotsocialz.com intimshop-fantasy.ru
howtowhitenteethfast.xyz iomoio.net
hyiphunter.org irunfar.com
iamsport.org isitwp.com
iboss.com islandminingsupply.wordpress.com
imgata.com istizanidinelikexanax.blogspot.com
inmate-locator.us itrevolution.cf
investmac.com iusstf.org
investsuccess.org jav-idol.com
io9.com jerseychinabizwholesale.us
iopeninghours.co.uk jillepille.com
iplusbit.blogspot.co.za
irkutsk.online-podarki.com
ixora.pro
jimmychoosale.online
jjbabskoe.ru jjbabskoe.ru
job.icivil.ir johannesburgsingles.co.za
juliaworld.net justkillingti.me
jus0wil.pp.ua keywordbasket.com
karachev-city.ru keywordblocks.com
kashubadesign.ru keywordhouse.com
kfon.eu keywordsuggests.com
kinky-fetishes.com keywordteam.net
kino-filmi.com kino-ecran.ru
kinoflux.net kino-rf.ru
kinobest.pl
kinocccp.net
kinogolos.ru kinogolos.ru
kinohit1.ru kleine-titten.biz
kol-energo.ru kollekcioner.ru
kolotiloff.ru komputers-best.ru
krasivye-devushki.net kountrylife.com
krasnodar.zrus.org kustanay.kz
kredit-pod-zalog-krasnodar.ru ladsblue.com
ktotut.net ladsup.com
kvartir-remont.biz lancheck.net
lescinq.com landscaping.center
letolove.ru laserpen.club
lexiangwan.com lawyersinfo.org
linerdrilling.com laxdrills.com
lomb.co lazy-z.com
lonely-mature.com lightinghomes.net
luchshie-topcasino.ru linkpulse.com
luckyshop.net.ua linkrr.com
makemoneyonline.com liquimondo.com
mantramusic.ru littleberry.ru
mapquestz.us ljusihus.se
matematikus.info lol-smurfs.com
matsdale.com lonerangergames.com
losangeles-ads.com
lovasszovetseg.hu
m-google.xyz
m1media.net
m292.info
m5home.ru
mabdoola.blogspot.com
makenahartlin.com
map028.com
marblestyle.ru
maximilitary.ru
me-ke.com me-ke.com
mediaoffers.click
medicinacom.ru
medosmotr-ufa.ru medosmotr-ufa.ru
mesbuta.info mega-bony-2017.pl
mega-polis.biz.ua
mejoresfotos.eu
metafilter.com metafilter.com
mhi-systems.ru metascephe.com
michellblog.online micasainvest.com
microsoftportal.net militarysale.pro
middlerush-a.akamaihd.net minegam.com
milblueprint.com mirzonru.net
mindbox.co.za mixed-wrestling.ru
miniature.io mobile-appster.ru
mir-business-24.ru mobioffertrck.com
mnogabukaff.net mojpregled.com
mockupui.com monetizationking.net
morpicert.pw moneymaster.ru
moskva.nodup.ru moonci.ru
mossmesi.com movpod.in
mrwhite.biz mrbojikobi4.biz
myblogregistercm.tk mriyadh.com
mygameplus.ru mug-na-chas-moscow.ru
muizre.ru
musicdaddy.net
musicstock.me
mwtpludn.review
mylesosibirsk.ru mylesosibirsk.ru
naphukete.ru myliveblog.ru
national-today-winning-winner.club mysexpics.ru
netanalytics.xyz mystats.xyz
nevansk.ru najaden.no
newfilmsonline.ru nardulan.com
nextbackgroundcheck.gq nastydollars.com
naughtyconnect.com
negociosdasha.com
netvouz.com
nextconseil.com nextconseil.com
nordvpn.com nfljerseyscheapbiz.us
nlfjjunb5.ru
notasprensa.info
noumeda.com noumeda.com
nucia.biz.ly novosibirsk.xrus.org
o-o-6-o-o.com npoet.ru
nuit-artisanale.com
o-o-8-o-o.com
o00.in
oconto.ru oconto.ru
odywpjtw.bloger.index.hr okout.ru
okonich.com.ua onlinebay.ru
oneclickfiles.com ooo-gotovie.ru
online-hit.info orgasmatrix.com
onlinefilmz.net origin-my.ru
onlinemeetingnow.com osb.se11.ru
onlineserialy.ru paleohub.info
onload.pw
openstat.com
oxford-book.com.ua
pathwhelp.org pathwhelp.org
pcads.ru pcboa.se
phobia.us pensplan.com
photo.houseofgaga.ru perfectpracticeweb.com
picmoonco.pw peugeot-club.org
picscout.com physfunc.ru
picturesfrom.com pic-re.blogspot.com
pk-services.ru pizdopletka.club
pkr1hand.com playboyfiles.xblog.in
pl.aasoldes.fr plohaya-kreditnaya-istoriya.ru
plastgranar.nu pooleroadmedicalcentre.co.uk
play-movie.pl pornhub-ru.com
pons-presse.com pornhubforum.tk
popads.net porno-video-chati.ru
porn555.com pornoforadult.com
pornoblood.com pornogratisdiario.com
pornoelita.info pornosmola.info
pornogig.com prchecker.info
pornosee.info presleycollectibles.com
pornzone.tv princeadvantagesales.com
pospr.waw.pl privatefx-in.ru
potoideas.us proekt-mos.ru
privatamateure.com progonrumarket.ru
privatov-zapisi.ru
privhosting.com
profitfx.online
propranolol40mg.blogspot.com
prosmibank.ru
prospekt-st.ru prospekt-st.ru
prostitutki-novgoroda.org prostitutki-astana.org
pssucai.info prostitutki-belgoroda.org
ptr.ruvds.com puzzleweb.ru
pussyfleet.com q-moto.ru
puteshestvennik.com qpypcx.com
qor360.com radiogambling.com
quangcaons.com raschtextil.com.ua
quickloanbank.com razorweb-a.akamaihd.net
quit-smoking.ga redirlock.com
quizzitch.net reelheroes.net
qwarckoine.com rn-to-bsn.com
ragecash.com rock-cafe.info
rating-bestcasino.com ros-ctm.ru
razvratnoe.org ruf777.com
rcb101.ru ruscoininvest.company
realmonte.net
renewablewealth.com
rep-am.com
ricorsogiustizia.org
rightenergysolutions.com.au
ring4rhino.com
robotixix.com
rockingclicks.com
rogervivierforsale.com
russia-today-video.ru russia-today-video.ru
rvtv.ru russkie-gorki.ru
rvzr-a.akamaihd.net s.lollypopgaming.com
s-forum.biz sakhboard.ru
sady-urala.ru saltspray.ru
sankt-peterburg.nodup.ru scanner-jess.top
saratov.xrus.org scanner-mary.top
scanner-irvin.top scanner-willy.top
scanner-julia.top scmor.ilxc.cc
scanner-walter.top score-ads.men
scansafe.net scrapinghub.com
scottbywater.com screpy.com
semaltmedia.com search-goo.com
semprofile.com searchinterneat-a.akamaihd.net
senger.atspace.co.uk searchwebknow-a.akamaihd.net
seo-prof1.xyz seo-2-0.com
seoanalyses.com serialsway.ucoz.ru
seocheckupx.com sexkontakteao.info
serviporno.com sexpartygirls.net
sex.hotblog.top sexxdate.net
sexfreepornoxxx.com sexyebonyteen.com
share-buttons-for-free.com shop.acim.org
shohanb.com shopfishing.com.ua
shopperifymac.com shoplvlv.us
shoppingjequiti.com.br sitebeam.net
shoppingmiracles.co.uk slavkokacunko.de
signx.info slim.sellany.ru
site5.com slowmacfaster.trade
siteaero.com smailik.org
snworks.com smart-scripts.com
soaksoak.ru soc-proof.su
soblaznu.net social-s-hhh.xyz
socialbookmarksubmission.org socialsignals24.com
solnplast.ru solinf.co
sortthemesitesby.com soviet-portal.do.am
spaceshipad.com splendorsearch-a.akamaihd.net
speeddream.xyz sptslmtrafms.com
sprttrack.com spy-sts.com
squidoo.com spywareit.com
stackthatbucks.com stathat.com
startwp.org stpicks.com
staticfs.host strongsignal-a.akamaihd.net
sticken.co studworks.org
stopnarco.ru sukirgenk.dvrlists.com
strag-invest.ru sundrugstore.com
streamin.to sunflowerdrawingpaintings.blogspot.com
superstarfloraluk.com supermesta.ru
swagbucks.com surcentro.com
sygraem.com surfbuyermac.com
tandvardshuset.net swsociety.se
taqywu51.soup.io tabletkinaodchudzanie.com.pl
tedy.su telefonsexi.com
teencastingporn.com thecoolimages.net
teenforporn.com thefarmergame.com
thaismartloan.com thetattoohut.com
thebitcoincode.com tilido.com
thegameriders.com titangel-vietnam.com
theheroes.ru titslove.yopoint.in
tivolibasket.it tivolibasket.it
tizanidinehcl2mg.blogspot.com tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com tizanidinehcl4mgtablet.blogspot.com
tizanidinestreetprice.blogspot.com tkanorganizma.ru
tizanidinestreetvalue.blogspot.com tonivedu.it
torrentdownloadhub.com tooplay.com
tourcroatia.co.uk tootoo.to
tovaroboom.vast.ru topbestgames.com
trafficgenius.xyz topsy.com
track112.site
tracxn.com
trafficcentr.xyz
traffixer.com traffixer.com
triumf-realty.ru traffmonster.info
truck-land.life trailer.cinemaflix.website
trustedmaccleaner.com trkdf.com
tupper-posuda.ru trustedhealthtips.com
twelvevisionspartyofcolorado.com turbodsp.com
ua-company.ru ugogo.info
ua.tc uhod-za-sobakoj.ru
ultimateclassicrock.com ultramart.biz
ultimatesetnewfreeallsoftupgradesystems.pw um-razum.ru
urlopener.com umityangin.net
us-america.ru unmaroll.ya.ru
uzporno.mobi upproar.com
v-doc.co urll.eu
vandrie-ict.nl
vasileostrovsky-rayon.ru
vchulkah.net vchulkah.net
vduplo.ru vduplo.ru
velobikestock.com viagra.pp.ua
viagraneggrx.com videochat.tv.br
videtubs.pl videochat.world
viel.su vietimgy.pw
vipromoffers.com vinsit.ru
vitanail.ru vip.51.la
vizitki.net vipps.com.my
vkgaleria.com vizag.kharkov.ua
vsesubwaysurfers.com vk-mus.ru
watchmygf.net vod.com.ua
web.cvut.cz voloomoney.com
webcamdevochka.com voronezh.xrus.org
webmasters.stackexchange.com w-journal.ru
weboptimizes.com w3javascript.com
webpromotion.ae walkme.com
website-analyzer.info wallpapersdesk.info
warezaccess.com
watchinf.com
watchmyfb.pl
we-are-gamers.com
weddingdresses.xyz
wesharepics.site
westum.se
wetgames.ru wetgames.ru
whatsappbot.flyland.ru wfb.hatedriveapart.com
wheelchairliftsarea.com wheelchairliftsarea.com
wikes.20fr.com whiteproduct.com
williamrobsonproperty.com wholesalecheapjerseysfree.com
womens-journal.net wleuaprpxuvr.ga
world-mmo.com womensterritory.ru
wosik-dach.service-for-web.de worldoffiles.ru
wurr.voila.net wufak.com
www.kabbalah-red-bracelets.com www.labves.ru
www.souvenirua.com xboxster.ru
www.wohnkabinen-shop.de xchangetrak.com
xcombear.ru xfire.com
xmladserver.com xn----7sbaphztdjeboffeiof6c.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn--c1acygb.xn--p1ai xn--80aanaardaperhcem4a6i.com
xn--80ab4aa2g.xn--p1ai
xn--e1aggki3c.xn--80adxhks xn--e1aggki3c.xn--80adxhks
xxxguitars.com xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
ynymnwbm.bloger.index.hr xnxx-n.com
xuki.us
xxxrus.org
xxxtubesafari.com
youbrainboost.asia youbrainboost.asia
youjizz.com your-bearings.com
zaapplesales.blogspot.com yourothersite.com
zakonobosago.ru ytmnd.com
zarajbuilders.com yun56.co
zarenica.net yuweng.info
zeroredirect2.com zagadki.in.ua
znakomstvaonlain.ru zaimite.ru
zajm-pod-zalog-nedvizhimosti.ru
zajm-zalog-krasnodar.ru
zaloadi.ru
zebradudka.com
znakomstva-piter78.ru
zooggames.com zooggames.com
zvetki.ru

474
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
000free.us 1000n1.ru
08800.top 101raccoon.ru
0912701309f8ce.com 2x2fan.ru
123movies.love 4kpics.rocks
1314dh.com adsref.men
1kdailyprofit.me adultwebhosting.info
24x7-server-support.site advancedmassagebysara.com
66cpwgln.space advertex.info
72-news.com aero2.ru
76brighton.co.uk agroeconom.kz
883zy.com airmaxshoes-2016.com
a1security.com.ua aloofly.com
acortarurl.es alyeskaresort.com
addblueoff.com.ua animalia-life.club
admatic.com.tr apimountainbikei-a.akamaihd.net
afftrack001.com apple.com-webbrowsing-security.science
agecheckadult.com avirasecureserver.com
agysya.ru avkzarabotok.com
alert.scansafe.net avtocredit-legko.ru
alevinefesleri.com ayerbo.xhost.ro
androids-store.com azartmix.com
apiwebwebgetcom-a.akamaihd.net babieca.com
applicationg29.com bannerads.de
arendovalka.xyz bestwebsitesawards.com
arvut.org bigcities.org
audiofree.ru bimatoprost-careprost.com
ausergrubhof.info bioscorp.ru
automatic-seo.com bitcoins-live.ru
avek.ru biznesrealnost.ru
badavit.com.ua blackle.com
bag77.ru blog.axant.it
baladur.ru blogos.kz
battlecarnival.su boeuklad.com
beatifullandscape.co boom-celebs.com
bestprofits-there.com braintobe.win
bestwebsiteawards.com bum.com.ru
bet365.com bumble.cheapwebsitehoster.com
blue-square.biz bus-offer.com
bmwhighperformers.com buyantiviralwp.com
bolezniorganov.ru cablecar.us
brillianty.info cbozhe.com
buckspar.gq changde.58.com
budilneg.xyz citysecurity.nu
business-made-fun.com clksite.com
buzzurl.jp compliance-checker-7.info
bwlx.prepedu.cn compliance-fred.top
callawaygolfoutlet.online compliance-jess.top
ccjp.eu compucelunlock.net
chatroulette.video cryptoswap.biz
choosecuisine.com cscwtalkto.site
clodo.ru custodieva.ru
compliance-brian.xyz cutalltheshit.com
contentlook.co czat.wp.pl
contentsexpress.com dealighted.com
contextualyield.com
crackguru.tk
crest-poloski.ru
culturevie.info
cyclobenzaprinevstizanidine.blogspot.com
datadepths.com
dataloading.net
degerlund.net degerlund.net
delitime.info deluxedumps.com
depositfiles-porn.ga dev33.dioniqlabb.se
detoxmed24.ru dikx.gdn
diffbot.com discovertreasure-a.akamaihd.net
dimfour.com downloader12.ru
dipstar.org dpihatinh.gov.vn
diusyawiga.tk e2click.com
doctissimo.fr ecommerce-seo.com
doxyporno.com
droidlook.net
drunkmoms.net
eandsgallery.com
ednorxmed.com
educatemetv.com educatemetv.com
efkt.jp el-nation.com
ekspertmed.com electro-prom.com
electronicadirect.com elektrischezi.canalblog.com
eleimgo.pw erotische-geschichten-xxl.com
elektrischezigarette2.onsugar.com eurosamodelki.ru
emerson-rus.ru everypony.ru
en.altezza.travel falcoware.com
eshop.md fbdownloader.com
etotupo.ru fidelityfunding.com
eyes-on-you.ga fighrofacciufreesig.ga
falllow.gq findacheaplawyers.com
fastcrawl.com forum.tvmir.org
flashbannernow.com foxjuegos.com
flirt4free.com gavuer.ru
folowsite.com gilbertbanda.net
food.dtu.dk glasof.es
footbalive.org googlsucks.com
fordsonmajbor.cf greendream.com.ua
foto-telok.net gsou.cf
foxydeal.com hamilton.ca
fullgirl.ru hd720kino.ru
games.kolossale.ru healbio.ru
gay-site.store helicalpile.us
getprismatic.com homedecorpicture.us
go2mike.ru hotel-mkad.ru
gok-kasten.net housemilan.ru
graphicwe.org imguramx.pw
heliko.no inboundlinks.win
hexpilot.com infektsii.com
homemade.gq insta-add.pro
horoshieokna.com instabid.tech
hully.altervista.org istizanidinelikexanax.blogspot.com
incomekey.net itag.pw
inet-traffic.com iwantmyfreecash.com
infazavr.ru j33x.com
informatiecentro.be jav-fetish.site
int.search.tb.ask.com jmat.cn
ipornox.xxx kamorel.com
jeremyeaton.co kazan.xrus.org
kamalsinha.com kleine-titten.biz
keyword-suggestions.com klejonka.info
keywordsking.com krasnodar.zrus.org
kinogolos.ru kreativperlen.ch
kinozapas.com ks1234.com
kolotiloff.ru
konkursowo-24.pl
kumuk.info kumuk.info
lacloop.info
lafriore.ru lafriore.ru
landinez.co levaquin750mg.blogspot.com
leadwayau.com lider-zhaluzi.kiev.ua
lecbter-relationships.ga likesuccess.com
lkbennettoutlet.online linkdebrideur.xyz
loadopia.com locksmith.jp
locustdesign.co lottospring.com
lonfon.xyz louboutinreplica.xyz
long-beach-air-conditioning.com lrac.info
m.b00kmarks.com lutherstable.org
m0r0zk0-krava.ru macotool.com
macnewtech.com mafa-free.com
magento-crew.net maridan.com.ua
mailemedicinals.com master-muznachas.ru
malls.com meduza-consult.ru
mathgym.com.au menstennisforums.com
mbiologi.ru mesto-x.com
mediafresh.online metalonly.info
mega-bony-2017.pl mindbox.co.za
mega-bony2017.pl mir-betting.ru
megaindex.ru mlf.hordo.win
member-quiz.com mmoguider.ru
minneapoliscopiers.com moesonce.com
mnogabukaff.net moncleroutletonline.pw
moneyteam24.com moneyzzz.ru
montazhnic.ru monsterdivx.tv
musezone.ru moscow.xrus.org
mybackgroundlandscape.blogspot.com
myghillie.info
myplaycity.com myplaycity.com
naj-filmy24.pl nero-us.com
net-radar.com no-rx.info
new-apps.ru offergroup.info
nextlnk12.com ostroike.org
ngps1.ru parlament.biz
nodding-passion.tk pc-services.ru
nodup.ru
nofreezingmac.click
nomuos.it
nonews.co
obiavo.uz
pammik.ru
partner-cdn.men
partner-host.men
picswe.com picswe.com
pl-top.pl picturesmania.com
piluli.info
pinsdaddy.com
pixgood.com
pladform.ru pladform.ru
pokemon-go-play.online
popmarker.com popmarker.com
popunder.net pornogratisdiario.com
pornmania.pl pourvous.info
porno-dojki.net
porno-home365.com
pornoplen.com
pravoholding.ru pravoholding.ru
privatamateure.com preg.marketingvici.com
prlog.ru professionaldieselcare.com
ptr.ruvds.com pshare.biz
pxhdwsm.com pyramidlitho.webs.com
rankscanner.com qor360.com
ranksonic.info queerspace.com
razleton.com questionmarque.ch
redbottomheels.xyz qwertty.net
registry-clean-up.net rankings-analytics.com
relayblog.com reeyanaturopathy.com
ring4rhino.com renecaovillasale.online
restorator-msk.ru
robotixix.com
roleforum.ru roleforum.ru
rollercoin.com
royal-investments.net
rus-teh.narod.ru
rusexy.xyz rusexy.xyz
ruspdd.com sady-urala.ru
russia-today-video.ru sbtdesign.co.uk
russian-postindex.ru scanner-barak.top
s8-nowy-wygraj.comli.com scanner-ivan.top
scanmyphones.com score-ads.men
seo-prof1.xyz search-error.com
seogadget.ru search.pch.com
seorankinglinks.xyz semrush.com
sitopreferito.it seocdvig.ru
sivs.ru seocheki.net
slkrm.ru seozoom.it
slowmacfaster.trade sexkontakte-seite.com
smadihome.com shareyards.com
smallseotools.com sibecoprom.ru
sms2x2.ru skachat-besplatno-obrazcy.ru
softxaker.ru small-games.biz
solnplast.ru smartadserver.com
space-worry.ml
speedup-my.site speedup-my.site
stmassage.ru spylog.com
stpicks.com squidoo.com
superoboi.com.ua srdrvp.com
technika-remont.ru stauga.altervista.org
telefonsex-ohne0900.net stjamesschool.info
telegraf.by stpolice.com
thaismartloan.com strigkaomsk.ru
theautoprofit.ml studentguide.ru
themestotal.com studiofmp.com
thepornsex.org susanholtphotography.com
tiandeural.ru svetlotorg.ru
tizanidinehcl4mgtab.blogspot.com sweepstakes.rewardit.com
tizanidinehcl4mgtablet.blogspot.com tattooreligion.ru
toursmaps.com teenfuck.tv
uac.net.au telefonsexi.com
ultramart.biz templates.franklinfire.co
vbabule.net templates.radiodigital.co
verymes.xyz tivolibasket.it
video-production.com tmearegion26.com
todohr.com
tonerbox.kz
tongkatmadura.info
trustedhealthtips.com
turist-strani.ru
twincitiescarservice.com
uggbootsoutletsale.us
ukkelberg.no
urccvfmc.bloger.index.hr
utiblog.fr
vabasa.inwtrade.com
validccseller.com
varikoz24.com
varikozdok.ru
vchulkah.net
viagra.pp.ua
viddyoze.com
videochat.ph
videogamesecrets.com
videosbox.ru videosbox.ru
vinylvault.co.uk viktoria-center.ru
vodaodessa.com villakohlanta.nu
vseigru.one vkonche.com
wallpaperaccess.com vseigry.fun
website-analytics.online warningwar.ru
whatistizanidine2mg.blogspot.com waterefficiency.co
while.cheapwebsitehoster.com webkeyit.com
wineration.com website-analyzer.info
xaijo.com witherrom55.eklablog.fr
xn----ctbbcjd3dbsehgi.xn--p1ai wordpresscore.com
xn--lifehacer-1rb.com xchangetrak.com
xvideosbay.com xfire.com
xxxkaz.org xitjw.info
yaderenergy.ru xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
yebocasino.co.za xn----7sbifcamovvfggw9d.xn--p1ai
yellowstonesafaritours.com xzlive.com
yopoint.in youtubedownload.org
zarabiaj-dzis.pl z-master.ru
zarabotat-na-sajte.ru zaim-pod-zalog-krasnodar.ru
zvooq.eu zambini.ru
zlatnajesen.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.106 0; 10.1.0.234 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3089 ### Version: V4.2022.05.3090
### Updated: Fri May 6 22:01:36 UTC 2022 ### Updated: Sat May 7 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3089 ### Version: V4.2022.05.3090
### Updated: Fri May 6 22:01:36 UTC 2022 ### Updated: Sat May 7 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##