vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.06.3145 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-06-03 22:07:10 +00:00
parent e42fa236ee
commit bad832e50e
46 changed files with 99120 additions and 99120 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3144 #### Version: V4.2022.06.3145
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3144 #### Version: V4.2022.06.3145
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.06.3144 #### Version: V4.2022.06.3145
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12254
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.06.3144 #### Version: V4.2022.06.3145
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12258
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12258
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12258
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12258
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 1; 10.1.0.107 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 0; 10.1.0.107 0;
127.0.0.1 0; 127.0.0.1 0;

12258
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 1; 10.1.0.107 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 0; 10.1.0.107 0;
127.0.0.1 0; 127.0.0.1 0;

12258
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 1; 10.1.0.107 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 0; 10.1.0.107 0;
127.0.0.1 0; 127.0.0.1 0;

12258
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3144 3145

12258
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12258
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.139.83 0; 20.125.97.185 0;

12258
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 1; 10.1.0.107 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 0; 10.1.0.107 0;
127.0.0.1 0; 127.0.0.1 0;

12258
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 1; 10.1.0.107 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 0; 10.1.0.107 0;
127.0.0.1 0; 127.0.0.1 0;

12258
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 1; 10.1.0.107 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 0; 10.1.0.107 0;
127.0.0.1 0; 127.0.0.1 0;

12258
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.139.83 0; 20.125.97.185 0;

12258
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.139.83 0; 20.125.97.185 0;

12258
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 1; 10.1.0.107 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Iria Badass
Joomla Battleztar Bazinga
Keybot Translation-Search-Machine Image Fetch
PageAnalyzer InfoTekies
SmartDownload Lmspider
Sosospider OnCrawl
YoudaoBot SemrushBot
arquivo.pt Tracemyfile
ips-agent URLy.Warning
xpymep1.exe pcBrowser

294
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404checker
80legs 80legs
ADmantX ADmantX
AIBOT ALittle Client
Abonti
Aboundex Aboundex
Acunetix Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot AiHitBot
Alexibot Aipbot
Anarchie AlphaBot
Anarchy Anthill
Apexoo
Asterias Asterias
Atomseobot
Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga BetaBot
Bigfoot
Black Hole Black Hole
Blackboard Blackboard
Blow BlowFish
Boardreader
Bolt Bolt
Brandwatch BuiltWith
Buck
BuiltBotTough
Bullseye
CODE87 CODE87
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CherryPicker CherryPicker
Chlooe Chlooe
Citoid
Claritybot
Cliqzbot Cliqzbot
Cocolyzebot Cocolyzebot
Collector CopyRightCheck
Cosmos Cosmos
Crescent Craftbot
CrunchBot Crawling at Home Project
CyotekWebCopy Curious
DTS Agent DSearch
Demon Demon
DigitalPebble Deusu
Digincore
Discoverybot Discoverybot
DittoSpyder DittoSpyder
DnyzBot
DomCopBot
DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler Dragonfly
EasyDL Ebingbong
Ecxi
EirGrabber EirGrabber
Evil Evil
Exabot
Express WebPictures Express WebPictures
Extractor ExtLinksBot
ExtractorPro ExtractorPro
Ezooms Ezooms
FDM
FHscan FHscan
Firefox/7.0
FlashGet
Flunky Flunky
Foobot Freeuploader
FrontPage Fuzz
FyberSpider
GT::WWW GT::WWW
GalaxyBot GalaxyBot
Genieo Genieo
GetWeb GetRight
Getintent Gotit
Go-Ahead-Got-It
Grabber Grabber
GrapeshotCrawler Grafula
GrapeFX
GridBot
HEADMasterSEO
HMView HMView
HTTP::Lite HTTP::Lite
HaosouSpider HTTrack
Havij Havij
Heritrix Heritrix
Hloader Humanlinks
HybridBot Iblog
IDBTE4M IlseBot
IndeedBot
Indy Library
InfoTekies InfoTekies
Intelliseek
InterGET
Internet Ninja Internet Ninja
Iria
Iskanie Iskanie
JamesBOT JOC Web Spider
JennyBot Jbrofuzz
Jetty Jetty
Jorgee JikeSpider
Joomla
Jyxobot Jyxobot
Keybot Translation-Search-Machine Kenjin Spider
Keyword Density
Kinza
Kozmosbot
Larbin Larbin
Leap
LeechGet LeechGet
LexiBot LexiBot
Lftp
LibWeb LibWeb
Libwhisker Libwhisker
LieBaoFast
Likse Likse
LinkScan
LinkextractorPro LinkextractorPro
LinqiaRSSBot Lipperhey
LinqiaScrapeBot MIIxpc
MFC_Tear_Sample MJ12bot
MQQBrowser MQQBrowser
MSFrontPage
MSIECrawler
MTRobot MTRobot
Magnet Magnet
Mail.RU_Bot MarkWatch
Majestic SEO
MarkMonitor
Masscan Masscan
MauiBot Mata Hari
Mediatoolkitbot Mb2345Browser
Microsoft Data Access Meanpathbot
Microsoft URL Control Metauri
Minefield
Mojolicious
MolokaiBot MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Musobot Musobot
NICErsPRO NICErsPRO
Name Intelligence NPbot
NearSite NearSite
Nessus Needle
NetAnts Netcraft
Netvibes Nettrack
Nikto Niki-bot
NimbleCrawler
Nimbostratus
Ninja Ninja
Not
Octopus
Offline Explorer
OpenLinkProfiler OpenLinkProfiler
Openvas Openfind
OutclicksBot OrangeSpider
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com PageThing.com
Pandalytics
Papa Foto Papa Foto
Pavuk PeoplePal
Pi-Monster Petalbot
PictureFinder Piepmatz
Pimonster Pimonster
Probethenet Pixray
RankActive Pockey
ProPowerBot
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot RankingBot
RankingBot2 RankingBot2
Rankivabot Rankivabot
ReGet RankurBot
Recorder
RedesScrapy
Ripper
SBIder SBIder
SEOkicks-Robot SEOkicks
SEOprofiler SEOlyticsCrawler
ScanAlert SISTRIX
ScoutJet Screaming
Scrapy ScreenerBot
SearchmetricsBot Searchestate
Seekport
SemanticJuice SemanticJuice
SentiBot
SeobilityBot SeobilityBot
Siphon
Site Sucker Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer
SiteSnagger SiteSnagger
SlySearch
SmartDownload SmartDownload
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
Sottopop
SpaceBison SpaceBison
Spammen SpankBot
Sqworm
Steeler
Stripper Stripper
Sucker Sucuri
SuperBot SuperBot
Surfbot SuperHTTP
Suzuran
Szukacz
T0PHackTeam T0PHackTeam
T8Abot
Teleport Teleport
Telesoft TeleportPro
Telesphorep Telesphoreo
Titan TheNomad
Toweyabot Toata
Trendiction Trendiction
Turingos
TurnitinBot
Twice
URLy Warning URLy Warning
URLy.Warning URLy.Warning
UnisterBot
V-BOT
VB Project VB Project
VelenPublicWebCrawler Vacuum
VeriCiteCrawler Voltron
Virusdie WASALive-Bot
VoidEYE WPScan
Voil
WWW-Collector-E WWW-Collector-E
WWWOFFLE
Wallpapers
WallpapersHD WallpapersHD
WeSEE WeSEE
Web Auto Web Collage
Web Enhancer Web Pix
Web Fuck
Web Sucker
WebBandit
WebEnhancer
WebGo IS WebGo IS
WebImageCollector
WebLeacher
WebReaper WebReaper
WebStripper
Webalta Webalta
WebsiteQuester Webshag
Webster WebsiteExtractor
Who.is Bot
Widow
WinHTTrack WinHTTrack
Wotbox Woobot
Wprecon Xaldon WebSpider
Xenu YoudaoBot
Zeus Zauba
ZumBot Zermelo
ZyBorg Zitebot
adscanner ZmEu
cah.io.community ZoomBot
check1.exe arquivo-web-crawler
clark-crawler arquivo.pt
coccocbot coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback crawler.feedback
demandbase-bot demandbase-bot
domainsproject.org domainsproject.org
eCatch eCatch
facebookscraper facebookscraper
heritrix
instabid instabid
isitwp.com ips-agent
iubenda-radar iubenda-radar
lwp-request lwp-request
mediawords mediawords
netEstate NE Crawler pcBrowser
probe-image-size plumanalytics
satoristudio.net polaris version
seostar seostar
serpstatbot sitechecker.pro
sexsearcher
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webmeup-crawler
x22Mozilla x22Mozilla
zgrab zgrab

306
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 360Spider
80legs 404enemy
AhrefsBot AIBOT
ASPSeek
Abonti
Aboundex
Aboundexbot
AiHitBot
Aipbot Aipbot
Alexibot Anarchie
Anthill Anarchy
Apexoo
Aspiegel Aspiegel
Asterias
Atomseobot Atomseobot
Attach
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDCbot BDCbot
BDFetch BLEXBot
BackDoorBot
Barkrowler Barkrowler
BatchFTP BatchFTP
BlackWidow BetaBot
Bitacle
Black Hole
Blackboard Blackboard
Bolt BotALot
Brandwatch Brandwatch
Buck
BuiltWith BuiltWith
Bullseye BunnySlippers
CCBot CATExplorador
Calculon CODE87
CheTeam CSHttp
CheeseBot Cegbfeieh
CensysInspect
Chlooe Chlooe
Citoid Cliqzbot
Cocolyzebot
Cogentbot
Copier
CopyRightCheck CopyRightCheck
Craftbot Cosmos
CrazyWebCrawler Crawling at Home Project
Crescent CrunchBot
DSearch DSearch
DatabaseDriverMysqli
Demon Demon
Deusu
Dirbuster Dirbuster
Dispatch Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender DomainAppender
Dragonfly DomainSigmaCrawler
Drip Domains Project
EMail Wolf ECCP/1.0
EMail Siphon
EasyDL
Ecxi
Evil
Express WebPictures Express WebPictures
Extractor ExtractorPro
Extreme Picture Finder EyeNetIE
FDM
Fimap
Firefox/7.0
Flunky
Foobot Foobot
Fuzz Freeuploader
FyberSpider
Fyrebot Fyrebot
G-i-g-a-b-o-t GT::WWW
GalaxyBot
GermCrawler
GetRight GetRight
Gigabot GetWeb
Go!Zilla Gotit
Go-Ahead-Got-It GrapeFX
GoZilla HEADMasterSEO
GrabNet Harvest
Grabber HonoluluBot
HTMLparser
Haansoft
Havij
Hloader
Humanlinks
HybridBot HybridBot
IDBTE4M
IRLbot IRLbot
Iblog Id-search
IlseBot IlseBot
Image Fetch IndeedBot
InfoNaviRobot
InfoTekies InfoTekies
InterGET Intelliseek
Internet Ninja Iskanie
InternetSeer
IstellaBot IstellaBot
Jetty JamesBOT
Joomla JetCar
Jorgee JikeSpider
Keybot Translation-Search-Machine JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple
Larbin Larbin
Leap LeechGet
LexiBot LexiBot
Libwhisker LibWeb
LieBaoFast LinkScan
Lightspeedsystems
Linkbot Linkbot
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey
Litemage_walker Litemage_walker
Lmspider
Ltx71 Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MJ12bot MJ12bot
MQQBrowser MTRobot
MSFrontPage Majestic12
MSIECrawler MarkWatch
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan Masscan
Mediatoolkitbot Mata Hari
MicroMessenger Mb2345Browser
Microsoft URL Control Microsoft Data Access
Mister PiX Moblie Safari
Mojeek Mojeek
MolokaiBot MolokaiBot
Morfeus Fucking Scanner Msrabot
NPbot NICErsPRO
Nameprotect Nameprotect
Navroad Navroad
NetSpider Nessus
Net Vampire
NetLyzer
NetMechanic
NetZIP NetZIP
Nettrack Nettrack
NextGenSearchBot NextGenSearchBot
Niki-bot Nmap
Nikto
Not
Nuclei Nuclei
Nutch
Offline Explorer Offline Explorer
Offline Navigator OnCrawl
OpenVAS OpenLinkProfiler
Openfind
Openvas Openvas
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageScorer
PageThing.com
Pandalytics Pandalytics
Panscient
Papa Foto Papa Foto
PeoplePal Petalbot
Picscout Pi-Monster
Picsearch
PictureFinder PictureFinder
Pixray
Pockey Pockey
ProPowerBot ProPowerBot
Psbot ProWebWalker
RSSingBot Quick-Crawler
RankActiveLinkBot
RankingBot RankingBot
Rankivabot RankingBot2
RankurBot RankurBot
Re-re Re-re
ReGet
RealDownload
RebelMouse RebelMouse
RedesScrapy Rogerbot
SEOprofiler SBIder
SMTBot SMTBot
ScanAlert
ScoutJet
Scrapy
Screaming Screaming
ScrepyBot
SearchmetricsBot SearchmetricsBot
SemanticJuice Seekport
Semrush
SemrushBot
SentiBot
Siphon
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSucker SiteSucker
SlySearch
Snake Snake
SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
Spammen
Spinn3r
Sqlworm
Steeler
Stripper Stripper
Sucker Sucker
SuperBot Sucuri
Surfbot SuperHTTP
Swiftbot SurveyBot
Teleport T8Abot
Telesphoreo
Telesphorep Telesphorep
TheNomad TheNomad
TightTwatBot Titan
Tracemyfile Trendictionbot
Turingos
Turnitin Turnitin
TurnitinBot Twice
Typhoeus UnisterBot
VelenPublicWebCrawler VCI
VidibleScraper Vacuum
Virusdie VeriCiteCrawler
Voltron VoidEYE
WWW-Mechanize Voil
WWW::Mechanize WASALive-Bot
Wallpapers/3.0 WBSearchBot
WeSEE WISENutbot
Web Enhancer WallpapersHD
Web Fetch
Web Fuck
Web Pix Web Pix
Web Sucker WebCollage
WebAuto
WebBandit
WebFetch WebFetch
WebFuck WebGo IS
WebImageCollector WebImageCollector
WebReaper WebLeacher
WebPix
WebSauger
WebSucker WebSucker
WebZIP WebWhacker
WebmasterWorldForumBot Webalta
Webshag Whack
WebsiteQuester
Whacker Whacker
Whatweb
Who.is Bot
Widow Widow
Xaldon WebSpider Woobot
Xaldon_WebSpider Zauba
Xenu Zermelo
Zeus ZoomBot
ZmEu arquivo-web-crawler
backlink-check
cah.io.community
check1.exe check1.exe
coccocbot coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback
crawler4j crawler4j
domainsproject.org demandbase-bot
evc-batch evc-batch
facebookscraper facebookscraper
gopher
instabid instabid
ips-agent ips-agent
isitwp.com isitwp.com
iubenda-radar iubenda-radar
lwp-trivial
meanpathbot meanpathbot
mediawords
muhstik-scan
oBot oBot
page scorer
pcBrowser pcBrowser
ripz probe-image-size
s1z.ru
satoristudio.net satoristudio.net
scalaj-http scalaj-http
seobility
seocompany.store seocompany.store
serpstatbot serpstatbot
sitechecker.pro sitechecker.pro
spyfu ubermetrics-technologies.com
sysscan voyagerx.com
tAkeOut
trendiction.com
webgains-bot
webpros.com webpros.com
webprosbot webprosbot
x09Mozilla xpymep1.exe
x22Mozilla zgrab
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
approved.su badavit.com.ua
boole.onlinewebshop.net baoxaydung.com.vn
brainboosting.club cheapestjerseysonwholesale.com
dfwu1013.info englishdictionaryfree.com
leadn.pl hotsocialz.com
lightinghomes.net languagecode.com
minecraft-rus.org sonata-arctica.wz.cz
pornogig.com txxx.com
topads.men umg-stroy.ru
vektorpress.ru vzlom-na-zakaz.com

948
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1000n1.ru 0912701309f8ce.com
28n2gl3wfyb0.ru 123any.com
4rent.ru 202ch.com
5-steps-to-start-business.com 20pascals.nl
5elementov.ru 214jaluwobapef.cf
5ws.dating-app.ru 2345.com
72-news.com 3-letter-domains.net
aaa38852e886ac4af1a3cff9b47cab6272.com 4ureyesonly.com
abbanreddy.com 8jn.dating-app.ru
abusora.com aa625d84f1587749c1ab011d6f269f7d64.com
add-add.men abwa.tk
addtoadd.men addblueoff.com.ua
adexprts.com adimmix.com
adnotbad.com adman.gr
adobereader-free.ru adultgalls.com
adsfresh.men advancedcleaner.com
adtech.fr advancedsoftwaresupport.com
adverster.com advokateg.ru
advertisingtag.net ageofclones.com
ahrefs.com air-edem.ru
allboard.xobor.de akama.com
allnews.md albamargroup.com
allproblog.com alert.scansafe.net
alphacarolinas.com alf-img.com
alpharma.net alkoravto.ru
amanda-porn.ga alldubai.biz
amateurlivechat.org allornamenti.com
amehdaily.com alltheviews.com
android4fun.org alot.com
androids-store.com angel1777.kz
animalia-life.club ap.senai.br
apartamentwroclaw.eu apiholdingmypage-a.akamaihd.net
app5.letmacworkfaster.world appfastplay.com
aproposde.com appsecurityr.com
asdfg.pro arabsexxxtube.com
atovh.local-finders.com arcadepages.com
audiobangout.com arendakvartir.kz
auto4style.ru artavenuegardenstudios.com
autotop.com.ua artdeko.info
aviapanda.ru asociatia-tipografilor-transilvania.ro
aviav.ru astana.xxxkaz.org
avtolombard-krasnodar.ru atdedinotuho.tk
azartclub.org atout-energie-69.com
azarttoto.com auto.rusvile.lt
b00kmarks.com autobudpostach.club
bag77.ru automatic-seo.com
bankofthewext.com automobile-spec.com
bannerpower.com aviav.co
bedcapdealers.com avirasecureserver.com
beetpics.pw azartmix.com
bensbargains.net backuperwebcam.weebly.com
berlininsl.com baixar-musicas-gratis.com
best-deals-products.com banki76.ru
best-seo-software.xyz basedecor.ru
bestbuy.ca basisches-wasser.net
bestdraws.com bestdooz.com
bitporno.sx bestfortraders.com
bizcheapjerseyswholesalechina.com bestofpicture.com
bjgugu.net.ua bestpornuha.com
bluejays-jerseys.us bestwrinklecreamnow.com
bluerobot.info bet365.com
bonanza-fortune.men beztuberkuleza.ru
bookhome.info bg6s0.com
bookmark4you.com.biz bharatdefencekavach.com
bosman.pluto.ro billiard-classic.com.ua
bouda.kvalitne.cz bio-optomarket.ru
brandbucket.com blackle.com
brus.city blog-hits.com
bloggedporn.com
blogrankers.com
bookmaker-bet.com
brainzpod.win
brokergid.ru
brothers-smaller.ru
bscodecs.com bscodecs.com
btvn.ru bukleteg.xyz
buckspar.gq buqayy0.livejournal.com
budpost.com.ua
bugof.gq
buntube.net
buqyxa.rincian.info buqyxa.rincian.info
burkesales.com business-made-fun.com
bvlgaribracelet.xyz buy-cheap-pills-order-online.com
buytizanidineonlinenoprescription.blogspot.com
bycontext.com bycontext.com
call-of-duty.info candcstuccoandstone.com
canyougethighofftizanidine.blogspot.com candelluxsklep.pl
cardsdumps.com carrauterie.be
cars-modification.net cartierlovebracelet.xyz
caulderwoodkennels.com cartierlovestore.xyz
cbb1smartlist12.click centrumcoachingu.com
cdnnetwok.xyz cfcl.co.uk
chcu.net cheap-trusted-backlinks.com
cheapjerseysbizwholesale.us cheapjerseysa.com
cheapmoncler.win check-host.net
chelnytruck.ru cherubinimobili.it
chimiver.info chidporn.com
cialgenisrx.com chiptuninger.com
cineacademy.ru
cleanallvirus.com
cleanmypc.com
cmhomestayagency.com
coccoc.com coccoc.com
com-onlinesupport.host comissionka.net
compliance-george.xyz
compliance-jane.top
compliance-mary.top
compliance-nelson.top
compliance-olga.top compliance-olga.top
conciergegroup.org compliance-viktor.top
connectingsingles.com concordexoticrentals.com
converse.ddsoldes.fr craftinsta.ru
cookie-law-enforcement-hh.xyz credit.co.ua
covadhosting.biz cwetochki.ru
cpabegins.ru cxpromote.com
cutt.us d2jsp.org
dafatiri.com dailyrank.net
dairyindia.in data.vtc.pw
decorazilla.com datsun-do.com
dekoration.us ddsoldes.fr
deshevo-nedorogo.ru dealighted.com
dfwu1019.info decenttools.com
diegolopezcastan.com delitime.info
dildofotzen.net depositfiles-porn.ga
dinkolove.ya.ru dev-seo.blog
dikqlyremy.info
dirtpics.pw dirtpics.pw
dispo.de discovertreasure-a.akamaihd.net
dividendo.ru discovertreasurenow.com
dominterior.org dmmspy.com
download-of-the-warez.blogspot.com dneprsvet.com.ua
downloadeer.net documentsite.net
downloader12.ru dojki365.online
drivotracker.com domainsphoto.com
drugs-no-rx.info domashneeruporno.com
dominateforex.ml
doxyporno.com
dpihatinh.gov.vn
dprtb.com
drupa.com drupa.com
druzhbany.ru druzhininevgeniy63.blogspot.com
dstroy.su earl-brown.info
dvrlists.com elektronischezigarettekaufen1.myblog.de
e-poker-2005.com elektrozigarettekaufen2.blogse.nl
ec-file.info elektrozigaretten1.postbit.com
ednorxmed.com
ekspertmed.com
electronicadirect.com
elmifarhangi.com
eloconcream.blogspot.com
elvenar.com
emerson-rus.ru emerson-rus.ru
engines-usa.com enge-fotzen.info
erectile.bid enternet.ee
etenininrade.ga epngo.bz
euromasterclass.ru ewebarticle.info
eurosamodelki.ru ezigarettenkaufen1.deviantart.com
evidencecleanergold.com ezigarettenkaufen1.pagina.gr
exct.net
exoneration-project.us
expertnaya-ocenka.ru
ezigarettenshop2.myblog.de
ezigarettenshop2.postbit.com
fable.in.ua fable.in.ua
familyholiday.ml familyholiday.ml
filerockstar298.weebly.com faptitans.com
filesmonster.porn fastcrawl.com
financetip.eu fealq.com
findclan.org felizporno.com
finteks.ru fellowshipoftheminds.com
firma-legion.ru feorina.ru
flashbannernow.com fickenprivat.info
flowersbazar.com fifa-coins.online
focalink.com financehint.eu
forensicpsychiatry.ru flavors.me
formulaf1results.blogspot.com food.dtu.dk
forpostlock.ru forums.d2jsp.org
forums.toucharcade.com foto-basa.com
forzeronly.com franch.info
foxydeal.com freetangodownload.com
free-today.com funnymama.com
freewareseek.com fx-brokers-review.com
freewhatsappload.com fz139.ttk.ru
fyl.com.ru galaxyflowers.ru
fyxabomiw.ru gambarkatabaru.com
gameprimary.com gamedayhouse.com
gamerscorps.com gamezblox.com
gamingspark.com gaming-journal.com
gate5.co.za gcup.ru
gay-file.com geileweiber.tk
geilehausfrauen.net gembird.com
gentamicineyedrops.blogspot.com generalporn.org
geoads.com getlaid-xxxhookupdirect.com
get-free-traffic-now.com ghostvisitor.com
getmiro.com gk170.ru
gheus.altervista.org gkvector.ru
girlgamerdaily.com globalscam.ga
girlspicsa.com go2album.com
globatur.ru gotwebsite1.com
gok-kasten.net gowreckdiving.com
gpirate.com gpirate.com
graphid.com greatdealshop.com
gwebtools.com groupmoney.ru
gwhwpxbw.bloger.index.hr gsmtlf.ru
h2monline.com gungamesz.com
hacktougroup.ru hamacapty.com
hanink.biz.ly handicapvantoday.com
harmonyglen.us harmonyglen.us
hikesearch.net hawaiielectriclight.com
hit-kino.ru hccoder.info
hitcpm.com hdfreeporno.net
housekuba.org hentai-manga.porn
howtoclean.club hermesreplica.pw
hoztorg-opt.ru hermesreplica.win
htmlcorner.com heroz.fr
hybrid.ru himazin.info
hyhj.info hitmuzik.ru
ideoworld.org hosting-tracker.com
igithab.com hotxnights.info
ihtec2019.org houseofrose.com
ilovevitaly.com hoverboard360.es
iminent.com hreade.com
immobiliaremassaro.com i-hobot.ru
impotentik.com ibb.com.ua
inclk.com iideaidekonkatu.info
infogame.name ikearugs.xyz
int.search.mywebsearch.com ilo134uloh.com
invitefashion.com img.wallpaperstock.net
ipchicken.com immigrational.info
iptool.xyz inboxdollars.com
iqoption-bin.com inspiring-desperate.tk
iqoption.pro iqs.biz.ua
islandminingsupply.wordpress.com irkutsk.zrus.org
ivanstroi.ru isoveti.ru
iwanttodeliver.com ix20.ru
iyasimasennka.com jabimgo.pw
janerikholst.se jav-idol.com
jaxcube.info jobmarket.com.ua
jerseychinabizwholesale.com justkillingti.me
jerseyswholesalechinalimited.com kamalsinha.com
jillepille.com karpun-iris.ru
jobgirl24.ru kerei.ru
journalhome.com kinogolos.ru
kamen-e.ru kinogonew.ru
kartiniresto.com knigonosha.net
kashubadesign.ru
kazrent.com
kchaxton.com
kerch.site
ketrzyn.pl
keywordteam.net
kino-fun.ru
kino2018.cc
kirov.zrus.org
knogg.net knogg.net
kol-energo.ru krasivoe-hd.com
kongruan.com krasivye-devushki.net
konoplisemena.com krasula.pp.ua
la-fa.ru labelwater.se
lanasshop.ru lacapilla.info
landscapebackgrounds.blogspot.com lancheck.net
laptoper.net laserpen.club
lashstudia.ru
law-check-two.xyz law-check-two.xyz
lazy-z.com
le-clos-des-alouettes.com le-clos-des-alouettes.com
letslowbefast.today light.ifmo.ru
linkbolic.com link.ac
lion.playtap.us linksharingt.com
littlecity.ch lion.conboy.us
locustdesign.co live-cam6.info
lombia.co lkbennettoutlet.online
longgreen.info lolnex.us
lookingglassemb.com lombardfinder.ru
lottospring.com long-beach-air-conditioning.com
ltvperf.com longadventure.com
m-google.xyz lunamedia.co
m1media.net mafcards.ru
macdamaged.space magicplayer-s.acestream.net
mackeeper-land-672695126.us-east-1.elb.amazonaws.com makis.nu
madot.onlinewebshop.net managerpak204.weebly.com
manimpotence.com martlinker.com
mature.free-websites.com masturbate.co.uk
mebel-alait.ru mebel-vstroika.ru
medkletki.ru meddesk.ru
mega-bony-2017.pl mhi-systems.ru
menetie.ru mielec.pl
message-warning.net mil-stak.com
mexicotravelnet.com minharevisao.com
michaelkorsoutlet.store
mini-modus.ru
miniads.ca
minyetki.ru
mirtorrent.net
misslike.ru misslike.ru
mobilemedia.md mobplayer.ru
mobsfun.net moonci.ru
moje-recenze.cz morefastermac.trade
monclerjacketsoutlet.win mosrif.ru
morocco-nomad-excursions.com
mosdverka.ru
mossmesi.com
movies-in-theaters.net
moviezbonkerssk.cf moviezbonkerssk.cf
mtmtv.info mozello.ru
muabancantho.info mrwhite.biz
musflashtv.com mttwtrack.com
musicstock.me musicas.baixar-musicas-gratis.com
muz-tracker.net muz-shoes.ru
my-cash-bot.co myonigroup.com
myonlinepayday.co mystats.xyz
myperiod.club nagdak.ru
na-telefon.biz narkologiya-belgorod.ru
naturalpharm.com.ua naughtyconnect.com
net-profits.xyz negociosdasha.com
new7ob.com new7ob.com
nicovideo.jp nfljerseys.online
nikhilbahl.com nfljerseyscheapbiz.us
nlfjjunb5.ru nikkiewart.ru
nonews.co ningessaybe.me
nrv.co.za nootrino.com
ntic.fr northfacestore.online
o-o-8-o-o.com novodigs.com
o.light.d0t.ru nuker.com
obiavo.net o333o.com
ohmyrings.com obiavo.by
one-gear.com obiavo.in
one.net.in office2web.com
onetravelguides.com
onlainbesplatno.ru
onlinadverts.com
onlinedomains.ru onlinedomains.ru
onlineporno.site onlinemegax.com
onlineslotmaschine.com ordernorxx.com
onstrapon.purplesphere.in page2rss.com
osnova3.ru pagesense.com
ostrovtaxi.ru partnerads.men
paclitor.com pcimforum.com
paleohub.info perfectplanned.com
panouri-solare-acoperis.com perl.dp.ua
paradontozanet.ru perm-profnastil.ru
parfusale.se pertlocogasilk.tk
pastaleads.com pflexads.com
paydayonlinecom.com phelissota.xyz
pearlisland.ru phrcialiled.com
phpdevops.com picturesfrom.com
pinkduck.ga pio.polytopesexempt.com
pix-hd.com piski.top
pixell.club piter.xrus.org
pladform.ru piulatte.cz
plaff-go.ru pix24x7.com
plugingeorgia.com play-mp3.com
polska-poezja.com ploenjitmedia.azurewebsites.net
pooleroadmedicalcentre.co.uk pontiacsolstice.info
popserve.adscpm.net poppen-nw.net
porndl.org porngalleries.top
pornobrazzers.biz porno-play.net
pornokajf.com pornodojd.ru
pp-budpostach.com.ua pornoforadult.com
primedice.com pornosee.info
privetsochi.ru pornosemki.info
projefrio.com.br pornosmola.info
prom23.ru pornstartits.xblog.in
promoheads.com postclass.com
qpypcx.com pr-ten.de
quality-traffic.com prefersurvey.net
rcpmda.ikan1080.xyz pricheskaonline.ru
recipedays.ru prizestohandle.club
recordpage-a.akamaihd.net pro-okis.ru
reklama1.ru pro-poly.ru
relatodelpresente.com.ar profitwithalex.info
rfd-split.hr proxyradar.com
rff-cfal.info psvita.ru
roma-kukareku.livejournal.com puserving.com
runstocks.com pyrodesigns.com.au
sa-live.com qexyfu.bugs3.com
sadaholding.com qwertty.net
samolet.fr raschtextil.com.ua
sampleletters.net reckonstat.info
santasgift.ml remont-comp-pomosh.ru
satoristudio.net rennlist.com
sbprabooks.com restorator-msk.ru
scanhub.ru rockma.se
scanner-donald.top rus-teh.narod.ru
scanner-fred.top rustic-quiver.win
scanner-ivan.top rvzr-a.akamaihd.net
sdi-pme.com saddiechoua.com
seeresultshub-a.akamaihd.net salmonfishingsacramentoriver.com
seojokes.net samoiedo.it
seorussian.ru saneitconsulting.com
servethis.com savingsslider-a.akamaihd.net
service-core.ru sayyoethe.blogspot.co.za
serviporno.com sbetodiodnye-lampy.ru
sexyebonyteen.com scanner-alex.top
sharebutton.org school-diplomat.ru
shell-pmr.ru searchtooknow-a.akamaihd.net
shivafurnishings.com see-your-website-here.com
sierraapps.com semp.net
sildenafil-tadalafil.info seogadget.ru
silvercash.com serving.adbetclickin.pink
sitechecker.pro sethrollins.net
sixcooler.de sexgalleries.top
skytraf.xyz sexiporno.net
slavic-magic.ru sexsearch.com
slavkokacunko.de sexyali.com
slimcdn.com sharebutton.net
slomm.ru sharpchallenge.com
smsactivator.ru shikiso.info
snworks.com shodanhq.com
shohanb.com
shopfishing.com.ua
signoredom.com
siteheart.net
siteripz.net
slavia.info
slim.sellany.ru
smstraf.ru
snip.to
snip.tw
socialmediasuggest.com socialmediasuggest.com
soserfis.com sodexo.com
sotechco.co sohoindia.net
solmarket.by
songoo.wz.cz
spabali.org
space2019.top space2019.top
spb-plitka.ru space4updating.win
spidtest.space
spinazdrav.ru spinazdrav.ru
spl63.fr spymac.net
spravka-medosmotr.ru
spylog.com
spywarebegone.com spywarebegone.com
squidoo.com sr-rekneskap.no
standardchartered-forex.com srecorder.com
stats-public.grammarly.io sstroy44.ru
stauga.altervista.org statoutlook.info
stickers-market.ru stats-collector.org
stockquotes.wooeb.com stpicks.com
stoki.ru streetfooduncovered.com
streetfire.net streha-metalko.si
stromerrealty.com stroymonolit.su
studiofaca.com stroyplus.ru
studiokamyk.com.pl
stuff-about-money.com
sugarlyflex.pw
superiends.org
supermama.top
superstats.com
survival.betteroffers.review survival.betteroffers.review
svetodiodoff.ru svbur.ru
svnuppsalaorebro.se svensk-poesi.com
swingerseiten.com svtrd.com
swinginwithme.ru swsociety.se
syvertsen-da.no
szucs.ru
t-bygg.com t-bygg.com
tabletkinaodchudzanie.com.pl talant-factory.ru
tastyfoodideas.com tarad.com
tecnoteakviareggio.it taranerymagesswa.blogspot.com
teesdaleflyballclub.co.uk technika-remont.ru
telefonsexi.com telemetryverification.net
terrafootwear.us tfxiq.com
thaismartloan.com tizanidinecost.blogspot.com
thecounter.com tizanidinehydrochloride2mg.blogspot.com
thenews-today.info tizanidineoral.blogspot.com
tizanidineformigraines.blogspot.com tizanidinerecreationaluse.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com tizanidineshowupondrugtest.blogspot.com
tizanidinesleepaid.blogspot.com tizanidinewithdrawal.blogspot.com
tizanidinevsvalium.blogspot.com top-karkas.ru
toolsky.com topkarkas.com
top-deal.com.pl toy-shop.top
top10-online-games.com toyota.7zap.com
topappspro.com tradedeals.biz
torrent-to-magnet.com traffictrade.life
trafficmania.com traxdom.ru
trion.od.ua truemfilelj.gq
tt-ipd.info tsan.net
tubo360.com tupper-posuda.ru
tv-spoty.info tvand.ru
tvorozhnaja-zapekanka-recept.ru twojebook.pl
twincitiescarservice.com tytoona.com
tx41tclega.ru uac.net.au
uchil.net uamtrk.com
uhod-za-sobakoj.ru uggsale.online
ultramart.biz uhdtv.website
unmaroll.ya.ru ukrtvory.in.ua
url2image.com unrealcommander.biz
vduplo.ru url-extractor.xyz
videogamesecrets.com uroki.net
videos-for-your-business.com usbggettwku.ga
vielporno.net uzporno.mobi
vitoriacabos.com veerotech.com
viveresaniesnelli.it vektorpress.ru
vkontaktemusic.ru veles.shop
vkontarkte.com veopornogratis.xxx
vod.com.ua via-energy-order.com
vodaodessa.com video-chat.in
volgograd.xrus.org video-chat.love
voltrknc1.com video-hollywood.ru
vvon.co.uk videtubs.pl
vzlomfb.com viktoria-center.ru
warezaccess.com vipps.com.my
watchmygf.net vizitki.net
webalan.ru vuclip.com
webnode.me w3javascript.com
website-analytics.online wahicbefa31.soup.io
website-audit.com.ua warningzscaler.heraeus.com
websiteexplorer.info watracker.net
wedding-salon.net webadvance.club
wesharepics.site weblibrary.win
whatistizanidine2mg.blogspot.com website-analyzer.info
wholinkstome.com website-speed-checker.site
wildnatureimages.com westum.se
www.pinnacle-bets.com wfb.hatedriveapart.com
x-lime.com whipme.yopoint.in
xep.info whosonmyserver.com
winx-play.ru
workle.website
wpthemedetector.co.uk
www.event-tracking.com
xblog.in
xfire.com xfire.com
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xitjw.info
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai xn----7sbaphztdjeboffeiof6c.xn--p1ai
xnxx699.com xn----7sbifcamovvfggw9d.xn--p1ai
yaderenergy.ru xn----btbdvdh4aafrfciljm6k.xn--p1ai
youandcredit.ru xn----itbkqkfiq.xn--p1ai
youjizz.com xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
youtuhe.com xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
yunque.pluto.ro xn--b1adccaf1bzj.xn--p1ai
za-music.mymobiplanet.com xn--h1ahbi.com.ua
zakon-ob-obrazovanii.ru xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
zaobao.com.sg xzlive.com
zoogdiesney.com yaminecraft.ru
zreloeporno.tv youradexchange.com
zrizvtrnpale.tk youtoner.it
youtubologia.it
yubikk.info
yugk.net
zakazvzloma.com
zarabiaj-dzis.pl
zarabotok--doma.ru
zdesformula.ru
zero1.it
zeroredirect.com
zeroredirect10.com
zixizop.net.ru
zryydi.com

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
10bet.com 101lesbian.xyz
11235813.webzdarma.cz 4kepics.com
123any.com 8kisses.eu
123movies.love aa9d046aab36af4ff182f097f840430d51.com
1adult.com adexprts.com
300richmond.co.nz adidas.frwebs.fr
a.pr-cy.ru adloads.net
academia-nsk.org adsfresh.men
ads.gold
adultgalls.com
albumsuper.info
aliexpresscashback.club
alldownload.pw
allfinweb.com allfinweb.com
android4fun.org allkrim.com
apiportalmorecom-a.akamaihd.net amazon-seo-service.com
arenanews.com.ua
arquapetrarca.info
astana.xxxkaz.org
audiofree.ru
autobudpostach.club
autochoixspinelli.com autochoixspinelli.com
autolombard-krasnodar.ru b2b-lounge.com
awency.com bankofthewext.com
backuperwebcam.weebly.com bestdooz.com
banan.tv bestdraws.com
bankcrediti.ru bestwaystogetpaid.us
batanga.net betwinservice.com
best-seo-solution.com bimatoprost-careprost.com.ua
bestssaker.com bimmerpost.com
bet-prognoz.com bmsco.co
betune.onlinewebshop.net bonzibuddi.com
bigpenisguide.com brothers-smaller.ru
bizfly.info buckspar.gq
blog-hits.com builtwith.com
boazpower.com butstrap.space
boeuklad.com buzzsumo.com
brakehawk.com calvet.altervista.org
brandedleadgeneration.com
burn-fat.ga
buzz-porno.info
buzzurl.jp
callcafe.info
candiceloves.us
capacitacionyaprendizaje.com capacitacionyaprendizaje.com
carapics.com catalogs-parts.com
casite-513049.cloudaccess.net caveavins.fr
cenoval.ru charmstroy.info
ceotrk.com cheapjerseysap.com
cercacamion.it check-this-out-now.online
chastnoeporno.com cialisovercounteratwalmartusa.com
cherubinimobili.it civilwartheater.com
christianlouboutinreplica.pw cjs.com.ru
clickbank.net cl.s7.exct.net
compliance-barak.xyz cocyq.inwtrade.com
compliance-checker-7.info compliance-jane.top
compliance-jess.top countercrazy.com
compliance-walt.top cutalltheshit.com
conocer-sanabria.com d0t.ru
copyrightclaims.org dafatiri.com
cosmetic.donna7753191.ru data-mining.tk
cwetochki.ru dating-time-now.com
damedingel.ya.ru
dayibiao.com
dear-diary.ru dear-diary.ru
diffbot.com delayreferat.ru
disruptingdinnerparties.com dieta-personalna.pl
div.as digilander.libero.it
dokumentalkino.net discountbarbour.online
domashneeruporno.com dotmass.top
dosug-lux.ru e-collantes.com
dscaas.website electricwheelchairsarea.com
dwomlink.info elmifarhangi.com
eachdayisagift.review eloxal.ru
ege-russian.ru ero-advertising.com
ekto.ee ez8motelseaworldsandiego.com
englishgamer.com ezigarettenshop1.yolasite.com
erectile.bid f07.de
erotische-geschichten-xxl.com f1nder.org
esnm.ru fashionindeed.ml
euroskat.ru feel-planet.com
extremepornos.net ferretsoft.com
ezigarettekaufen1.hpage.com ff30236ddef1465f88547e760973d70a.com
ezigarettenshop2.myblog.de filmbokep69.com
facebook-mobile.xyz filmidivx.com
factorynightclub.com forum.poker4life.ru
felizporno.com frbizlist.com
fellowshipoftheminds.com free-fb-traffic.com
fetishinside.com free-share-buttons.blogspot.com
financepoints.eu frustrated-favorable.gq
forodvd.com fsalas.com
fortunejack.com g7m.pl
freshberry.com.ua gael-s.ru
galaxys6manual.info galaxyflowers.ru
game-top.su gameprimary.com
gavuer.ru get-free-traffic-now.com
getaclueamerica.com gfaq.ru
gk170.ru goatse.ru
gloverid.site goldpanningtools.com
golden-catalog.pro gomusix.com
greenidesign.co googglet.com
health-medical-portal.info gwebtools.com
hitsbox.info handicapvantoday.com
holidaypics.org hannasolution.ru
hop.clickbank.net hdwallpapers-free.com
hotelcrocenzi.sm hikesearch.net
howlongdoestizanidinestayinyoursystem.blogspot.com homeart.space
hoverboard360.at
howtowhitenteethfast.xyz
humanelydrew.com
i-service.kz
iamsport.org
id-forex.com id-forex.com
ilmen.net ilovevitaly.com
imgarit.pw impisr.edunsk.ru
incep.imagine-ex.co import-sales.com
infokonkurs.ru inboxdollars.com
infospot.pt infowarcraft.ru
interfucks.net interesnie-faktu.ru
isoveti.ru internet-apteka.ru
iweblist.info
jackwolfskinoutlet.online
jagg.info
jamiembrown.com jamiembrown.com
jennyfire.ru javrip.net
jaxcube.info
jillepille.com
justbcause.com
justdating.online
jyvopys.com
kam-dom.ru
karusel-market.ru
katushka.net
keywordsdoctor.com keywordsdoctor.com
keywordteam.net kupit-adenu.ru
kursy-ege.ru
lanadelreyfans.us
lanasshop.ru lanasshop.ru
lasvegaslockandsafe.com lapolis.it
lemon-ade.site larose.jb2c.me
liquimondo.com lecbter-relationships.ga
livefixer.com lineavabit.it
liveu.infoteka.hu lordzfilmz.me
maglid.ru lost-alpha.ru
manipulyator-peterburg.ru mafcards.ru
masturbate.co.uk maranbrinfo.com.br
maxxtor.eu marcogrup.com
mebel-alait.ru markjaybeefractal.com
mebel-vstroika.ru medicine-4u.org
mediafresh.online missvietnam.org
metaxalonevstizanidine.blogspot.com moivestiy.biz
micasainvest.com mojpregled.com
mobstarr.com monarchfind-a.akamaihd.net
mp3ringtone.info montredemarque.nl
mrsdalloways.com moviezbonkerssk.cf
musflashtv.com musicpro.monster
myanyone.net musirc.com
mybinaryoptionsrobot.com muzaporn.com
mydirtystuff.com myonlinepayday.co
narkologiya-orel.ru myra.top
narkologiya-peterburg.ru netvouz.com
naturtreenspicerx.pw nrjmobile.fr
naval.jislaaik.com nucia.biz.ly
ngps1.ru nudo.ca
noumeda.com o-o-8-o-o.ru
novosti-hi-tech.ru ochistka-stokov.ru
nuit-artisanale.com onefilms.net
obiavo.com openlibrary.org
oksrv.com orion-v.com
onescreen.cc orsonet.ru
ons-add.men ownshop.cf
partnerworkroom.men pdamods.ru
perfectpracticeweb.com pekori.to
picswe.com pelfind.me
piuminiita.com pizza-tycoon.com
pixshark.com play-movie.pl
poems.com.ua pochemychka.net
pojdelo.weebly.com popugauka.ru
polska-poezja.com pornosexrolik.com
pontiacsolstice.info potolokelekor.ru
pony-business.com preg.marketingvici.com
popserve.adscpm.net pretty-mart.com
popunder.ru pricheskaonline.ru
porn-w.org privatamateure.com
prointer.net.ua privatefx-in.ru
promoheads.com prize44.com
quickloanbank.com proftests.net
ranksignals.com progress-upakovka.ru
ranksonic.com prom23.ru
redhotfreebies.co.uk purplestats.com
remont-fridge-tv.ru radiogambling.com
resultshub-a.akamaihd.net rank-checker.online
rff-cfal.info razleton.com
rossmark.ru renecaovillasale.online
royal-investments.net riralmolamsaca.tk
rozalli.com robertefuller.com
rustic-quiver.win royal-betting.net
sanyuprojects.com rvtv.ru
rvzr-a.akamaihd.net
rybalka-opt.ru
salutmontreal.com
scanner-donald.top scanner-donald.top
scanner-george.top selectads.men
sdsjweb.com seoanalyses.com
seo-platform.com seoheap.com
seorankinglinks.com seonetwizard.com
seorankinglinks.xyz seorank.info
servicecenter.co.ua sexreliz.com
sexblog.pw
sexpornotales.com
shinikiev.com.ua shinikiev.com.ua
sisi-go.ru siteonomy.com
sitevaluation.com skylta.com
solitaire-game.ru sloopyjoes.com
soundfrost.org snegozaderzhatel.ru
spidtest.org sodexo.com
srgwebmail.nl souvenir.cc
stpolice.com space2019.top
strangeduckfilms.com spammen.de
strongsignal-a.akamaihd.net sps-shop.com
strv.se stop-gepatit.te.ua
stuffpride.com sugarkun.com
superlist.biz
svolze.com
swinger-mobil.net
taaaak.com
taximytishi.ru
teastory.co teastory.co
time-japan.ru teenfuck.tv
timer4web.com template-kid.com
tizanidinedosageforsleep.blogspot.com templates.franklinfire.co
tizanidineonline.blogspot.com themeforest.net
tizanidinevssoma.blogspot.com tizanidineformigraines.blogspot.com
tjkckpytpnje.com toxicwap.com
tksn.ru track.deriv.com
toondinsey.com tryrating.com
tracksz.co tubeline.biz
tversvet.ru tula.mdverey.ru
tvory.predmety.in.ua tv-spoty.info
twincitiescarservice.com twittruth.com
ukkala.xyz ukrtvir.com.ua
umaseh.com umnovocaminho.com
unisexjewelry.org uptime-as.net
uzporno.mobi usacasino.com
v24s.net vapeface.club
valoresito.com versaut.xxx-cam.webcam
via-energy-acquistare.com videochat.life
video-production.com videojam.tv
videochaty.ru videooko.weebly.com
videtubs.pl virtuagirl.com
voloomoney.com visa-china.ru
watchmygf.net vmnmvzsmn.over-blog.com
watsonrealtycorp.com vodkoved.ru
weblibrary.win vzlomtw.com
weddingdresses.xyz vzubah.com
whengirlsgowild.com w3javascript.com
white-truck.life website-stealer.nufaq.com
westen-z.life
westvilletowingservices.co.za
wholesalejerseysgaa.com
wingsofrefuge.net wingsofrefuge.net
winterclassichockeyjerseys.com www.souvenirua.com
wleuaprpxuvr.ga www.timer4web.com
www.wohnkabinen-shop.de xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
x-diesel.info xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xmladserver.com xn--e1afanlbnfckd7c3d.xn--p1ai
xmnb.net xxart.ru
xn--80ahvj9e.xn--p1ai yadro.ru
zazagames.org yaoguangdj.com
zebramart.ru ynymnwbm.bloger.index.hr
zed21.net youjizz.vc
zlatnajesen.com youtubedownload.org
zolotoy-lis.ru ypmuseum.ru
zootoplist.com zkjovpdgxivg.ga
zreloeporno.tv

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.94 0; 10.1.0.107 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3144 ### Version: V4.2022.06.3145
### Updated: Fri Jun 3 10:03:19 UTC 2022 ### Updated: Fri Jun 3 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3144 ### Version: V4.2022.06.3145
### Updated: Fri Jun 3 10:03:19 UTC 2022 ### Updated: Fri Jun 3 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##