vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 02:29:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.01.2884 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-01-28 22:07:42 +00:00
parent 9d6244979c
commit 2b4216f655
46 changed files with 86561 additions and 86561 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.01.2883 #### Version: V4.2022.01.2884
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.01.2883 #### Version: V4.2022.01.2884
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.01.2883 #### Version: V4.2022.01.2884
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10684
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.01.2883 #### Version: V4.2022.01.2884
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10688
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10688
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10688
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10688
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.205 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.205 0;
127.0.0.1 0; 127.0.0.1 0;

10688
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.205 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.205 0;
127.0.0.1 0; 127.0.0.1 0;

10688
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.205 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.205 0;
127.0.0.1 0; 127.0.0.1 0;

10688
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2883 2884

10688
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10688
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.255.164.140 0; 20.115.165.181 0;

10688
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.205 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.205 0;
127.0.0.1 0; 127.0.0.1 0;

10688
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.205 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.205 0;
127.0.0.1 0; 127.0.0.1 0;

10688
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.205 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.205 0;
127.0.0.1 0; 127.0.0.1 0;

10688
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.255.164.140 0; 20.115.165.181 0;

10688
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.255.164.140 0; 20.115.165.181 0;

10688
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.205 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Grabber ADmantX
InfoTekies Devil
LinkextractorPro IndeedBot
Offline Explorer JetCar
SMTBot Keyword Density
ScrepyBot Nameprotect
TurnitinBot Nuclei
Web Fetch Probethenet
Webshag Wprecon
iubenda-radar plumanalytics

296
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404checker 404checker
80legs 404enemy
ADmantX
AIBOT AIBOT
ALittle Client
ASPSeek
Abonti Abonti
Aboundex Aboundex
Aboundexbot Aboundexbot
AfD-Verbotsverfahren AhrefsBot
AiHitBot Alligator
Alexibot AlphaBot
Anarchy99 Anarchy
Asterias Atomseobot
BDFetch Attach
BacklinkCrawler AwarioRssBot
BetaBot BackDoorBot
Backlink-Ceck
Battleztar Bazinga
Bitacle Bitacle
Black Hole Blow
BlackWidow Bolt
Blackboard BotALot
Brandprotect
Buddy Buddy
BuiltWith BuiltWith
Bullseye
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CCBot CCBot
CODE87 CODE87
Calculon
CheTeam CheTeam
CheeseBot CheeseBot
CherryPicker
Chlooe Chlooe
Claritybot Citoid
Cliqzbot
Cloud mapping Cloud mapping
Collector Collector
Copier Copier
Copyscape CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent
CrunchBot CrunchBot
Curious CyotekWebCopy
DIIbot DTS Agent
DSearch Demon
DatabaseDriverMysqli Digincore
Devil
Dirbuster Dirbuster
Disco
Dispatch Dispatch
DnyzBot DittoSpyder
DomainCrawler DomainCrawler
DomainStatsBot DomainStatsBot
Dotbot Domains Project
Dragonfly Drip
EMail Siphon EMail Wolf
Ebingbong EasyDL
Ecxi
EirGrabber
EroCrawler EroCrawler
ExtractorPro Exabot
FlashGet Express WebPictures
Foobot ExtLinksBot
FrontPage Extractor
Fyrebot Extreme Picture Finder
Genieo EyeNetIE
GermCrawler Ezooms
Flunky
Freeuploader
G-i-g-a-b-o-t
Getintent Getintent
Gigabot Gigabot
Go-Ahead-Got-It Gotit
Grabber Grafula
HEADMasterSEO
HMView
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
HTTrack Haansoft
Harvest Harvest
Havij
Heritrix Heritrix
Hloader Hloader
HybridBot HonoluluBot
Id-search IDBTE4M
IlseBot IDBot
Image Fetch IRLbot
InternetSeer Iblog
IndeedBot
InfoNaviRobot
InterGET
Iria Iria
IstellaBot JOC Web Spider
Jbrofuzz JamesBOT
JikeSpider
Joomla
JustView JustView
Larbin Kenjin Spider
Leap Kozmosbot
LexiBot LNSpiderguy
Lftp Lftp
LibWeb LibWeb
Libwhisker
Lightspeedsystems Lightspeedsystems
Likse Likse
LinksManager LinkextractorPro
LinqiaMetadataDownloaderBot LinkpadBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Ltx71
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool MIDown tool
MJ12bot MJ12bot
MTRobot MSFrontPage
MSIECrawler
Mag-Net
Magnet Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO Majestic SEO
Masscan Majestic-SEO
MauiBot Mata Hari
Meanpathbot Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri MicroMessenger
Microsoft Data Access Microsoft URL Control
Minefield
Moblie Safari Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Nameprotect NearSite
Navroad
Nessus Nessus
Net Vampire NetLyzer
NetSpider NetMechanic
Niki-bot NetZIP
Nikto Netcraft
NimbleCrawler Netvibes
Nuclei Not
Offline Explorer Nutch
OpenVAS Offline Navigator
Openvas Openvas
OrangeSpider
OutfoxBot OutfoxBot
Page Analyzer
PageGrabber PageGrabber
PageScorer
PageThing.com PageThing.com
Pavuk Pandalytics
Panscient
Papa Foto
PeoplePal PeoplePal
Pi-Monster Pi-Monster
Picscout Picscout
Picsearch Picsearch
PictureFinder Pimonster
PleaseCrawl Pockey
ProPowerBot
Probethenet
Psbot Psbot
Pu_iN Pu_iN
Pump Pump
QueryN Metasearch
Quick-Crawler Quick-Crawler
RSSingBot RankActiveLinkBot
RankActive Rankivabot
RankingBot2
Re-re
ReGet ReGet
Reaper RealDownload
SEOkicks Rogerbot
SEOkicks-Robot SBIder
SEOstats
SMTBot SMTBot
Scanbot Scanbot
ScoutJet
Screaming
ScreenerBot ScreenerBot
Site Sucker ScrepyBot
SiteExplorer SearchmetricsBot
Sitebeam Siphon
Sitevigil SiteCheckerBotCrawler
Snake SiteSnagger
Snoopy SiteSucker
Siteimprove
Sociscraper Sociscraper
Sogou web spider Sottopop
SpankBot
Spanner Spanner
SputnikBot Sqlmap
Sqlworm
Steeler
Sucker Sucker
SuperHTTP
Surfbot Surfbot
T0PHackTeam Suzuran
T8Abot Teleport
Telesphoreo Telesoft
Thumbor
TightTwatBot TightTwatBot
Toweyabot Titan
Tracemyfile TwengaBot
Trendictionbot
True_Robot
Turnitin
TurnitinBot
Typhoeus
URLy.Warning URLy.Warning
UnisterBot
V-BOT V-BOT
VCI VCI
Vagabondo Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
Voil VoidEYE
WBSearchBot
WEBDAV
WISENutbot WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD Web Auto
Web Collage Web Pix
Web Enhancer Web Sucker
Web Fetch WebBandit
WebGo IS
WebImageCollector
WebLeacher WebLeacher
WebPix
WebReaper
WebSucker WebSucker
WebWhacker WebWhacker
WebZIP WebZIP
Webalta Webalta
WebsiteQuester Webshag
Webster WebsiteExtractor
Whack Whack
Whacker
Widow Widow
WiseGuys Robot WinHTTrack
Wonderbot Wonderbot
Woobot Woobot
Wprecon Wotbox
Xenu
Zade Zade
Zeus
Zitebot Zitebot
ZmEu ZmEu
ZumBot
ZyBorg ZyBorg
adscanner
archive.org_bot archive.org_bot
autoemailspider arquivo-web-crawler
check1.exe cah.io.community
coccocbot-web
cognitiveseo cognitiveseo
com.plumanalytics dataforseo.com
crawler.feedback
demandbase-bot demandbase-bot
domainsproject.org eCatch
evc-batch gopher
facebookscraper
heritrix heritrix
internetVista monitor internetVista monitor
iubenda-radar
meanpathbot
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
page scorer oBot
plumanalytics
probe-image-size probe-image-size
seobility s1z.ru
seostar scalaj-http
sogouspider seoscanners
sexsearcher
siteripz
sysscan
trendiction.de
ubermetrics-technologies.com
webgains-bot webgains-bot
webprosbot webmeup-crawler
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab

316
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 404checker
ADmantX 80legs
Abonti AIBOT
Aboundex ALittle Client
Aboundexbot
Acunetix Acunetix
Aipbot Anarchie
Alexibot Anarchy
AlphaBot Anarchy99
Apexoo Aspiegel
Asterias Asterias
AwarioRssBot
AwarioSmartBot
BDFetch BDFetch
BLEXBot BackDoorBot
BackStreet BackStreet
Backlink-Ceck BackWeb
BacklinkCrawler
Barkrowler Barkrowler
BetaBot Battleztar Bazinga
Black Hole Bitacle
BlackWidow
Blackboard Blackboard
BlowFish Blow
Boardreader
BotALot BotALot
Brandwatch
Buck
Buddy
BuiltWith BuiltWith
Bullseye BuzzSumo
CCBot CATExplorador
CODE87 Cegbfeieh
CensysInspect CheeseBot
CherryPicker ChinaClaw
Claritybot Cliqzbot
Cocolyzebot CopyRightCheck
Copier
Copyscape Copyscape
Cosmos Crawling at Home Project
Crescent
CrunchBot CrunchBot
Custo Custo
CyotekWebCopy CyotekWebCopy
DataCha0s DBLBot
Devil DIIbot
Digincore DSearch
Demon
DigitalPebble
Dirbuster Dirbuster
Discobot Discobot
Dispatch DnyzBot
DomCopBot DomainAppender
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi Ecxi
EirGrabber EirGrabber
EroCrawler
Evil Evil
Exabot Exabot
ExtLinksBot Ezooms
Extractor FDM
EyeNetIE
FHscan FHscan
FemtosearchBot Fimap
Firefox/7.0 Flunky
FlashGet Freeuploader
G-i-g-a-b-o-t Fyrebot
GT::WWW
GermCrawler
GetWeb
Getintent Getintent
Grabber Go-Ahead-Got-It
GrapeFX HEADMasterSEO
GrapeshotCrawler HaosouSpider
HMView Havij
HTMLparser Heritrix
HTTP::Lite
Haansoft
Harvest
Hloader Hloader
HonoluluBot
IDBTE4M IDBTE4M
Iblog IRLbot
Id-search
IlseBot
Image Fetch Image Fetch
IndeedBot Image Sucker
Indy Library InfoNaviRobot
InfoTekies
Intelliseek
InterGET InterGET
Iskanie Internet Ninja
IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT Jetty
Jbrofuzz
JennyBot
Jorgee Jorgee
Kinza
LNSpiderguy LNSpiderguy
Lanshanbot LWP::Simple
Larbin Larbin
Leap
LeechFTP LeechFTP
LeechGet LeechGet
LexiBot
Lftp Lftp
LibWeb Libwhisker
LinkWalker Lightspeedsystems
LinkpadBot Linkbot
Linkdexbot
LinkextractorPro
LinksManager LinksManager
Litemage_walker LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lmspider Lmspider
Ltx71
MJ12bot MJ12bot
MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12 Majestic12
Masscan MarkMonitor
MauiBot MauiBot
Mediatoolkitbot MegaIndex.ru
Metauri MolokaiBot
Microsoft Data Access
Minefield
Moblie Safari
Mojolicious
Mr.4x3 Mr.4x3
Musobot Msrabot
Nameprotect NICErsPRO
Navroad Nessus
Needle NetLyzer
NetAnts
NetMechanic
NetSpider NetSpider
Nettrack Nettrack
NextGenSearchBot Netvibes
Nibbler NimbleCrawler
Nikto
Ninja
Nuclei
Nutch
Offline Navigator
OnCrawl
OpenVAS
Openvas Openvas
OutclicksBot
OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageGrabber PageGrabber
PageScorer
PageThing.com PageThing.com
Pavuk Papa Foto
Pi-Monster Petalbot
Piepmatz Picscout
Pimonster Psbot
Probethenet Pu_iN
Pump PxBroker
PyCurl QueryN Metasearch
Quick-Crawler RankActive
RSSingBot RankActiveLinkBot
RankFlex RankingBot
Rankivabot Rankivabot
RealDownload Re-re
Recorder Reaper
RepoMonkey Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder SBIder
SMTBot SEOkicks
Screaming SEOkicks-Robot
ScreenerBot ScreenerBot
SearchmetricsBot SearchmetricsBot
Semrush
SemrushBot SemrushBot
SentiBot
Siphon
Site Sucker Site Sucker
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
Siteimprove SiteSnagger
SlySearch Sitebeam
Sitevigil
SmartDownload SmartDownload
Snapbot
Snoopy Snoopy
SocialRankIOBot Sociscraper
Sosospider
Sottopop Sottopop
Spammen Spanner
SpankBot Spbot
SputnikBot Sqworm
Sqlworm
Steeler Steeler
Stripper Stripper
Sucker
Sucuri Sucuri
SuperBot
SuperHTTP SuperHTTP
Surfbot
SurveyBot
Swiftbot Swiftbot
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep Telesphorep
Thumbor
TightTwatBot TightTwatBot
Toata
Toweyabot Toweyabot
True_Robot Tracemyfile
Turnitin
TurnitinBot
Typhoeus
UnisterBot UnisterBot
Vagabondo VCI
VeriCiteCrawler VelenPublicWebCrawler
VidibleScraper
Voil
WBSearchBot WBSearchBot
WISENutbot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWW::Mechanize
Wallpapers
WallpapersHD WallpapersHD
WeSEE
Web Collage Web Collage
Web Fuck Web Enhancer
Web Sauger
Web Sucker Web Sucker
WebAuto
WebBandit WebBandit
WebFetch WebCollage
WebEnhancer
WebImageCollector
WebLeacher
WebStripper
WebSucker WebSucker
WebWhacker
WebZIP WebZIP
Website Quester Webalta
WebmasterWorldForumBot
WebsiteExtractor WebsiteExtractor
WebsiteQuester Whacker
Webster WiseGuys Robot
Whatweb Wprecon
Who.is Bot
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot YoudaoBot
Zade Zeus
Zitebot ZmEu
ZumBot
ZyBorg
adscanner adscanner
arquivo-web-crawler arquivo.pt
autoemailspider cah.io.community
clark-crawler clark-crawler
cognitiveseo cognitiveseo
dataforseo.com com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org
gopher
heritrix heritrix
ips-agent isitwp.com
iubenda-radar lwp-trivial
lwp-request
magpie-crawler magpie-crawler
meanpathbot
mediawords mediawords
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
page scorer
pcBrowser
plumanalytics plumanalytics
ripz probe-image-size
scalaj-http scalaj-http
sexsearcher scan.lol
seoscanners
seostar
serpstatbot
siteripz siteripz
sogouspider
sp_auditbot sp_auditbot
tAkeOut
ubermetrics-technologies.com ubermetrics-technologies.com
webpros.com
x22Mozilla x22Mozilla
xpymep1.exe zgrab
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
4kpics.rocks anapa-inns.ru
cartierlove2u.xyz centre-indigo.org.ua
filefilter.weebly.com domain.webkeyit.com
mrcsa.com.au drugstoreforyou.com
pdfprof.com infowarcraft.ru
poptool.net moetomnenie.com
realting-moscow.ru portside.cc
videochat.cafe torontoplumbinggroup.com
westen-v.life videtubs.pl
x-diesel.com vksaver-all.ru

922
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1-free-share-buttons.com 0lovespells0.blogspot.com
1000n1.ru
1001desert.com
11235813.webzdarma.cz 11235813.webzdarma.cz
123locker.com 123movies.love
12bet.com 2020iscoming.info
18ps.ru
1hwy.com
1kdailyprofit.me
24x7-server-support.site 24x7-server-support.site
3weekdiet.com 273-fz.ru
4pp13.com 404.mn
57883.net 4replicawatch.net
8gold.com 5000-cotydzien.com
8kisses.eu 883zy.com
aac52006ec82a24e08b665f4db2b5013f7.com abcdeg.xyz
abusora.com abiente.ru
acc.eu.org
actices.com
actionnooz.com
acunetix-referrer.com
ad-words.ru ad-words.ru
adf.ly adexprts.com
adloads.net
admeasures.com admeasures.com
adnotbad.com adprotect.net
ads-cool.pro adultnet.in
adtech.fr advertisingtag.net
albamargroup.com affiliate-fr.com
algerianembassy.co.in afftrack001.com
allbizne.co.ua afmuseum.com
animenime.ru afora.ru
apioasisspacenet-a.akamaihd.net aktivator-windows10.blogspot.com
appfixing.space alive-ua.com
applicationg29.com alldownload.pw
arclk.net andpolice.com
arendakvartir.kz animebox.com.ua
artefakct.com anonymizeme.pro
asrvvv-a.akamaihd.net apelsinnik.website
astrochicks.com apiitsthirteende-a.akamaihd.net
atofilms.com apimegabrowsebiz-a.akamaihd.net
automobile-spec.com apispringsmartne-a.akamaihd.net
appleid-verification.com
arcadeplayhouse.com
arius.tech
asscenihotosidea.blogspot.com
aversis.net
aviav.ru.com
avitocars.ru
avon-novosib.ru
avtointeres.ru avtointeres.ru
azartmsl.com avtolombard-krasnodar.com
azarttoto.com awency.com
azbaseimages.net ayakino.net
azbukadiets.ru ayanaspa.com
azinoofficial777.ru backuperwebcam.weebly.com
babespcs.com bannerbank.ru
babyguns.ru bannerpower.com
back.dog bannerspace.com
backlink4u.net bavsac.com
baditri.com bayareaaeroclub.org
bear.gotcher.us best-coupon-offer.com
becuo.com bestbuy.ca
beremenyashka.com bestofpicture.com
besthomemadepornsites.com bestpriceninja.com
bestimagecoollibrary.com beta.hotkeys.com
betterscooter.com bharatdefencekavach.com
bin-brokers.com biglistofwebsites.com
bingoporno.com bingoporno.com
bitcoinremote.com blogos.kz
biteg.xyz
bjetjt.com
blogs.rediff.com
bloke.com
bluejays-jerseys.us bluejays-jerseys.us
bmwhighperformers.com bolitgorlo.net
boanonihaca.tk
boeuklad.com
bombla.org bombla.org
bouda.kvalitne.cz bonvillan.com
brandehk.dk boom-celebs.com
brianhenry.co bracketsmackdown.com
bscodecs.com braip.com.br
btvn.ru brandbucket.com
bugof.gq breastaugmentation.co.za
builtwith.com brewdom.ru
bumascloset.com browsepulse-a.akamaihd.net
buttons-for-your-website.com budpost.com.ua
buy-forum.ru buntube.net
bvlgariwallet.xyz bupropion-sr-150-mg.us
c1.onedmp.com buyessay3.blogspot.ru
call-of-duty.info buypuppies.ca
candytiner.com byme.se
cannibalcheerleader.com callawaygolfstore.online
cartierreplica.top cardsharp1.ru
cartierreplica.xyz carson.getenjoyment.net
cartierwatch.xyz cartujano-pre.de
casinos4dummies.co.uk casite-513049.cloudaccess.net
cb.iphantom.com
cenoval.ru
cerev.info cerev.info
certifywebsite.win cezartabac.ro
cfsrating.sonicwall.com chatroulette.video
chcu.net chatroulette.world
chimiver.info cheapjerseysbizwholesale.us
cialischsrx.com chiblackhawks-jerseys.com
cialisndbrx.com chocolateslim-original.com
cicaki.net choice-credit.ru
cindymatches.com cjmc.info
clean-virus-mac.com
cleanpcnow.com cleanpcnow.com
clipartnew.com club-lukojl.ru
cobaltpro.ru
cocolyze.com
coderstate.com
coldfilm.ru
colehaanoutlet.store
comeondog.info comeondog.info
cometorussia.net compliance-andrew.xyz
community.allhiphop.com compliance-don.top
compliance-checker-7.info
compliance-donald.xyz compliance-donald.xyz
compliance-jess.top compliance-george.top
consorzioilmosaico.org compliance-julia.top
compliance-viktor.top
comsysnet.com
cookie-law-enforcement-ff.xyz
cookielawblog.wordpress.com
coop-gamers.ru coop-gamers.ru
countercrazy.com copypaste.traderzplanet.in
creativehutindia.com cougfan.info
credit-respect.ru crackzplanet.com
creditnation.ru d2jsp.org
crest3d.ru
cupday.com
cyse.tk
dailystrength.org dailystrength.org
daooda.com dame-ns.kz
daptravel.com
darmebel.com.ua
dealitright.click
decorationspcs.com
delayreferat.ru
dengi-pod-zalog-nedvizhimosti.ru dengi-pod-zalog-nedvizhimosti.ru
designdevise.com design-lands.ru
destinationrealestate.com dignitasdata.se
detsky-nabytek.info diusyawiga.tk
dev78.dioniqlabb.se divatraffic.com
dimfour.com docs4all.com
discovertreasurenow.com docstoc.com
djihispano.com dojki-hd.com
dnsrsearch.com doyouknowtheword-flummox.ml
dokumentalkino.net dpihatinh.gov.vn
domain.webkeyit.com driving.kiev.ua
downloaddy.net dynainbox.com
dprtb.com eager-nash.188-93-233-196.plesk.page
e-biznes.info editmedios.com
e-collantes.com edudocs.net
e705.net ekobata.ru
ebooknovel.club elektronischezigarettekaufen1.beeplog.com
ecommerce-seo.com elektrozigarette1.dreamwidth.org
electrik-avenue.com elitedollars.com
elektrozigarette2.wordpressy.pl embedle.com
elexies.info enbersoft.com
englishgamer.com everflora.ru
esfchat.tk evidencecleanergold.com
esopini.com
essayassist.com
etotupo.ru
eurosamodelki.ru
exchangeit.gq
exchanges-bet.com exchanges-bet.com
executehosting.com ezigaretteshop2.mywapblog.com
extremez.net f012.de
eyessurgery.ru f07.de
ezigarettekaufen2.yolasite.com faithe.top
facebook-mobile.xyz famix.xyz
fandlr.com fast-torrent.ru
farmingworm.com fast-wordpress-start.com
fellowshipoftheminds.com favornews.com
fidelityfunding.com fickenbumsen.net
filesvine.com
filkhbr.com filkhbr.com
fivedwld.cf filmbokep69.com
flprog.com filmetricsasia.com
fm-upgrade.ru filunika.com.ru
fodelsedagspresenter.nu finejewelryshop.ru
fok.nl finuse.com
forensicpsychiatry.ru fix-website-errors.com
forex-procto.ru flex4launch.ru
freenode.info flowersbazar.com
freesitetest.com fotopop.club
fuckmill.com fototravel.eu
fx-brokers-review.com futbolkisales.ru
gabeshop.ru gallery.rennlist.com
galaxy-family.ru gambarxkata.co
gambarkataku.co gamblingnerd.com
gamingspark.com game-mmorpg.net
gazobeton-p.com.ua gameprimary.com
getresponse.com gaming-journal.com
genericviagrasildenafiled.net
gepezz.info
gfaq.ru
girlspicsa.com girlspicsa.com
gnuetella.com go2album.com
golaya.pw
goldandcard.ru
gomusix.com
goodhousekeeping.com
goodhumor24.com
googlemare.com googlemare.com
gpirate.com graphicwe.org
greatidea.marketing green-tea.tv
groupmoney.ru
gsasearchengineranker.top gsasearchengineranker.top
gsmtlf.ru gsmtlf.ru
gymi.name guigyverpo.cf
hatedriveapart.com guitar-master.org
havepussy.com hdhc.ru
hawaiielectriclight.com hdimagegallery.net
hetmanship.xyz health-medical-portal.info
herehloadibs.cf
hifidesign.ru hifidesign.ru
highspeed5.net high-speed1.net
highstairs-a.akamaihd.net hitsbox.info
hiwibyh.bugs3.com hobbyhuren-datenbank.com
homeart.space homemade.gq
homedecoguide.info hotxnights.info
hostsshop.ru howtoclean.club
houdom.net ideawheel.com
housekuba.org igithab.com
hoverboard360.at igrovyeavtomaty777.ru
hoverboard360.se imagine-ex.co
hybrid.ru immobiliaremassaro.com
ico.re indetiske.ya.ru
ictizanidinehcl4mg.blogspot.com infektsii.com
imgarit.pw innoslicon.com
indo-export.ru inome.com.ua
infobanks.ru intelhdgraphicsgtdrive6w.metroblog.com
invest-pamm.ru intellekt21.ru
investsuccess.org irkutsk.online-podarki.com
iopeninghours.co.uk islamtoday.co.za
ip-guide.com isotoner.com
iplusbit.blogspot.co.za ispac.org
iqbazar.ru ivoiretechnocom.ci
iqs.biz.ua jabimgo.pw
ixora.pro janerikholst.se
izhevsk.zrus.org jbl-charge.info
jav-fetish.com job.icivil.ir
javrip.net jobgirl24.ru
jerseysbizwholesalecheap.com johannesburgsingles.co.za
journalhome.com joyceblog.top
kamen-e.ru karusel-market.ru
kamorel.com kazka.ru
kazinogames.lv keki.info
kevblog.top kiskinhouse.com
kinopolet.net komputers-best.ru
kladrus.ru koronirealestate.gr
knowyournextmove.com kovrenok.ru
kollekcioner.ru kupit-adenu.ru
konturkrasoty.ru lacasamorett.com
kozhniebolezni.com letmacworkfaster.site
kraljeva-sutjeska.com lflash.ru
labafydjxa.su life.biz.ua
lacave.ntic.fr lifehacĸer.com
larutti.ru
lechtaczka.net
letsart.ru
libertybilisim.com
liffa.ru
lincolntheatre.com
linkdebrideur.xyz linkdebrideur.xyz
lisque.batcave.net liver-chintai.org
littleberry.ru lombardfinder.ru
livefixer.com losangeles-ads.com
livingcanarias.com
locatellicorretor.com.br
lonerangergames.com
longgreen.info
longlifelomilomi.info
lostfilm-online.ru
lubetube.com lubetube.com
lunchrock.co lulea-auktionsverk.se
luxmagazine.cf macdamaged.space
mackeeper-center.club mackeeper-land-672695126.us-east-1.elb.amazonaws.com
macnewtech.com
magento-crew.net magento-crew.net
magnetic-bracelets.ru mansparskats.com
makedo.ru max-eclat.men
mall.uk maxxtor.eu
markjaybeefractal.com mecash.ru
matematikus.info medizinreisen.de
matsdale.com
maximpartnerspr.com
mebel-alait.ru
mega-bony2017.pl
megakino.net megakino.net
mere.host.sk members.ghanaweb.com
mhi-systems.ru message-warning.net
michaelkorssaleoutletonline.net mikozstop.com
misterjtbarbers.com militarysale.pro
mixtapetorrent.com minecraft-neo.ru
mobile-appster.ru mini.7zap.com
mobilierland.com missis.top
moesexy.com misswell.net
moneymaster.ru mjchamonix.org
monsterdivx.com mobsfun.net
montazhnic.ru modenamebel.ru
more-letom.ru moesonce.com
mp3downloadhq.com moneyzzz.ru
muizre.ru morf.snn.gr
music.utrolive.ru most.gov.iq
muz-shoes.ru mouselink.co
myfreetutorials.com mrpornogratis.xxx
mypornfree.ru mydearest.co
mysex21.com na15.ru
nalogovyykodeks.ru nash-krym.info
namenectar.com naughtyconnect.com
naperehresti.info negociosdasha.com
nextlnk12.com negral.pluto.ro
nikkiewart.ru networkad.net
npoet.ru new-apps.ru
nuup.info nextbackgroundcheck.gq
oda.as nfljerseyscheapbiz.us
ofanda.com nightvision746.weebly.com
oivcvx.website njkmznnb.ru
oktube.ru nofreezingmac.work
onescreen.cc nosecret.com.ua
online-podarki.com nottyu.xyz
onlinetvseries.me novatech.vn
onlinewritingjobs17.blogspot.ru oakleyglassesonline.us
ons-add.men obiavo.net
onstrapon.purplesphere.in offside2.5v.pl
ontargetseo.us oil-td.ru
onthemarch.co okmedia.sk
ourtherapy.ru onemantrip.com
outshop.ru onko-24.com
oz-offers.com online247.ml
partners-ship.pro online7777.com
patterntrader-en.com onlinemeetingnow.com
pawli.eu openfrost.com
pepperstyle.ru openfrost.net
petedrummond.com openstat.com
photorepair.ru orel-reshka.net
picurams.pw osnova3.ru
p-business.ru
paperwritingservice17.blogspot.ru
paphoselectricianandplumber.com
parajumpersstore.online
parlament.biz
partner-high.men
perm-profnastil.ru
phelissota.xyz
photokitchendesign.com
phpdevops.com
phrcialiled.com
pila.pl pila.pl
pinkduck.ga piter.xrus.org
pizdeishn.com
pizza-tycoon.com pizza-tycoon.com
playtap.us pk-services.ru
polska-poezja.com plastjulgranar.se
pornhub-ru.com plohaya-kreditnaya-istoriya.ru
pornoelita.info pochtovyi-index.ru
pornofiljmi.com podshipniki-nsk.ru
pornogig.com pokemon-go-play.online
pornosexrolik.com pokemongooo.ml
portside.xyz pony-business.com
pozdrawleniya.ru popunder.net
praisong.net porngalleries.top
primedice.com pornokajf.com
privatefx.all4invest.info pornosemki.info
prizeestates.cricket preparevideosafesystem4unow.space
quit-smoking.ga princeadvantagesales.com
rating-bestcasino.com psa48.ru
razamicroelectronics.com pukaporn.com
reckonstat.info puzzleweb.ru
referencemoi.com questionmarque.ch
registratciya-v-moskve.ru quickloanbank.com
reklama-i-rabota.ru r-control.ru
reklama1.ru rabot.host.sk
relax.ru radiodigital.co
renecaovilla.online rangoman.date
replica-watch.ru rankia.com
responsive-test.net realmonte.net
rethinkwasteni.info realting-moscow.ru
redirlock.com
regionshop.biz
registrydomainservices.com
repeatlogo.co.uk
revistaindustria.com revistaindustria.com
rff-cfal.info rff-cfal.info
rfid-locker.co ritlweb.com
rialp.getenjoyment.net royal-betting.net
robotixix.com rozalli.com
rocis.site rucrypt.com
rockingclicks.com rusprostitute.com
ruclicks.com sabizonline.com
rvi.biz samolet.fr
rvtv.ru santasgift.ml
samo-soznanie.ru sbf441.com
savefrom.com sc-specialhost.com
saveriopiazza.it scanner-don.top
scalerite.co.za scanner-jane.top
scanner-john.top scanner-mark.top
schalke04fc.info scanner-viktor.top
sdrescher.net school-diplomat.ru
sdsjweb.com scottbywater.com
search.1and1.com screpy.com
searchtooknow-a.akamaihd.net scrnet.biz.ua
sell-fb-group-here.com searchinquire.com
searchkut.com
seccioncontrabajo.com
seeresultshub-a.akamaihd.net
semalt.com semalt.com
seo18.su semprofile.com
seoanalyses.com
seobility.net
seocdvig.ru seocdvig.ru
seojokes.net seojokes.net
seotoolsagency.com serviporno.com
sex.hotblog.top seryeznie-znakomstva.ru
sexgalleries.top sex-tracker.de
sexphoto.site sexad.net
sexuria.net sexfreepornoxxx.com
sexy-pings.com sexystrippe.info
shariki-zuma-lines.ru sharebutton.net
ship-marvel.co.ua sharpchallenge.com
shemalegalls.blogporn.in
shisha-swag.de shisha-swag.de
shop-electron.ru shmetall.com.ua
shopperifymac.com shodanhq.com
simon3.ru shopfishing.com.ua
simple-share-buttons.com sibdevice.ru
sinel.info sierraapps.com
sisi-go.ru
site-speed-check.site
siteexpress.co.il siteexpress.co.il
siteripz.net skladvaz.ru
sitevaluation.com slavkokacunko.de
skutecznetabletkinaporostwlosow.pl slayerlife.com
snjack.info slonechka.ru
snts.shell-pmr.ru smallseotools.com
sohoindia.net social-fun.ru
solitaire-game.ru socialsignals24.com
sonnikforme.ru soft1.ru
sortthemesitesby.com softxaker.ru
sovinsteel.ru souvenirua.com
spasswelt.xyz spabali.org
spb.ru space2019.top
spywarespy.com spb-plitka.ru
srecorder.com sport-video-obzor.ru
srgwebmail.nl starwars.wikia.com
strangeduckfilms.com stats-collector.org
stretchingabuckblog.com stevemonsen.com
strigkaomsk.ru stroy-portal22.ru
stroyplus.ru summerlinhomes411.info
superiends.org superfish.com
supernew.org supermama.top
swsociety.se supermesta.ru
symbaloo.com svbur.ru
taihouse.ru swinger-mobil.net
teletype.in tackletarts.co
the-torrent-tracker.blogspot.com td-l-market.ru
theallgirlarcade.com textads.men
thecounter.com thaisamkok.com
thegamerznetwork.com thegolfclub.info
theguardlan.com thewebsitetemplate.info
thfox.com thiegs.reco.ws
timetorelax.biz titan-cloud.life
timhost.ru tizanidine4mgstreetprice.blogspot.com
tizanidinepain.blogspot.com tizanidineandcipro.blogspot.com
tizanidinestreetprice.blogspot.com tizanidinedruginteractions.blogspot.com
tmearegion26.com tizanidinehcl4mgtab.blogspot.com
tnaionline.org tizanidinerecreationaluse.blogspot.com
torrents.life tizanidinesleepaid.blogspot.com
tour-line.net tizanidineusedfor.blogspot.com
tozup.com tizanidinevscyclobenzaprine.blogspot.com
trafficreceiver.club top-karkas.ru
traffmonster.info topanasex.com
tuckpointingmasonrysystems.com topdownloads.ru
txxx.com toproadrunner5.info
uasb.ru topsiteminecraft.com
ucoz.ru toyota.7zap.com
udayavani.com traxdom.ru
ukrtvory.in.ua truck-addzilla.life
unece.org trucri.me
unrealcommander.com trudogolik.net
tryrating.com
twitlinks.com
uchebavchehii.ru
uchil.net
ukrobstep.com
ukrtextbook.com
umnovocaminho.com
uptime-alpha.net uptime-alpha.net
us-america.ru ural-buldozer.ru
valoresito.com urengoy.pro
valueclick.com utrolive.ru
vasileostrovsky-rayon.ru vclicks.net
viagra-soft.ru veerotech.com
vellings.info
veopornogratis.xxx
videochat.life videochat.life
videositename.com videooko.weebly.com
virtualbb.com videospornogratisx.net
visa-pasport.ru visa-pasport.ru
vkak.ru volgograd.xrus.org
vkontaktemusic.ru voloo.ru
vseuznaem.com voluumtrk.com
vzlomfb.com vonradio.com
warezaccess.com vseigru.one
warningwar.ru vuclip.com
watch-movies.ru vvon.co.uk
web.cvut.cz vykup-avto-krasnodar.ru
webix.me vysigy.su
website-analytics.online w3javascript.com
website-stealer.nufaq.com wanker.us
wechatdownload10.com webmasterhome.cn
welcomeauto.ru webscouter.net
while.cheapwebsitehoster.com website-audit.com.ua
windowssearch-exp.com webtherapy.ru
woman-h.ru weburlopener.com
woman-orgasm.ru westvilletowingservices.co.za
worldmusicfests.com white-truck.life
wowcasinoonline.ooo wholinkstome.com
wttavern.com williamrobsonproperty.com
www.888.com wjgony.com
www.kabbalah-red-bracelets.com wonderfulflowers.biz
www.souvenirua.com world-mmo.com
wwwadultcheck.com writingservices17.blogspot.ru
wygraj-teraz.com wufak.com
x-lime.net www.wohnkabinen-shop.de
xdoza.com xerox-douglas.cf
xmronta.com xjlottery.com
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xmnb.net
xn--hxazdsfy.blogspot.com xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xxxasianporn.net xn--90acenikpebbdd4f6d.xn--p1ai
yaoguangdj.com xn--b1ag5cfn.xn--p1ai
yatrk.xyz xn--b1agm2d.net
yeartwit.com xn--c1acygb.xn--p1ai
yellowfootprints.com xn--lifehacer-1rb.com
yoopsie.com xn--oogle-wmc.com
youghbould.wordpress.com xxlargepop.com
youjizz.com y8games-free.com
yurgorod.ru youporn-forum.ga
zakazfutbolki.com yourdesires.ru
zapiszto.pl youresponsive.com
zarepta.com zaim-pod-zalog-krasnodar.ru
zeroredirect2.com zhorapankratov7.blogspot.com
zetmaster.ru zigarettenonl.canalblog.com
zhongwenlink.com
zigarettenonlinekaufen1.bloog.pl zigarettenonlinekaufen1.bloog.pl
zkjovpdgxivg.ga zigarettenonlinekaufen2.drupalgardens.com
zlatnajesen.com zocaparj.kz
zooggames.com
zryydi.com

492
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
007angels.com 03p.info
0daymusic.org 100searchengines.com
123kuma.com 10bet.com
12u.info 123movies.love
1xbet4you.com 2000k.ru
7wind.ru 20pascals.nl
a96527gi.beget.tech 28n2gl3wfyb0.ru
aadroid.net 2ads.co.uk
abusora.com 3th.co.in
adclickthru.net 404.mn
adtech.de 5kstore.com
adventureparkcostarica.com 76brighton.co.uk
agreda.pluto.ro 7xc4n.com
alf-img.com absolute-s.ru
alibestsale.com acmebtn.ml
allmarketsnewdayli.gdn actionnooz.com
allnews24.in advertex.info
altamayoztourism.com aero2.ru
anal-acrobats.com agysya.ru
apptester.tk albumsuper.info
arabsexxxtube.com alert-fdm.xyz
bala.getenjoyment.net algarveglobal.com
bedcapdealers.com allsilver925.co.il
best-seo-software.xyz apiitsthirteende-a.akamaihd.net
best-way.men appearance-cool.com
betterscooter.com apple.com-cleaner.systems
blogig.org appleid-verification.com
bluerobot.info ascat.porn
bumascloset.com avek.ru
buyclomidonlaine.com babs.com.ua
cah.io.community back.dog
cartierlovebraceletreplica.xyz baikaleminer.com
cdncash.net balois.worldbreak.com
cherrypointplace.ca bambi.ck.ua
circlesl.com beauby.ru
civilwartheater.com bestfortraders.com
clicksor.net bestofpicture.com
com-onlinesupport.host bestssaker.com
compliance-alexa.top bestwrinklecreamnow.com
confib.ifmo.ru bio.trade-jp.net
consorzioilmosaico.org blackhatworth.com
d0t.ru blog.f00kclan.de
ddlmega.net blog.koorg.ru
doctormakarova.ru bloggen.be
download-wallpaper.net boazpower.com
drpornogratisx.xxx brus-vsem.ru
dtnlyss.com businesxxl.com
elitesportsadvisor.com cashkitten-a.akamaihd.net
centrumcoachingu.com
cialisovercounteratwalmartusa.com
club-musics.ru
compliance-checker-7.info
conboy.us
coolwallpapers-hd.com
craftinsta.ru
decorazilla.com
delta-line.men
dev.citetick.com
diffbot.com
dinosaurus.site
dojki-hd.com
dolohen.com
doxyporno.com
duawitchrarato.tk
e90post.com
easync.io
ekn-art.se
elektrischezigarette2.onsugar.com
elektrozigarettekaufen2.blogse.nl
empathica.com empathica.com
en.home-task.com eng-lyrics.com
eorogo.top eu-cookie-law.info
european-torches.ru everypony.ru
ezigarettenkaufen1.deviantart.com extractorandburner.com
faithe.top fantasticpixcool.com
favornews.com fast-wordpress-start.com
fealq.com feorina.ru
ferrotodo.com ff30236ddef1465f88547e760973d70a.com
firstdrugmall.ru fickenprivat.info
firstsiteguide.com filesdatabase.net
fiverr.com foodcrafts.website
flagcounter.me fordsonmajbor.cf
flashbannernow.com forum-engineering.ru
forexunion.net frcls.fr
fuel-gas.com free-deals.faith
gamingspark.com freshmac.space
gateway.zscalertwo.net gabeshop.ru
gaypornmovie.net ge0ip.org
gearsadspromo.club getaclueamerica.com
generic-pills-online.com girls-ufa.ru
globalscam.ga girlsfuckdick.com
good-mummy.ru goldandcard.ru
gov.yanao.ru gonextmedia.com
greatfind-a.akamaihd.net guod.me
greenzaim.ru guruofcasino.com
groupmoney.ru haikuware.com
gwebtools.com.br hamilton.ca
hamptonoaks.ca happy.new.yeartwit.com
hazardky.net hdpixion.com
hccoder.info heatpower.ru
hentaiheroes.com hitsbox.info
hermesreplica.win hoporno.com
himazin.info howlongdoestizanidinestayinyoursystem.blogspot.com
honyaku.yahoofs.jp hoztorg-opt.ru
hostsshop.ru ido3.com
ico.re ilikevitaly.com
ifmo.ru ilte.info
images.gyffu.com imabase.com
imgarit.pw imagez.co
iplusbit.blogspot.co.za imagui.eu
islamtoday.co.za iphantom.com
istanbulit.com iplogger.org
jennyfire.ru jerseyssportsshop.com
jolic2.com joessmogtestonly.com
jrpmakati.com journeydownthescale.info
kadashihotel.com joyceblog.top
kamen-e.ru keywordhouse.com
kareliatobacco.ru khadastoafarde.tk
keywordbasket.com kletkimehan.ru
kino-rating.ru kreativperlen.ch
kinoflux.net kupiproday.com.ua
kinohit1.ru kuzinsp.ru
kinomaniatv.pl lacloop.info
kinoplen.ru ladsup.com
kinozapas.com laserpen.club
kinozapas.org law-check-seven.xyz
ku6.com legionalpha.com
kunstaktien.info lennatin.info
kwzf.net lexiangwan.com
lacave.ntic.fr lionking-1994.blogspot.com
lakomka.com.ua lockerz.com
lancheck.net lodki-pvh.dp.ua
laptoper.net lombardfinder.ru
lesbian.xyz lostfilm-online.ru
lifeinsurancekb.com lunamedia.co
lineshops.biz m5home.ru
lolnex.us macdamaged.space
manualterap.roleforum.ru mafa-free.com
manve.info makis.nu
manyresultshub-a.akamaihd.net marcowebonyodziezowe.pl
maranbrinfo.com.br menetie.ru
marktforschung-stuttgart.com metalonly.info
marwer.info mexicotravelnet.com
mearns-tractors.co.uk
mediaoffers.click
meteocast.net
michellblog.online
mindbox.co.za mindbox.co.za
minecraft-neo.ru mnimmigrantrights.net
mirzonru.net monetizationking.net
misandesign.se
mistr-x.org
mitrasound.ru
mmstat.com
monetizer.com-01.site
moonci.ru moonci.ru
mossmesi.com mp3s.club
movpod.in mrwhite.biz
mrinsidesales.com music7s.me
muz-tracker.net mygameplus.com
mylovelibrabry.com narkologiya-orel.ru
naperehresti.info nash-krym.info
new7ob.com novosti-hi-tech.ru
nofreezingmac.work nsatc.net
notaria-desalas.com nuit-artisanale.com
nzfilecloud.weebly.com ofanda.com
obiavo.su onlinebay.ru
onblastblog.online onlinetvseries.me
onlineserialy.ru openmediasoft.com
onlyforemont.ru openmultipleurl.com
optom-deshevo.ru optikremont.ru
ourtherapy.ru ossmalta.com
oxotl.com owathemes.com
paceform.com panchro.co.uk
paphoselectricianandplumber.com partnerads.men
pensplan4u.com pastaleads.com
pestomou.info patterntrader-en.com
pewit.pw pertlocogasilk.tk
phuketscreen.com phrcialiled.com
pl.aasoldes.fr piratecams.com
pl.id-forex.com poffet.net
platesauto.com popmarker.com
pochtovyi-index.ru porno-transsexuals.ru
popugaychiki.com pornoelita.info
pornogig.com powenlite24.ru
pourvous.info q-moto.ru
printingpeach.com rainbowice.ru
privatefx.all4invest.info rarbg.to
prize44.com realitykings.com
pussyfleet.com rednise.com
rangjued.com refads.pro
rankings-analytics.com saitevpatorii.com
recipedays.ru sankt-peterburg.nodup.ru
refudiatethissarah.info sape.top
registrationdomainsite.com scanner-nelson.top
relatodelpresente.com.ar searchaddis.com
rewardit.com searchengineranker.email
risparmiocasa.bz.it seasonvar.ru
rniaeba.ga segol.tv
rossmark.ru seoanalyses.com
ruclicks.com seobility.net
sack.net seoprofiler.com
sashagreyblog.ga seryeznie-znakomstva.ru
scanner-margo.top sex-sex-sex5.com
search.xtconnect.com sexkontakteao.info
searchtooknow-a.akamaihd.net sexpornotales.com
seoboxes.com sexreliz.com
sexad.net sharebutton.net
shakhtar-doneck.ru shoppingmiracles.co.uk
sierraapps.com skutecznetabletkinaporostwlosow.pl
sildenafilcitratemed.com slavkokacunko.de
skachat-besplatno-obrazcy.ru social-search.me
slayerlife.com socialmadesimple.com
small-game.com spammen.de
social-buttons.com studiokamyk.com.pl
socialbookmarksubmission.org suhanpacktech.com
sophang8.com sunflowerdrawingpaintings.blogspot.com
stairliftstrue.com supermama.top
stjamesschool.info superstats.com
subj.ukr-lit.com svetlotorg.ru
sudexpert66.ru svnuppsalaorebro.se
sugvant.ru svtrd.com
swimpool.ca
swinon.site swinon.site
symphonyintegratedhealthcare.com taboola.com
tasteidea.com telsis.com
teencastingporn.com timdreby.com
teletype.in titangel-vietnam.com
thaismartloan.com tizanidine4mgprice.blogspot.com
the-usa-games.blogspot.com tizanidineduringpregnancy.blogspot.com
theporndude.com top-study.work
timecrimea.ru track-rankings.online
tizanidineoral.blogspot.com tracksz.co
tomatis.gospartner.com ttsq.fr
torrent-to-magnet.com ucoz.ru
trafficfactory.biz uhdtv.website
trustedhealthtips.com ultimatesetnewfreeallsoftupgradesystems.pw
tvnewsclips.info unmaroll.ya.ru
ukr-lit.com varikozdok.ru
umekana.ru venta-prom.ru
uptime-gamma.net vizitki.net
urlopener.com vrotike.ru
usadacha.net vzube.com
velobikestock.com watch-movies.ru
via-energy-cumpara.com webcamtalk.net
video-hollywood.ru wholesalejerseychinaoutlet.com
videtubs.pl wholesalejerseyscheapjerseys.us.com
vpnmouse.com windowssearch-exp.com
w3data.co wineitudes.wordpress.com
wapsite.me withstandingheartwarming.com
warezkeeper.com ww1943.ru
waterefficiency.co xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
webenlace.com.ar xn--80ab4aa2g.xn--p1ai
webpromotion.ae yhit.press
wesharepics.com yoluxuryevents.com
whereiskentoday.com youradexchange.com
wholesalenfljerseys.us.com yuarra.pluto.ro
win-spy.com zeg-distribution.com
womensterritory.ru zog.link
wtsindia.in zscaler.net
www.pinnacle-bets.com
wzgyyq.com
x5market.ru
xkaz.org
xmnb.net
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xn--hxazdsfy.blogspot.com
yadro.ru
zeroredirect.com
zeroredirect11.com
zeroredirect12.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.205 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.01.2883 ### Version: V4.2022.01.2884
### Updated: Fri Jan 28 10:03:31 UTC 2022 ### Updated: Fri Jan 28 22:01:46 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.01.2883 ### Version: V4.2022.01.2884
### Updated: Fri Jan 28 10:03:31 UTC 2022 ### Updated: Fri Jan 28 22:01:46 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##