vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 02:59:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.05.3104 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-05-14 10:09:13 +00:00
parent a02507004d
commit 567dfdabb0
47 changed files with 100474 additions and 100484 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3103 #### Version: V4.2022.05.3104
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3103 #### Version: V4.2022.05.3104
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.05.3103 #### Version: V4.2022.05.3104
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12422
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.05.3103 #### Version: V4.2022.05.3104
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12426
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12426
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12426
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12426
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.244 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.244 0;
127.0.0.1 0; 127.0.0.1 0;

12426
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.244 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.244 0;
127.0.0.1 0; 127.0.0.1 0;

12426
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.244 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.244 0;
127.0.0.1 0; 127.0.0.1 0;

12426
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3103 3104

12426
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12426
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.124.141 0; 20.65.37.194 0;

12426
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.244 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.244 0;
127.0.0.1 0; 127.0.0.1 0;

12426
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.244 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.244 0;
127.0.0.1 0; 127.0.0.1 0;

12426
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.244 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.244 0;
127.0.0.1 0; 127.0.0.1 0;

12426
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.124.141 0; 20.65.37.194 0;

12426
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.124.141 0; 20.65.37.194 0;

12426
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.244 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Chlooe Atomseobot
CrunchBot Citoid
DIIbot Dirbuster
Dotbot Libwhisker
EroCrawler OutfoxBot
Majestic-SEO PHPCrawl
ScoutJet SBIder
WebsiteQuester Typhoeus
plumanalytics WebmasterWorldForumBot
seocompany.store sp_auditbot

318
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
360Spider
AIBOT AIBOT
Aboundexbot ASPSeek
Aipbot Acunetix
Alexibot Alexibot
AllSubmitter
Alligator
AlphaBot AlphaBot
Anthill
Aspiegel Aspiegel
Asterias AwarioSmartBot
Atomseobot BDCbot
BBBike
BDFetch BDFetch
BLEXBot
BackDoorBot BackDoorBot
BackStreet BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
Bandit BacklinkCrawler
BatchFTP BatchFTP
BetaBot
Bigfoot
BlackWidow
Blackboard Blackboard
Boardreader Blow
BotALot BotALot
Brandprotect
Buck
Buddy Buddy
BuiltBotTough BuiltBotTough
BuiltWith BuiltWith
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
CATExplorador
CODE87 CODE87
CazoodleBot CSHttp
Calculon
CensysInspect
CheTeam
CheeseBot CheeseBot
Chlooe ChinaClaw
Citoid
Claritybot Claritybot
Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot CopyRightCheck
Cosmos Crawling at Home Project
CrazyWebCrawler CrunchBot
Curious CyotekWebCopy
Custo DBLBot
DSearch
DTS Agent
DataCha0s DataCha0s
Deusu Devil
Disco Digincore
Discobot DigitalPebble
Discoverybot
Dispatch Dispatch
DittoSpyder DomainAppender
DnyzBot DomainCrawler
DomainSigmaCrawler DomainStatsBot
Domains Project
ECCP/1.0 ECCP/1.0
EMail Wolf EasyDL
Ebingbong Ecxi
Evil EroCrawler
Exabot
ExtractorPro
Ezooms Ezooms
FlashGet Fimap
Foobot
FyberSpider
GalaxyBot
Genieo
GermCrawler GermCrawler
Gigabot GetRight
Go!Zilla Getintent
Go-Ahead-Got-It GoZilla
GrapeshotCrawler GrapeFX
HEADMasterSEO
HMView
HTMLparser HTMLparser
HaosouSpider HTTP::Lite
Harvest
Heritrix Heritrix
HonoluluBot
HybridBot HybridBot
Iblog Iblog
Id-search Id-search
IlseBot Image Sucker
Image Fetch IndeedBot
Internet Ninja InfoNaviRobot
JOC Web Spider InfoTekies
JamesBOT Intelliseek
InterGET
JennyBot
JetCar JetCar
JikeSpider Joomla
Jorgee Jorgee
Keybot Translation-Search-Machine JustView
Keyword Density Keyword Density
Kinza
Kozmosbot Kozmosbot
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
Larbin
Leap Leap
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan LinkScan
LinkWalker
Linkbot Linkbot
LinkextractorPro
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider Lmspider
MFC_Tear_Sample MJ12bot
MSFrontPage MSFrontPage
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO
Majestic12 Majestic12
MarkWatch MarkWatch
Mass Downloader
Masscan Masscan
Mata Hari
Mb2345Browser Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot Mediatoolkitbot
MegaIndex.ru
Metauri Metauri
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Mojolicious Minefield
Moblie Safari
Mojeek
MolokaiBot
Musobot
NICErsPRO NICErsPRO
Needle Navroad
Nessus
Net Vampire Net Vampire
NetAnts
NetLyzer NetLyzer
NetMechanic NetMechanic
Nmap NetSpider
Not Netcraft
Nuclei Netvibes
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Ninja
Nutch Nutch
Octopus
OpenLinkProfiler
OpenVAS
OrangeBot OrangeBot
OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot
PHPCrawl PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
PeoplePal PageThing.com
Picsearch Pandalytics
Panscient
Papa Foto
Petalbot
Pi-Monster
PictureFinder
Piepmatz Piepmatz
Pimonster
Pixray Pixray
Pu_iN ProPowerBot
Probethenet
Psbot
Pump Pump
PxBroker
PyCurl PyCurl
RankingBot RSSingBot
RankActive
RankFlex
RankurBot RankurBot
RealDownload RedesScrapy
Rogerbot Ripper
SEOstats SBIder
SalesIntelligent SEOkicks
Scanbot SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SMTBot
ScoutJet ScoutJet
Searchestate Screaming
SeoSiteCheckup ScrepyBot
Site Sucker SearchmetricsBot
SiteExplorer SemanticJuice
SiteSucker SeobilityBot
Siphon
SiteLockSpider
Sitebeam
Siteimprove Siteimprove
Snake SmartDownload
Snoopy Snapbot
SocialRankIOBot
Sociscraper
Sottopop Sottopop
SpaceBison
Spammen Spammen
SpankBot
Spanner Spanner
SputnikBot Sucker
Sqlworm
Sqworm
Steeler
Sucuri
Surfbot Surfbot
Szukacz SurveyBot
Swiftbot
T0PHackTeam
T8Abot T8Abot
Teleport
TeleportPro TeleportPro
TheNomad Telesphoreo
Thumbor Telesphorep
TightTwatBot Trendictionbot
Titan
Toweyabot
True_Robot
Turingos
Turnitin Turnitin
Twice
Typhoeus Typhoeus
URLy Warning Upflow
UnisterBot
VB Project VB Project
VCI
VelenPublicWebCrawler VelenPublicWebCrawler
Virusdie VoidEYE
Voil Voil
Voltron WASALive-Bot
WPScan WBSearchBot
Wallpapers/3.0 WISENutbot
Web Collage WWW::Mechanize
WallpapersHD
Web Auto
Web Enhancer Web Enhancer
Web Fetch
Web Fuck
Web Sauger Web Sauger
Web Sucker WebAuto
WebBandit WebCopier
WebEnhancer WebFuck
WebSucker WebGo IS
WebZIP WebImageCollector
WebSauger
WebStripper
WebWhacker
Webalta Webalta
Whatweb WebsiteExtractor
Widow Whack
Wonderbot Whacker
Wprecon WinHTTrack
Xaldon_WebSpider ZmEu
Xenu ZoomBot
YoudaoBot ZumBot
Zauba adscanner
Zermelo
ZoominfoBot
ZyBorg
arquivo-web-crawler arquivo-web-crawler
arquivo.pt autoemailspider
check1.exe check1.exe
crawler4j cognitiveseo
eCatch crawler.feedback
gopher dataforseo.com
heritrix heritrix
instabid instabid
internetVista monitor internetVista monitor
isitwp.com ips-agent
linkdexbot iubenda-radar
lwp-trivial lwp-request
magpie-crawler
mediawords mediawords
muhstik-scan muhstik-scan
oBot netEstate NE Crawler
page scorer satoristudio.net
polaris version scan.lol
s1z.ru seobility
scalaj-http seostar
sogouspider serpstatbot
sp_auditbot siteripz
spyfu spyfu
tAkeOut
ubermetrics-technologies.com
webgains-bot webgains-bot
webmeup-crawler
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe
zgrab

310
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker
404enemy
ADmantX
AIBOT AIBOT
ASPSeek ASPSeek
Abonti
Aboundex
Aboundexbot Aboundexbot
AfD-Verbotsverfahren
AiHitBot AiHitBot
Aipbot Aipbot
AlphaBot AllSubmitter
Anarchie Anarchie
Anarchy99 Anarchy99
Ankit Anthill
Aspiegel Attach
Asterias AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDCbot BDCbot
BDFetch
BackDoorBot
BackStreet BackStreet
BackWeb BackWeb
Badass Badass
Barkrowler Barkrowler
BatchFTP
BetaBot
Bigfoot
Bitacle Bitacle
Black Hole Black Hole
Blackboard BlackWidow
Blow Boardreader
Brandprotect BotALot
Brandwatch Brandwatch
BuiltBotTough Buddy
BuiltWith Bullseye
CazoodleBot CCBot
CensysInspect CODE87
CherryPicker ChinaClaw
Chlooe Chlooe
Cliqzbot
Cogentbot
Collector
Copier
Craftbot Craftbot
Crescent
CrunchBot
Curious
Custo Custo
CyotekWebCopy CyotekWebCopy
DataCha0s DBLBot
Demon DatabaseDriverMysqli
Discoverybot Devil
Dispatch
DittoSpyder
DnyzBot
DomainAppender DomainAppender
DomainCrawler Domains Project
DomainSigmaCrawler Download Wonder
EMail Wolf EMail Wolf
EasyDL EirGrabber
Evil Extractor
ExtractorPro FDM
FHscan FemtosearchBot
FlashGet Firefox/7.0
Flunky Flunky
Foobot Foobot
FyberSpider
Fyrebot Fyrebot
G-i-g-a-b-o-t
GT::WWW
GermCrawler GermCrawler
Gigabot GetRight
Gotit GetWeb
Grabber Go!Zilla
Grafula GrabNet
GrapeFX
HEADMasterSEO HEADMasterSEO
HTTrack HTMLparser
Haansoft HTTP::Lite
HaosouSpider Heritrix
Havij HonoluluBot
IDBTE4M IDBTE4M
IRLbot IDBot
Id-search Id-search
Image Sucker IlseBot
Image Fetch
InfoTekies
Intelliseek Intelliseek
Internet Ninja
InternetSeer
Iria Iria
IstellaBot Iskanie
JennyBot JamesBOT
JetCar JetCar
Joomla Jetty
Jorgee
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kinza
Kozmosbot Kozmosbot
LNSpiderguy LWP::Simple
LexiBot Lanshanbot
LieBaoFast LeechFTP
LibWeb
Libwhisker
Lightspeedsystems
Likse Likse
LinkWalker
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
Ltx71 MSFrontPage
MIDown tool
MTRobot MTRobot
Magnet Mag-Net
Majestic SEO
Majestic-SEO Majestic-SEO
Majestic12 MarkMonitor
Mass Downloader Mass Downloader
Mata Hari
MauiBot MauiBot
MegaIndex.ru Mb2345Browser
Metauri Metauri
MicroMessenger MicroMessenger
Minefield Microsoft URL Control
Mister PiX
Mojeek Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
NICErsPRO
NPbot NPbot
Nessus Needle
NetLyzer Net Vampire
NetMechanic NetAnts
NetZIP NetSpider
Nettrack Nettrack
Netvibes
Nibbler Nibbler
Niki-bot Nikto
Nimbostratus Nimbostratus
Nmap Ninja
Nutch Nuclei
Octopus
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
PageGrabber PageAnalyzer
PageScorer
PageThing.com PageThing.com
Panscient
Papa Foto
PeoplePal
Petalbot Petalbot
Picsearch Pi-Monster
PictureFinder Picscout
Pimonster Piepmatz
PleaseCrawl ProPowerBot
ProWebWalker ProWebWalker
Probethenet Probethenet
PxBroker Pu_iN
PyCurl Pump
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActiveLinkBot RankActive
RankFlex RankingBot
Rankivabot RankingBot2
ReGet RankurBot
Ripper Re-re
RocketCrawler RocketCrawler
Rogerbot SEOkicks
SBIder
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOstats
SISTRIX
ScanAlert
Scanbot Scanbot
Scrapy Scrapy
ScreenerBot Screaming
SearchmetricsBot
SemrushBot
SentiBot SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteSnagger SiteLockSpider
SiteSucker
Sitebeam Sitebeam
Siteimprove Sitevigil
SmartDownload Snake
Snapbot SocialRankIOBot
Sociscraper Sosospider
SpankBot Spammen
Spinn3r Spinn3r
Sqlworm Sqlmap
Sqworm
Steeler Steeler
Stripper Stripper
SuperBot Sucker
SuperHTTP SuperHTTP
Suzuran T8Abot
Swiftbot TeleportPro
Teleport
Telesoft Telesoft
Trendiction Telesphorep
Trendictionbot Thumbor
Turingos TightTwatBot
TwengaBot Titan
Twice Toweyabot
Tracemyfile
True_Robot
Typhoeus
URLy Warning
URLy.Warning URLy.Warning
Upflow
V-BOT
Vacuum Vacuum
VelenPublicWebCrawler
VidibleScraper VidibleScraper
WBSearchBot Virusdie
WISENutbot WASALive-Bot
WWW-Collector-E WWWOFFLE
Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Auto Web Auto
Web Enhancer Web Enhancer
Web Fuck Web Fetch
Web Sucker Web Sauger
WebCollage
WebCopier
WebEnhancer WebEnhancer
WebFuck
WebLeacher WebLeacher
WebReaper WebPix
WebWhacker WebStripper
Webalta WebSucker
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteQuester WebsiteQuester
Whacker Webster
Whatweb Whack
Who.is Bot Who.is Bot
WinHTTrack Widow
WiseGuys Robot Woobot
Wonderbot Wotbox
YoudaoBot
Zade Zade
Zauba
Zeus
Zitebot Zitebot
ZmEu
ZoominfoBot
ZyBorg ZyBorg
arquivo-web-crawler adscanner
arquivo.pt archive.org_bot
autoemailspider
backlink-check backlink-check
cah.io.community
check1.exe check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j crawler4j
heritrix dataforseo.com
facebookscraper
instabid
internetVista monitor internetVista monitor
ips-agent isitwp.com
linkdexbot
lwp-request
muhstik-scan
oBot
polaris version polaris version
seobility probe-image-size
seoscanners s1z.ru
seostar seostar
serpstatbot siteripz
sexsearcher sogouspider
sp_auditbot sp_auditbot
sysscan sysscan
webpros.com trendiction.com
webprosbot trendiction.de
x09Mozilla ubermetrics-technologies.com
webgains-bot
x22Mozilla x22Mozilla
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
1millionusd.xyz allcredits.su
acads.net exonline.info
best-seo-offer.com jackwolfskinoutlet.online
cinemaenergy-hd.ru leadwayau.com
famix.xyz marcowebonyodziezowe.pl
internetartfair.com mixx.com
pornzone.tv rockingclicks.com
terraclicks.com snjack.info
vbabule.net tizanidineoral.blogspot.com
zoogdiesney.com tubeline.biz

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03e.info 0912701309f8ce.com
1008.su 101raccoon.ru
11pikachu.ru
1bet.com 1bet.com
28n2gl3wfyb0.ru 1hwy.com
5kstore.com 2nt.ru
abiente.ru 2x2fan.ru
absolute-s.ru 4inn.ru
activepr.ru 4ur.click
ads-seo.men 9med.net
aa8b68101d388c446389283820863176e7.com
aanapa.ru
aaronabel.com
activecampaign.dreamhosters.com
adanih.com
adimmix.com
adult-shop.com.ua adult-shop.com.ua
agardomains.com afftrack001.com
aihelen.net agadelha.com.br
aimayangzhi.com ahrefs.com
airlandsea.info alekseevec.ru
albamargroup.com alevinefesleri.com
ald2014.org alice.it
algarveglobal.com alkoravto.ru
alive-ua.com allesohnegirls.net
allcredits.su allstatesugarbowl.org
allsilver925.co.il alt-servis.ru
alphacarolinas.com alta-realestate.com
alphavisions.net amanda-porn.ga
aludecor.info anal-acrobats.com
alyeskaresort.com anmysite.com
amoi.tn aosheng-tech.com
anniemation.com apessay.com
apccargo.com
apiluckyleapnet-a.akamaihd.net
apiqualitinknet-a.akamaihd.net
apispringsmartne-a.akamaihd.net
apparel-offer.com apparel-offer.com
apple.com-cleaner.systems appsaurus.com
aquarium-pro.ru arenanews.com.ua
artdeko.info artdeko.info
ascat.porn aruplighting.com
asscenihotosidea.blogspot.com astrochicks.com
atmovs.com aussie-prizes.com
auto-zapchasti.org autolombard-krasnodar.ru
autoblogger24.info avkzarabotok.info
ayodhya.co awency.com
bablonow.ru azartniy-bonus.com
bad-stars.net azbaseimages.net
balans.shahterworld.org azbuka-mo.ru
bannertesting.com bagcionderlab.com
baoxaydung.com.vn bannerbank.ru
bashtime.ru beauty-bracelet.com
battlecarnival.su belinvestdom.by
becuo.com belsetirehafi.tk
best-deals-products.com bestofpicture.com
bestplacetobuyeriacta.jw.lt bestsexyblog.com
betune.onlinewebshop.net betwinservice.com
big-cash.net billiard-classic.com.ua
bird1.ru blockworld.ru
bkgr.se bloggers.nl
blackhatworth.com blogig.org
blackplanet.com board.f00d.de
blog.f00kclan.de brandbucket.com
blog.koorg.ru bugof.gq
blog.koreadaily.com bumascloset.com
blogos.kz
blogsfunky672.weebly.com
boobsimge.com
brianhenry.co
bronzeaid-a.akamaihd.net
brus-vsem.ru
buy-cheap-online.info
buyantiviralwp.com buyantiviralwp.com
c-english.ru buyhoverboard.com
callawaygolfstore.online buypillsorderonline.com
callmd5map.com buypuppies.ca
cars-modification.net californianews.cf
carsdined.org call-of-duty.info
casinos4dummies.co.uk candypeople.se
cbb1smartlist12.click capacitacionyaprendizaje.com
centrumcoachingu.com carapics.com
cezartabac.ro cardsharp1.ru
checkhit.com carfax.com.ua
chelnytruck.ru cartierlove2u.xyz
chinacheapelitejerseys.com cartujano-pre.de
chocolateslim-u-srbiji.com casablancamanor.co.za
christianlouboutinreplica.win casinorewards.info
chuckguilford.com cerev.info
cialisovercounteratwalmartusa.com cheapjerseysap.com
cleanpcnow.com cheapjerseysfootballshop.com
clksite.com cherubinimobili.it
cmhomestayagency.com chimiver.info
colobit.biz chocolateslim-en-france.com
compiko.info cicaki.net
conciergegroup.org cindymatches.com
concordexoticrentals.com clean-start.net
coolgamechannel.com cleanallspyware.com
coolyarddecorations.com click2pawn.com
countbertwistdisp26.soup.io clicksotrk.com
covid-schutzmasken.de clips.ua.ac.be
compliance-alexa.top
compliance-andrew.top
compliance-john.top
copro.pw
copyrightclaims.org
cornomase.win
costablue.xyz
cottageofgrace.com
cowblog.fr cowblog.fr
cranly.net
crd.clan.su
creativehutindia.com creativehutindia.com
creditmoney.com.ua csgo4.win
cryptoswap.biz customboxes4less.com
cs-passion.pl cv.wallhade.co
custom-product-labels.com d0t.ru
cyclobenzaprinevstizanidine.blogspot.com dame-ns.kz
dairyindia.in data-ox.com
dangphoto.trade dataloading.net
ddpills.com date-withme.com
deadlinkchecker.com datract.com
demenageur.com ddsoldes.fr
descargar-musica-gratis.net dealighted.com
digilander.libero.it dealwifi.com
dildofotzen.net depositfiles-porn.ga
dipstar.org diegolopezcastan.com
dirtpics.pw dieta-personalna.pl
dispo.de dikx.gdn
docstoc.com dinosaurus.site
documentbase.net divku.ru
dodlive.mil domination.ml
domain-tracker.com dosug-lux.ru
domainsphoto.com droidlook.net
dood.live dstroy.su
doublepimp.com e-commerce-seo.com
earthmagic.info earncash.com.ua
econom.co easyshoppermac.com
ecxtracking.com ecxtracking.com
education-cz.ru
eets.net eets.net
elektronischezigarettekaufen1.beeplog.com elektrischezi.canalblog.com
elektronischezigarettekaufen1.myblog.de elektrischezigarettekaufen2.cowblog.fr
englishgamer.com elvel.com.ua
enthuse.computernetworksonline.com enbersoft.com
escortplius.com energydiet-info.ru
esopini.com eng-lyrics.com
espaceinventoristes.com eorogo.top
everypony.ru epngo.bz
evogarage.com erotik-kostenlos.net
ewebarticle.info erotikstories.ru
extener.org estelight.ru
face.hostingx.eu europages.com.ru
fandlr.com exoclick.com
farmingworm.com extstat.com
felizporno.com ezigarettenshop2.postbit.com
fighrofacciufreesig.ga fanrto.com
filmci.pro fatmaelgarny.com
findpics.pw fearcrow.com
finuse.com fellowshipoftheminds.com
firstdrugmall.ru fertilitetsradgivningen.se
fishtauto.ru fetishinside.com
flashlarevista.com
flex4launch.ru
floridamobilebillboards.com floridamobilebillboards.com
flowwwers.com flprog.com
folowsite.com fm-upgrade.ru
food.dtu.dk formseo.com
foodgid.net forum.poker4life.ru
forex-procto.ru foto-basa.com
formulaantiuban.com fr-bearings.ru
forodvd.com fr.netlog.com
foto-telok.net
foto-weinberger.at
fotzen-ficken.com
frankofficial.ru
frbizlist.com
free-deals.faith
free-share-buttons.top free-share-buttons.top
freelifetimefuckbook.com freewhatsappload.com
front.ru freshmac.space
frvo.alptandem.ru freza-sverlo.ru
fungirlsgames.net fungamelands.com
fusoradio.info
fxund.us
gabeshop.ru gabeshop.ru
games.kolossale.ru gallerily.com
gay.adultgalls.com gallictures.com
ge0ip.net gambarxkata.co
get-free-social-traffic.com gaming-journal.com
getlamborghini.ga gdcentre.ru
getprismatic.com gdzkurokam.ru
getresponse.com genericviagrasildenafiled.net
gigixo.com gg.zzyjxs.com
girlsatgames.ru glcomputers.ru
gloverid.site goatse.ru
golaya.pw goblacked.com
gombita.info golden-catalog.pro
goodwinmetals.co goldpanningtools.com
goroda-vsego-mira.ru goroda-vsego-mira.ru
gosarhivrt.ru
gotcher.us
gotomontenegro.net gotomontenegro.net
gpirate.com greatfind-a.akamaihd.net
grizzlysgrill.com guardlink.com
gsasearchengineranker.xyz guiadeserraazul.com
gstatey.net gwagka.com
gunsvicceadadebt.tk hatedriveapart.com
haikuware.com hausfrauensex18.com
handsandlegs.ru haveinc.xyz
havepussy.com
hazardky.net
hd720kino.ru hd720kino.ru
herehloadibs.cf hexpilot.com
hobild.net histats.com
homeart.space home-task.com
homedecoguide.info homemature.net
homegardenlova.com host-tracker.com
howtowhitenteethfast.xyz hotblog.top
hscsscotland.com house.sieraddns.com
hulfingtonpost.com howtoclean.club
hunthillfarmtrust.org hut1.ru
i-hobot.ru
i-midias.net.br i-midias.net.br
ictizanidinehcl4mg.blogspot.com iframe-toloka.com
ie.57883.net igithab.com
ikritikimou.gr igru-xbox.net
igtools.club
ilmexico.com ilmexico.com
iminent.com ilo134uloh.com
inbabes.sexushost.com imgarcade.com
incolors.club imgarit.pw
infektsii.com imguramx.pw
insider.pro inclk.com
io9.com indianmedicaltourismshop.com
iopeninghours.co.uk informatiecentro.be
iphantom.com inome.com.ua
iqoption-bin.com instakink.com
isistaylorporn.info iptool.xyz
itag.pw iqoption.com
japfm.com islandminingsupply.wordpress.com
jav-fetish.site istanbulit.com
jerseychinabizwholesale.com itservicesthatworkforyou.com
jewelryandfiligree.com ivearchenceinflu.cf
justkillingti.me iwanttodeliver.com
justucalling32211123456789.tk izismile.com
kalandranis.gr jackwolfskinoutlet.online
karadene.com jerseychinabizwholesale.us
kashubadesign.ru jimmychoosale.online
katadhin.co joy-penguin.com
keenoutlet.online junketjuice.blogspot.com
ketoanhanoi.info kaac.ru
keyhantercume.com kamagragelusa.net
keywordglobal.co.za ketrzyn.pl
kinopolet.net kfon.eu
kmgamex.cf kino-key.info
kopihijau.info kinogolos.ru
kosmetyki.tm.pl kinohall.ru
kosova.de klumba55.ru
kotaku.com kometars.xyz
krafte.ru konturkrasoty.ru
krasivoe-hd.net koopilka.com
krasnodar.ru koronirealestate.gr
kretpicf.pw kosynka-games.ru
lifehacĸer.com kozhniebolezni.com
lightinghomes.net kumuk.info
linkarena.com kurbappeal.info
linkredirect.biz kurwa.win
lion.playtap.us kvartir-remont.biz
listiseltemournlan.gq ladov.ru
livesex-amateure.info larchik.net
lovelycraftyhome.com law-check-two.xyz
lubetube.com le-clos-des-alouettes.com
mac-shield.com leadn.pl
maranbrinfo.com.br lenvred.org
matchpal-a.akamaihd.net lescinq.com
matematikus.info lexaprogeneric.link
maximpartnerspr.com link.ac
mazda-roadsters.com linkpulse.com
mearns-tractors.co.uk liumimgx.pw
mebel-alait.ru liupis.com
mebel-ekb.com loadopia.com
localflirtbuddies.com
locationdesaison.com
lomza.info
lonely-mature.com
lost-alpha.ru
lowephotos.info
luckyday.world
lumb.co
m292.info
maglid.ru
mantramusic.ru
manve.info
manyresultshub-a.akamaihd.net
marktforschung-stuttgart.com
martlinker.com
master-muznachas.ru
maxthon.com
mb140.ru
mbiologi.ru
mebeldekor.com.ua mebeldekor.com.ua
medicine-4u.org mediaoffers.click
medkritika.ru meds-online24.com
mesbuta.info member-quiz.com
mex-annushka.ru missvietnam.org
minecraft-neo.ru mmofreegames.online
minegam.com mojpregled.com
mlvc4zzw.space
mmog-play.ru
mobile.ok.ru
mole.pluto.ro mole.pluto.ro
money-every-day.com monclervests.xyz
monsterdivx.tv moneymaster.ru
moscow-clining.ru moneytop.ru
mostantikor.ru mostantikor.ru
movpod.in musezone.su
mozello.ru myfreemp3.eu
mrbojikobi4.biz
mrsdalloways.com
mrwhite.biz
msk.afora.ru
mural.co
music.utrolive.ru
my-aladin.com
myfreecams.com
myghillie.info myghillie.info
mylesosibirsk.ru
mystats.xyz
mywallpaper.top
myxdate.info myxdate.info
na15.ru najaden.no
nagdak.ru nastroyke.net
narutonaruto.ru
nastydollars.com
natali-forex.com
nationalbreakdown.com
negral.pluto.ro
nelc.edu.eg nelc.edu.eg
new7ob.com new-apps.ru
news-readers.ru nfljerseys.online
nlfjjunb5.ru njkmznnb.ru
nootrino.com no-fuel.org
nordstar.pro nordvpn.com
northfacestore.online notaria-desalas.com
noscrapleftbehind.co nowtorrents.com
notasprensa.info
nudejapan.net nudejapan.net
o333o.com nudo.ca
oballergiya.ru nvformula.ru
obiavo.by
obiavo.com
oconto.ru
oecnhs.info
offer.camp
offers.bycontext.com
officedocuments.net
ohmyrings.com
okeinfo.online
oklogistic.ru
okout.ru okout.ru
olympescort.com old-rock.com
onclkads.com online-x.ru
online-templatestore.com onlyforemont.ru
onstrapon.purplesphere.in onlyporno.ru
orel-reshka.net openmediasoft.com
otbelivanie-zubov.com optibuymac.com
ourville.info
outshop.ru outshop.ru
oz-offers.com oyster-green.com
partner-high.men paccohichetoti.ml
pharmacyincity.com pandroid.co
photochki.com parajumpersstore.online
pic-re.blogspot.com partner-trustworthy.men
picsfair.com php-market.ru
picture-group.com picscout.com
pinstake.com pijoto.net
pinup-casino1.ru pipki.r.acdnpro.com
pirateday.ru pizda.lol
piter.xrus.org play-movie.pl
pogosh.com pochemychka.net
pomoc-drogowa.cba.pl popander.mobi
pornohd1080.online popcash.net
pornoinn.com popup-fdm.xyz
portadd.men porno-dojki.net
portside.xyz pornoblood.com
pretty-mart.com pornofiljmi.com
privatbank46.ru portal-eu.ru
pro-tec.kz positive2b.ru
pssucai.info potoideas.us
psvita.ru powenlite24.ru
pukaporn.com powitania.pl
purchasepillsnorx.com pr-ten.de
purplestats.com prchecker.info
puserving.com priceg.com
raavidesigns.com printdirectforless.com
randki-sex.com printingpeach.com
ranksonic.com profolan.pl
ratemodels.net prostitutki-rostova.org
rebuildermedical.com push-ad.com
rednise.com pyrodesigns.com.au
registry-clean-up.net q-moto.ru
remont-komputerov-notebook.ru quickchange.cc
remybutler.fr quit-smoking.ga
rent2spb.ru qwesa.ru
replicaclub.ru rasteniya-vs-zombi.ru
resellerclub.com rcpmda.ikan1080.xyz
retreatia.com redirectingat.com
rfserial.net rennlist.com
ric.info rentehno.ru
richinvestmonitor.com rogervivierforsale.com
ring4rhino.com rossmark.ru
rn-to-bsn.com runtnc.net
roma-kukareku.livejournal.com ruscoininvest.company
rostov.xrus.org rusexy.xyz
royalads.net rvi.biz
rusoft-zone.ru s1z.ru
russintv.fr saitevpatorii.com
sabaapress.com sayyoethe.blogspot.co.za
saltspray.ru sbprabooks.com
samara.rosfirm.ru sc-specialhost.com
samoiedo.it scansafe.net
sanyuprojects.com semxiu.com
scanner-josh.top sexs-foto.com
scanner-julia.top shakhtar-doneck.ru
scrapinghub.com shopcheermakeup.info
scripted.com shopfishing.com.ua
search-error.com shopsellcardsdumps.com
seemoreresultshu-a.akamaihd.net siha.de
seinterface.com skanninge.se
semprofile.com sklad-24.ru
seo-prof1.xyz skypasss.com
seoanalyses.com sloopyjoes.com
seoholding.com sneakyboy.com
seorankinglinks.xyz snowplanes.com
serving.adbetclickin.pink soochi.co
sexpartygirls.net sotkal.lark.ru
sexvideo-sex.com spywarenuker.com
sharebutton.net
shymkent.xkaz.org
sicfor.bcu.cc
simplesite.com
skutecznetabletkinaporostwlosow.pl
skytraf.xyz
slimcdn.com
smart-balancewheel.com
smartpet.ru
smsactivator.ru
snts.shell-pmr.ru
social-buttons.xyz
socialmadesimple.com
soft1.ru
softlinesolutions.me
soietvousmaime.fr
solicita.info
sortthemesitesby.com
spylog.com
spywarespy.com spywarespy.com
srgwebmail.nl staff.prairiesouth.ca
stairliftstrue.com statoutlook.info
stpicks.com sticken.co
styro.ru stickers-market.ru
sucsesofinspiration.com stockspmb.info
svetodiodoff.ru storehouse.ua
svnuppsalaorebro.se stroiminsk.org
szucs.ru strongholdsb.ru
tabakur77.com success-seo.com
tattomedia.com summerlinhomes411.info
tattooreligion.ru sunflowerdrawingpaintings.blogspot.com
superkanpo.com
supervesti.ru
support.nopeas.sk
surflinksmedical.com
susanholtphotography.com
svetlotorg.ru
taihouse.ru
tds-advert002.info
telefonsexsofort.tk telefonsexsofort.tk
theallgirlarcade.com templates.franklinfire.co
thecoral.com.br templates.radiodigital.co
thewebsitetemplate.info thedownloadfromwarez.blogspot.com
timdreby.com thefds.net
tizanidine4mguses.blogspot.com thegameriders.com
tizanidineandhydrocodone.blogspot.com thenews-today.info
tizanidinepain.blogspot.com thexart.club
topquality.cf threecolumnblogger.com
topsiteminecraft.com tivolibasket.it
torrents.cd tizanidinedrugtest.blogspot.com
toxicwap.com tizanidineonline.blogspot.com
track2.shop tizanidinepills.blogspot.com
trackzapper.com torrents-tracker.com
tradedeals.biz touchmods.fr
traderzplanet.in track-rankings.online
traffic-club.info treasuretrack-a.akamaihd.net
traffic100.com tri-slona.org
trafficcentr.xyz triplepanda.xyz
trafficfactory.biz trkdf.com
traffpartners.com ttrraacckkrr.com
trion.od.ua ttsq.fr
trucri.me tube8.com
try-rx.com tuckermktg.com
tupper-shop.ru
turist-strani.ru
tv-spoty.info
twittrading.com
uchetunet.su
udsgame.online udsgame.online
ural-buldozer.ru umityangin.net
urlopener.blogspot.com.au ussearche.cf
uroki.net uzungil.com
usadacha.net v-doc.co
vancleefreplica.pw v24s.net
vchulkah.net vabasa.inwtrade.com
vedomstvo.net vapomnoncri.tk
velobikestock.com
velpanex.ru
vgoloveboli.net
via-energy-order.com via-energy-order.com
videonsk.com via-gra.webstarts.com
videos-for-your-business.com video-camer.com
videtubs.pl videotuber.ru
villacoloniale.com viel.su
vinsit.ru villakohlanta.nu
viveresaniesnelli.it vinylvault.co.uk
vkontaktemusic.ru virtuagirl.com
vykupavto-krasnodar.ru vk-mus.ru
vkonche.com
vodaodessa.com
voloo.ru
voluumtracker1.com
voprosotvet24.ru
vvpg.ru
vzlomtw.com
wardreapptokone.tk wardreapptokone.tk
web.cvut.cz webadvance.club
weburlopener.com webcamdevochka.com
wedding0venues.tk wholesalejerseychinashop.com
whipme.yopoint.in womens-journal.net
whosonmyserver.com www.ehscloud.cn
wnoz.de wzgyyq.com
woodyguthrie.se xep.info
word-vorlagen.xyz xmronta.com
world-mmo.com xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
wormix-cheats.ru xn----9sbubg3ambdfl1j.xn--p1ai
wovis.site xn----dtbndd4ae7eub.top
wrz0iuebwhp5fg.freeddns.com xn----itbeirbjbi7bc6bh2d.xn--p1ai
ww2awards.info
wyniki-lista.pl
x-diesel.info
x-diesel.org
x-mix.info
xaylapdiendanang.com
xblognetwork.com
xgftnlrt.bloger.index.hr
xlolitka.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--80abgj3a5acid6ghs.top xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn--b1addnj3cah.xn--p1ai xtube.com
xnxx-n.com xxxrus.org
xportvusbdriver8i.snack.ws y8games-free.com
xxxdatinglocal.us
xz618.com
yaderenergy.ru
yellocloud.be yellocloud.be
youjizz.com
your-bearings.com
yourdesires.ru
yourmovies.pl
yourserverisdown.com yourserverisdown.com
yousense.info yoursite.com
zarabiaj-dzis.pl yunque.pluto.ro
zeroredirect10.com zambini.ru
zhacker.net zhongwenlink.com
zkjovpdgxivg.ga zkjovpdgxivg.ga
zootravel.com
zs2vm.top

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
123movies.love 0lovespells0.blogspot.com
1flag.co.za 2pxg8bcf.top
20pascals.nl 4kpics.rocks
256bit.by 5u.com
8jn.dating-app.ru aac500b7a15b2646968f6bd8c6305869d7.com
8xv8.com abclauncher.com
abctoppictures.net admanaerofoil.com
abiente.ru adult3dgames.com
absolute-s.ru adultactioncam.com
adultnet.in
aerogo.com
all-streaming-media.com all-streaming-media.com
allnews24.in allornamenti.com
allpdfmags.net alpinism.ru
alphaforum.ru android-systems.ru
alpharma.net angel1777.kz
anabolics.shop antons-transporte.de
animal-drawings.com apptester.tk
apple.com-webbrowsing-security.science apxeo.info
appleid-verification.com artparquet.ru
arcteryxsale.online asrvvv-a.akamaihd.net
arenda-avtoprokat-krasnodar.ru astrochicks.com
artefakct.com bankofthewext.com
arvut.org bezlimitko.xyz
asrvrep-a.akamaihd.net bg6s0.com
asscenihotosidea.blogspot.com big-boards.info
azartclub.org bildsuche.ru
balkanfarma.org bingoporno.com
bannerconnect.net biteg.xyz
bestkfiledxd.cf bjetjt.com
bestmouthwash.club blog.koorg.ru
bestofpicture.com bloggers.nl
binomo.kz bobba.dzaba.com
birzha-truda.eu boleznikogi.com
bitcoin-ua.top bongiornos.info
blobar.org bosefux.esy.es
bmsco.co brendbutik.ru
braindaily.xyz buyclomidonlaine.com
braip.com.br buyviagraa.blogspot.com
buy-meds24.com cacheimages.com
buzzurl.jp capture-room.com
chatroulette.online carabela.com.do
cheapcigarettesc.info censys.io
cheapjerseysbizwholesale.us children-learningreading.info
ci.ua christianlouboutinshoes.xyz
ciceros.co cialiswithoutadoctor.net
civilwartheater.com compliance-john.top
clickbank.net consorzioilmosaico.org
clknsee.com covetnica.com
compliance-don.top creatives.adbetclickin.pink
confib.ifmo.ru customerpromos-a.akamaihd.net
courtshipgift.com dafatiri.com
crafthubs.com dating-app.ru
cyclobenzaprinevstizanidine.blogspot.com davidovic.info
danashop.ru daydream-studio.ru
deniven.1bb.ru dev33.dioniqlabb.se
dimfour.com diminishedvalueoforegon.com
discountliv.com domainsatcost.com
downloaddy.net dynainbox.com
downloadeer.net e-avon.ru
earn-from-articles.com e-commerce-seo.com
enskedesquashclub.se easyukraine.com
exoclick.com energydiet-info.ru
expertnaya-ocenka.ru eshop.md
fenoyl.batcave.net essay-edu.biz
fillmewithhappiness.com essay-writing.work
floridamobilebillboards.com estelight.ru
foodcrafts.website estibot.com
footballfarrago.com europages.com.ru
forum.poker4life.ru euroskat.ru
freelotto.com evaashop.ru
freenode.info ezaz.info
friendflnder.com famix.xyz
fapgon.com
fickkontakte.org
fidelityfunding.com
fil.ru
filmania-x.ru
filmi-onlain.info
finteks.ru
fishtauto.ru
fitnesspiks.com
forex-indextop20.ru
fortevidyoze.net
foxweber.com
freemags.cc
fsalas.com fsalas.com
fun2cell.net gardene.ru
fx-brokers-review.com googleseo.com.tr
fyxabomiw.ru greatzip.com
galaxy-family.ru helpmymacfaster.trade
gallerylisting.com hmmm.cz
gemgrab-a.akamaihd.net holidaypics.org
getpopunder.com homemade.gq
girlspicsa.com hully.altervista.org
gktt.ru iframe-toloka.com
goodwinmetals.co ikearugs.xyz
gtopstats.com imabase.com
hamacapty.com imk.com.ua
hatdc.org infektsii.com
hitmuzik.ru informatiecentro.be
hostcritique.com internetproviderstucson.com
hut1.ru iyasimasennka.com
hyipmanager.in jackwolfskinoutlet.online
ilmen.net jagg.info
images-graphics-pics.com
immobiliaremassaro.com
iplogger.org
itronics.ca
iweblist.info
janavibekken.no
jasonpartington.com
javlibrary.cc javlibrary.cc
joyceblog.top jo24news.com
kaidalibor.de jurajskie.info
kandidos.com katushka.net
keywordsking.com keywordsuggests.com
kinostorm.net kol-energo.ru
klosetkitten.com kumuk.info
lacloop.info letolove.ru
laexotic.com littlesexdolls.com
lapolis.it livesex-amateure.info
letmacworkfaster.site locationdesaison.com
lexixxx.com lockerz.com
lonely-mature.com louboutinbooties.xyz
long-beach-air-conditioning.com lrac.info
lovelycraftyhome.com macrotek.ru
m292.info magicdiet.gq
magento-crew.net map028.com
matb3aa.com marmotstore.online
maxxtor.eu mature.free-websites.com
mebelcomplekt.ru meddesk.ru
med-zdorovie.com.ua meetlocalchicks.com
mediawhirl.net menstennisforums.com
megagrabber.ru mesto-x.com
mex-annushka.ru minecraft-rus.org
michaelkorsoutletstore.net minet.club
mindeyegames.com mistr-x.org
mirzonru.net modenamebel.ru
missclub.info mompussy.net
missvietnam.org morocco-nomad-excursions.com
monarchfind-a.akamaihd.net most-kerch.org
moncleroutletonline.win moyakuhnia.ru
moneyviking-a.akamaihd.net musezone.ru
mygameplus.ru myfreetutorials.com
napalm51.nut.cc na15.ru
nakozhe.com
national-today-winning-winner.club national-today-winning-winner.club
netanalytics.xyz nevansk.ru
nfljerseyscheapchinabiz.com nfljerseysforsalewholesaler.com
nordvpn.com nightvision746.weebly.com
offergroup.info nofreezingmac.click
offf.info novatech.vn
offtime.ru o-o-6-o-o.ru
okayimage.com obiavo.by
onescreen.cc oecnhs.info
openlibrary.org offer.wpsecurity.website
paleohub.info officedocuments.net
perl.dp.ua oklogistic.ru
petrovka-online.com okroshki.ru
picscout.com oksrv.com
picturesify.com oktube.ru
onclkads.com
online-hit.info
optom-deshevo.ru
painting-planet.com
papasdelivery.ru
partnerads.men
pensplan.com
piccdata.com
picswe.com
pintattoos.com
piulatte.cz piulatte.cz
pixell.club
pizza-tycoon.com
pladform.ru pladform.ru
pokemon-go-play.online popugauka.ru
popcash.net poquoson.org
poppen-nw.net pornofiljmi.com
pornmania.pl pornokajf.com
pornstartits.xblog.in pornowarp.info
positive2b.ru pornzone.tv
potoideas.us pozdravleniya-c.ru
priceg.com produkto.net
pro-poly.ru promodj.com
progonrumarket.ru prostitutki-tolyatti.org
psoriasis-file.trade qpypcx.com
pssucai.info quick-seeker.com
py100.ru rankingchart.de
qor360.com replicaclub.ru
qualitymarketzone.com ribieiendom.no
ragecash.com rixpix.ru
razyboard.com rossmark.ru
repeatlogo.co.uk rostov.xrus.org
rimedia.org rusenvironmental.net
rocketchange.ru rusprostitute.com
rogervivierforsale.com ryetaw.com
rp9.ru samolet.fr
runofilms.ru santasgift.ml
rusexy.xyz secret.xn--oogle-wmc.com
sbprabooks.com seksotur.ru
scanner-alexa.top seo18.su
scanner-andrew.top sibtest.ru
scanner-jess.top skytraf.xyz
sex-sex-sex5.com smadihome.com
shopcheermakeup.info smart-balancewheel.com
shoplvlv.us soft-program.com
snegozaderzhatel.ru soochi.co
snomer1.ru spasswelt.net
social-buttons.com speechfoodie.com
solnplast.ru speeddream.xyz
sotechco.co spinnerco.ca
sotkal.lark.ru starwars.wikia.com
sovinsteel.ru suhanpacktech.com
spb-plitka.ru sunflowerdrawingpaintings.blogspot.com
spylog.com survival.betteroffers.review
spymac.net svensk-poesi.com
starpages.net swagbucks.com
stefanbakosab.se swingerseiten.com
stroiminsk.org syvertsen-da.no
stroymonolit.su techart24.com
sureone.pro tehngr.ru
surintech.ac.th titan-cloud.life
sygraem.com tizanidineformigraines.blogspot.com
szucs.ru tizanidinepills.blogspot.com
tackletarts.co tmtrck.com
telegramdownload10.com topads.men
thebitcoincode.com totu.us
tizanidine4mgstreetprice.blogspot.com tracxn.com
tizanidinecapsules.blogspot.com traffic2cash.org
tizanidineinteractions.blogspot.com tupper-posuda.ru
toyota.7zap.com
trafficmp.com
truck-land.life
tsan.net
typimga.pw
uchil.net
ucoz.ru ucoz.ru
uhodzalijami.ru ustion.ru
ukkelberg.no uvozdeckych.info
unece.org v720hd.ru
univerfiles.com vacances-voyages.info
urlcut.ru valueclick.com
usbggettwku.ga via-energy-acquistare.com
utrolive.ru viagra.pp.ua
vacuumcleanerguru.com videotuber.ru
ventelnos.com vzubah.com
voronezh.xrus.org wcb.su
vriel.batcave.net webradiology.ru
vucms.com webscouter.net
webkeyit.com whengirlsgowild.com
webnode.me whiteelephantwellington.com
wesharepics.com wrona.it
whatsappdownload10.com www.ehscloud.cn
whatzmyip.net wwwadultcheck.com
winner7777.net x-rates.ru
worldoffiles.ru xedserver.com
woweb.com.ua xn----itbeirbjbi7bc6bh2d.xn--p1ai
wtsindia.in xn--lifehacer-1rb.com
x-mix.info xnxxandxvideos.com
xboxster.ru xtrafficplus.com
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai yadro.ru
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai zagadki.in.ua
xxlargepop.com zeleznobeton.ru
xxxnatelefon.ru zoomovies.org
yellowproxy.net zs2vm.top
youghbould.wordpress.com zynax.ua
yoursearch.me
ypmuseum.ru
za-music.mymobiplanet.com
zahvat.ru
zeroredirect.com
znakomstva-moskva77.ru
zytpirwai.net

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.244 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3103 ### Version: V4.2022.05.3104
### Updated: Fri May 13 22:01:27 UTC 2022 ### Updated: Sat May 14 10:03:20 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3103 ### Version: V4.2022.05.3104
### Updated: Fri May 13 22:01:27 UTC 2022 ### Updated: Sat May 14 10:03:20 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##