V4.2022.06.3160 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-01h4x.com
 360Spider
-AIBOT
-ALittle Client
+ADmantX
+ASPSeek
 Abonti
+Aboundexbot
 AfD-Verbotsverfahren
+AhrefsBot
+Aipbot
 AllSubmitter
+Anarchy
 Anarchy99
-Asterias
-Attach
+Ankit
+Anthill
+Atomseobot
 AwarioRssBot
+BDCbot
 BLEXBot
-BackDoorBot
 BackStreet
 BackWeb
 Backlink-Ceck
-Barkrowler
+Bandit
+BetaBot
 Bigfoot
-BlackWidow
+Blackboard
+Blow
+BlowFish
+Boardreader
 BotALot
+Brandprotect
+Buddy
 BuiltBotTough
+BuiltWith
+Bullseye
 BuzzSumo
-CSHttp
-Calculon
-CheeseBot
-Cocolyzebot
+Cegbfeieh
+CensysInspect
+CheTeam
+Claritybot
+Cliqzbot
+Cogentbot
+Copyscape
 Craftbot
-Crawling at Home Project
-CrazyWebCrawler
 Crescent
 Custo
-DBLBot
+CyotekWebCopy
 DIIbot
-DataCha0s
-Demon
-Deusu
 Devil
-Digincore
-DigitalPebble
-Dirbuster
-Discobot
-Discoverybot
-DittoSpyder
-DnBCrawler-Analytics
-DnyzBot
-DomainAppender
-DomainSigmaCrawler
-Domains Project
+Disco
+Dispatch
+DomainStatsBot
 Dotbot
-EMail Wolf
+ECCP/1.0
+EMail Siphon
 EasyDL
+Ecxi
+EirGrabber
 EroCrawler
-Exabot
+ExtLinksBot
 Extreme Picture Finder
-Ezooms
-FemtosearchBot
 Firefox/7.0
-Flunky
-Foobot
-Freeuploader
-Fuzz
-Fyrebot
 G-i-g-a-b-o-t
+GT::WWW
+GalaxyBot
+Genieo
 GermCrawler
-Getintent
-Gigabot
+GetRight
+GetWeb
 GoZilla
-Grabber
-GrapeFX
+GrabNet
+Grafula
 HEADMasterSEO
+HMView
+HTMLparser
 HTTP::Lite
 Haansoft
-HaosouSpider
+Heritrix
 Hloader
-HonoluluBot
+HybridBot
 IDBot
+IRLbot
+Iblog
 Id-search
-Image Fetch
 Image Sucker
+Indy Library
+InfoNaviRobot
 InfoTekies
 Intelliseek
 InterGET
-InternetSeer
+Internet Ninja
+Iskanie
+IstellaBot
+JOC Web Spider
+JamesBOT
+Jbrofuzz
+JennyBot
 JetCar
-JikeSpider
-Jyxobot
+Jetty
+Joomla
 Keybot Translation-Search-Machine
+Keyword Density
 Kinza
-Kozmosbot
-LWP::Simple
 Lanshanbot
-Leap
-LexiBot
-Lftp
-LibWeb
-LieBaoFast
-Lightspeedsystems
-LinkScan
-LinkextractorPro
-LinkpadBot
+LinksManager
+LinqiaMetadataDownloaderBot
 LinqiaRSSBot
-Lipperhey Spider
 Litemage_walker
 Lmspider
 Ltx71
+MFC_Tear_Sample
 MIDown tool
 MIIxpc
 MQQBrowser
-MSFrontPage
 MSIECrawler
+MTRobot
 Magnet
+Majestic SEO
 Mass Downloader
-MauiBot
-MeanPath Bot
-Meanpathbot
+Masscan
+Mata Hari
+Mb2345Browser
+Mediatoolkitbot
 MegaIndex.ru
 Mister PiX
+Moblie Safari
 Mojeek
-Mojolicious
-Mr.4x3
-Msrabot
+Morfeus Fucking Scanner
+Mozlila
+NICErsPRO
+Navroad
+Needle
 Nessus
-Net Vampire
-NetZIP
-Netcraft
-Nettrack
+NetAnts
+NetMechanic
 Nikto
 NimbleCrawler
-Nmap
-Offline Explorer
-Offline Navigator
-Openvas
-OrangeBot
+Nimbostratus
+Nuclei
+Openfind
+OrangeSpider
 OutfoxBot
-Page Analyzer
+PECL::HTTP
+POE-Component-Client-HTTP
 PageAnalyzer
 PageThing.com
-Panscient
-Papa Foto
 Petalbot
+Pi-Monster
+Picscout
+Picsearch
+PictureFinder
 Pimonster
-PleaseCrawl
-ProPowerBot
-Psbot
-Pump
+Pixray
+Pockey
+Pu_iN
+PxBroker
 RSSingBot
-RankingBot2
-Re-re
+RankingBot
+RankurBot
+RealDownload
+Reaper
 RebelMouse
-RedesScrapy
-Rogerbot
+RepoMonkey
 SBIder
-SEOkicks
-SEOlyticsCrawler
+SEOstats
 SISTRIX
-SalesIntelligent
-Scanbot
-ScoutJet
+SMTBot
+ScanAlert
 Scrapy
 Screaming
 ScrepyBot
 Searchestate
 Semrush
-SeoSiteCheckup
+SemrushBot
 SeobilityBot
-SiteCheckerBotCrawler
-SiteLockSpider
+Shodan
+Site Sucker
+SiteSucker
 Sitebeam
 Siteimprove
-Snake
-Snapbot
+SmartDownload
 Sociscraper
-Sosospider
 Spammen
-Spbot
-Spinn3r
-SputnikBot
-Sqlworm
-Steeler
-Stripper
+Sqworm
+Sucuri
 SuperBot
+SuperHTTP
 Surfbot
-Suzuran
-T0PHackTeam
-Telesphoreo
-Telesphorep
-TheNomad
-Thumbor
+SurveyBot
+Szukacz
+The Intraformant
 TightTwatBot
-Titan
-Toweyabot
 Tracemyfile
-Turnitin
-TurnitinBot
-Typhoeus
+Trendiction
+Trendictionbot
+Twice
+URLy Warning
 URLy.Warning
-VelenPublicWebCrawler
-VoidEYE
+VCI
+VeriCiteCrawler
+Virusdie
 Voil
 Voltron
-WASALive-Bot
-WISENutbot
-WWW::Mechanize
-WeSEE
+WWWOFFLE
+Wallpapers
 Web Auto
+Web Collage
+Web Pix
 Web Sauger
-Web Sucker
-WebBandit
-WebEnhancer
-WebImageCollector
+WebAuto
+WebCollage
+WebFetch
+WebFuck
 WebPix
 WebReaper
-WebStripper
-WebZIP
-WebmasterWorldForumBot
-Webster
-Whack
-Wonderbot
-Xaldon_WebSpider
-Zauba
-ZmEu
-ZoomBot
+Webshag
+WebsiteQuester
+Whatweb
+Who.is Bot
+Woobot
+Zade
+Zitebot
 ZoominfoBot
-adscanner
+ZumBot
+ZyBorg
+archive.org_bot
+arquivo-web-crawler
+autoemailspider
 cah.io.community
-cognitiveseo
-com.plumanalytics
-crawl.sogou.com
+demandbase-bot
 domainsproject.org
-facebookscraper
 gopher
 heritrix
-iubenda-radar
+ips-agent
 linkdexbot
-lwp-request
-lwp-trivial
-magpie-crawler
-meanpathbot
 mediawords
+muhstik-scan
+page scorer
 pcBrowser
-probe-image-size
-scalaj-http
-sexsearcher
-sogouspider
+plumanalytics
+seostar
+sitechecker.pro
+siteripz
 sp_auditbot
 spyfu
 tAkeOut
-webmeup-crawler
+trendiction.com
+trendiction.de
+voyagerx.com
+webpros.com
 x09Mozilla
-zauba.io
+x22Mozilla