V4.2021.08.2550 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-01h4x.com
-360Spider
-ALittle Client
-ASPSeek
-Abonti
+404checker
+404enemy
+ADmantX
+Aboundex
 Aboundexbot
-Anarchie
-Ankit
-Apexoo
-Aspiegel
-BDCbot
-BLEXBot
-BackDoorBot
+AfD-Verbotsverfahren
+Aipbot
+AlphaBot
+Anarchy99
+Attach
+BBBike
+BDFetch
+BackStreet
 Backlink-Ceck
-BatchFTP
 Battleztar Bazinga
+BetaBot
 Bigfoot
-Bitacle
-Blackboard
-Brandprotect
-Brandwatch
+Black Hole
+BlackWidow
+Blow
+BlowFish
+BotALot
 Buck
-BuiltWith
-Bullseye
+BuiltBotTough
 BunnySlippers
 BuzzSumo
-CCBot
+CATExplorador
 CSHttp
-Cegbfeieh
+CheTeam
 CherryPicker
 ChinaClaw
-Chlooe
-Cliqzbot
+Claritybot
+Cloud mapping
+Cocolyzebot
+Copier
 CopyRightCheck
-Copyscape
 Cosmos
 Crawling at Home Project
-Crescent
 Custo
-DBLBot
 DIIbot
 DTS Agent
-Devil
-Digincore
-DigitalPebble
+DataCha0s
+DatabaseDriverMysqli
+Deusu
 Dirbuster
+Discoverybot
 DittoSpyder
-DomainCrawler
-EMail Wolf
-Ecxi
+DnyzBot
+DomCopBot
+Download Wonder
+Dragonfly
+Drip
+EasyDL
+EroCrawler
 Exabot
-Extractor
-ExtractorPro
-Extreme Picture Finder
-FDM
+EyeNetIE
+Ezooms
+Firefox/7.0
 FlashGet
 Flunky
+Foobot
+Freeuploader
 Fuzz
-FyberSpider
 Fyrebot
-G-i-g-a-b-o-t
 GetRight
+GetWeb
 Gigabot
-Grabber
-HTTP::Lite
-Haansoft
-HaosouSpider
+Gotit
+GrapeshotCrawler
+GridBot
+HEADMasterSEO
+HMView
 Heritrix
-Humanlinks
-HybridBot
-IDBot
-Iblog
-Image Fetch
-IndeedBot
-Indy Library
+IDBTE4M
+IRLbot
+Image Sucker
+InfoNaviRobot
 Intelliseek
 InterGET
+InternetSeer
 Iria
-IstellaBot
-JennyBot
-JetCar
-JikeSpider
+JOC Web Spider
+Jbrofuzz
+Jetty
 Joomla
-Jorgee
-JustView
-Keyword Density
-LWP::Simple
+Jyxobot
+Kinza
 Lanshanbot
-Leap
+Larbin
 LeechGet
 LexiBot
-Lftp
 LibWeb
-Likse
-LinkScan
 LinkWalker
-Linkdexbot
+Linkbot
 LinkextractorPro
 LinkpadBot
 LinksManager
-LinqiaRSSBot
-LinqiaScrapeBot
-Lipperhey Spider
-Litemage_walker
 Ltx71
 MIIxpc
-MJ12bot
-MTRobot
+MQQBrowser
+MSFrontPage
+Mag-Net
+Magnet
+Majestic12
+MarkWatch
+Mass Downloader
+Mata Hari
+Mediatoolkitbot
+MegaIndex.ru
 Metauri
+Microsoft URL Control
 Mister PiX
-Moblie Safari
+Mojolicious
 Morfeus Fucking Scanner
-Mozlila
 Msrabot
-NICErsPRO
-NPbot
+Musobot
 Nameprotect
 NearSite
-Needle
+Nessus
 Net Vampire
+NetMechanic
 NetSpider
-Netvibes
-Nikto
-NimbleCrawler
-Nimbostratus
+NetZIP
+Nettrack
 Nmap
+OnCrawl
 Openvas
-OutclicksBot
+OrangeBot
+OrangeSpider
 OutfoxBot
+PECL::HTTP
 PHPCrawl
-POE-Component-Client-HTTP
-Page Analyzer
-PageThing.com
-Papa Foto
-Pavuk
-Picscout
+PageScorer
+Panscient
+PeoplePal
 Piepmatz
-Pixray
 PleaseCrawl
-ProWebWalker
+ProPowerBot
+Probethenet
 Pu_iN
-PyCurl
-QueryN Metasearch
-Quick-Crawler
+Pump
+PxBroker
 RankActive
 RankFlex
-Rankivabot
+RankingBot2
 RealDownload
-RebelMouse
-RedesScrapy
+Reaper
 RocketCrawler
+Rogerbot
 SEOkicks
-SEOlyticsCrawler
-SEOprofiler
+SEOkicks-Robot
 SISTRIX
-Scrapy
-Semrush
+SalesIntelligent
+ScanAlert
 SemrushBot
-SeoSiteCheckup
-Seomoz
-Siphon
+SentiBot
+Site Sucker
 SiteCheckerBotCrawler
+SiteLockSpider
 SiteSucker
 Sitebeam
+Siteimprove
+Sitevigil
 SlySearch
-Snoopy
-Sociscraper
+Snapbot
 Sogou web spider
-Sottopop
-Spanner
+Sosospider
+Spammen
 SputnikBot
-Stripper
-SuperBot
+Sqlmap
+Sqlworm
+Sucuri
 Surfbot
+Swiftbot
 Szukacz
 T0PHackTeam
+T8Abot
+Teleport
 TeleportPro
-Telesoft
-Telesphoreo
 Telesphorep
+The Intraformant
 TightTwatBot
-Toata
-Tracemyfile
-Trendiction
-Turingos
-Turnitin
+Titan
+Toweyabot
+Trendictionbot
 TurnitinBot
-Twice
-Typhoeus
-UnisterBot
+URLy Warning
 V-BOT
 VB Project
-VelenPublicWebCrawler
-Virusdie
+VCI
+Vacuum
+Vagabondo
+VeriCiteCrawler
+VidibleScraper
 VoidEYE
-WASALive-Bot
-WBSearchBot
-WEBDAV
-WISENutbot
+Voil
 WWW-Collector-E
-WWW-Mechanize
-WWW::Mechanize
-Wallpapers/3.0
-WallpapersHD
-Web Collage
+WWWOFFLE
+Wallpapers
+WeSEE
 Web Fetch
-Web Sucker
+WebAuto
 WebCopier
-WebEnhancer
-WebImageCollector
-WebStripper
+WebFuck
+WebLeacher
+WebPix
+WebReaper
 WebWhacker
-Webshag
+WebmasterWorldForumBot
 WebsiteExtractor
-WebsiteQuester
 Whack
-Whatweb
-WinHTTrack
-Woobot
+Who.is Bot
+Widow
+WiseGuys Robot
+Wonderbot
 Wotbox
-Wprecon
-Xenu
+YoudaoBot
 Zade
 Zauba
 Zermelo
-Zeus
-archive.org_bot
+ZoomBot
+ZoominfoBot
 arquivo.pt
 autoemailspider
-instabid
+cah.io.community
+com.plumanalytics
+crawler4j
+domainsproject.org
+evc-batch
+gopher
 internetVista monitor
-isitwp.com
 lwp-request
-magpie-crawler
-meanpathbot
+lwp-trivial
+mediawords
 muhstik-scan
 netEstate NE Crawler
+oBot
+plumanalytics
 ripz
-s1z.ru
 satoristudio.net
-scalaj-http
+seobility
 seostar
-sexsearcher
+serpstatbot
+sp_auditbot
 spyfu
-trendiction.com
 trendiction.de
 ubermetrics-technologies.com
-webprosbot
-xpymep1.exe
+voyagerx.com
+webpros.com
 zauba.io