V4.2021.08.2495 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-01h4x.com
-360Spider
-404enemy
+404checker
 ADmantX
 ALittle Client
-ASPSeek
+Aboundexbot
+Acunetix
 AhrefsBot
-AiHitBot
 Aipbot
 AllSubmitter
+AlphaBot
+Ankit
+Anthill
 Apexoo
-Attach
+Aspiegel
+Asterias
+AwarioRssBot
+BBBike
+BDCbot
 BDFetch
-BackWeb
-Backlink-Ceck
+Badass
 Bandit
+Barkrowler
 Battleztar Bazinga
-BetaBot
-Blow
+Bitacle
 BlowFish
 Boardreader
 Bolt
-Brandwatch
-BuzzSumo
-CATExplorador
-CSHttp
-Calculon
+BotALot
+Brandprotect
+Buck
+Buddy
+BuiltBotTough
+CCBot
+CODE87
 CensysInspect
 CheeseBot
-ChinaClaw
-Cliqzbot
-Cloud mapping
+CherryPicker
 Cocolyzebot
-Copyscape
+Copier
 Craftbot
-CrazyWebCrawler
-DIIbot
+Curious
+DSearch
 DTS Agent
 DataCha0s
+DatabaseDriverMysqli
+Deusu
 DigitalPebble
-Disco
+Dirbuster
+Discoverybot
 DittoSpyder
-DnyzBot
+DomCopBot
+DomainStatsBot
+Domains Project
 ECCP/1.0
-EMail Siphon
+EMail Wolf
+EasyDL
 Ebingbong
-Extractor
-FHscan
+EroCrawler
+Extreme Picture Finder
+EyeNetIE
+Ezooms
 FemtosearchBot
+Fimap
+Firefox/7.0
 FlashGet
 Flunky
-Freeuploader
-Fuzz
+FrontPage
 FyberSpider
+G-i-g-a-b-o-t
 GT::WWW
-GalaxyBot
-GermCrawler
-GetRight
 Gigablast
 Go-Ahead-Got-It
 Gotit
 Grabber
+GridBot
+HMView
 HTMLparser
-HTTP::Lite
-Havij
-Humanlinks
-IDBTE4M
+Haansoft
+HaosouSpider
+Hloader
+IDBot
 IRLbot
-Iblog
 Id-search
 IlseBot
 Image Fetch
-InfoNaviRobot
+InfoTekies
 Intelliseek
-Internet Ninja
-IstellaBot
+Iria
 JOC Web Spider
-Joomla
-JustView
+Jbrofuzz
+Jetty
+JikeSpider
+Jorgee
 Jyxobot
 Kenjin Spider
 Keyword Density
+Kinza
 Kozmosbot
+LNSpiderguy
 LWP::Simple
+Leap
+LeechFTP
 LexiBot
+Lftp
 Libwhisker
-Likse
+Lightspeedsystems
 LinkScan
-Linkbot
 Linkdexbot
-LinkextractorPro
-LinkpadBot
-Lipperhey
-Lipperhey Spider
-Lmspider
-Ltx71
-MFC_Tear_Sample
-MIIxpc
-MJ12bot
+LinqiaRSSBot
+Litemage_walker
 MTRobot
-Magnet
-Majestic SEO
-Majestic-SEO
-Majestic12
+MarkWatch
 Mass Downloader
 Masscan
-Mb2345Browser
+MauiBot
+Meanpathbot
 Mediatoolkitbot
+MicroMessenger
 Microsoft URL Control
-Mister PiX
-Mojeek
-Morfeus Fucking Scanner
+Moblie Safari
 Msrabot
-NICErsPRO
-Needle
-Netcraft
-NextGenSearchBot
+Musobot
+NearSite
+NetAnts
+Nettrack
 Niki-bot
-Nikto
-NimbleCrawler
-Nimbostratus
 Ninja
-Nmap
-Nuclei
-Nutch
 Offline Explorer
-OpenVAS
-Openvas
+OnCrawl
 OrangeSpider
-PECL::HTTP
+OutclicksBot
+OutfoxBot
 PHPCrawl
 POE-Component-Client-HTTP
-PageScorer
-PeoplePal
-Petalbot
-Picscout
+PageGrabber
+PageThing.com
+Panscient
+Papa Foto
+Pi-Monster
 Picsearch
-PictureFinder
 Pimonster
 Pixray
-PleaseCrawl
-ProWebWalker
+Pockey
+Psbot
 Pu_iN
-PxBroker
+Pump
 PyCurl
 QueryN Metasearch
 Quick-Crawler
-RSSingBot
-RankFlex
+RankActive
 RankingBot
-RankingBot2
-ReGet
-RedesScrapy
 RepoMonkey
-Ripper
-RocketCrawler
 Rogerbot
-SEOprofiler
+SEOkicks
+SEOkicks-Robot
+SEOlyticsCrawler
+SEOstats
 SISTRIX
+SMTBot
+SalesIntelligent
 ScanAlert
+Scanbot
 Scrapy
 ScreenerBot
-SearchmetricsBot
+ScrepyBot
+SentiBot
 SeoSiteCheckup
-SeobilityBot
-Siphon
-Site Sucker
+SiteCheckerBotCrawler
 SiteSnagger
 Siteimprove
 Sitevigil
+Snapbot
 Sociscraper
-Sosospider
 SpaceBison
-Spammen
+SpankBot
+Spanner
 Spbot
-SputnikBot
-Sqlmap
-Sqlworm
-Steeler
-Stripper
-SuperHTTP
+Sqworm
+Sucker
+Sucuri
+Surfbot
 Szukacz
 T0PHackTeam
-TeleportPro
+Teleport
+Telesoft
 Telesphorep
-TightTwatBot
+The Intraformant
+Thumbor
+Toata
 Tracemyfile
 True_Robot
 Turingos
-TwengaBot
-Typhoeus
-URLy.Warning
-UnisterBot
+Turnitin
+Twice
 V-BOT
 VB Project
-Vagabondo
+VCI
+VelenPublicWebCrawler
 VeriCiteCrawler
+Virusdie
+Voltron
+WASALive-Bot
 WEBDAV
-WISENutbot
-WWW-Mechanize
-Wallpapers/3.0
-WeSEE
-Web Collage
-Web Fetch
-Web Fuck
+WPScan
+WWW-Collector-E
+WWW::Mechanize
 Web Sauger
-WebAuto
+Web Sucker
+WebCollage
+WebEnhancer
+WebGo IS
+WebImageCollector
+WebLeacher
 WebReaper
+WebSauger
 WebStripper
+WebSucker
 WebZIP
 WebmasterWorldForumBot
+Website Quester
+Webster
 Whack
 Whacker
-Widow
-WinHTTrack
-WiseGuys Robot
-Wotbox
 Wprecon
+Xaldon_WebSpider
 YoudaoBot
 Zauba
 Zermelo
-Zeus
 Zitebot
-ZumBot
+ZoominfoBot
+ZyBorg
+archive.org_bot
 arquivo.pt
-autoemailspider
-backlink-check
+coccocbot-web
 cognitiveseo
-crawler4j
-demandbase-bot
-domainsproject.org
-facebookscraper
-heritrix
-internetVista monitor
-ips-agent
+eCatch
 isitwp.com
 lwp-request
-magpie-crawler
-muhstik-scan
-netEstate NE Crawler
-oBot
-pcBrowser
+meanpathbot
+page scorer
 polaris version
+scalaj-http
+seobility
+seoscanners
+seostar
+serpstatbot
 sexsearcher
-tAkeOut
-trendiction.com
-ubermetrics-technologies.com
+sogouspider
+voyagerx.com
 webmeup-crawler
-zauba.io
 zgrab