AhrefsBot
Apexoo
BLEXBot
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
BlowFish
Buddy
Calculon
CherryPicker
ChinaClaw
Cosmos
CrazyWebCrawler
Crescent
DBLBot
DIIbot
DTS Agent
DigitalPebble
Dispatch
DnyzBot
DomainSigmaCrawler
Dotbot
Drip
Ecxi
EirGrabber
Exabot
Flunky
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
Grabber
HMView
Haansoft
Humanlinks
IDBot
Intelliseek
Internet Ninja
InternetSeer
JOC Web Spider
Jbrofuzz
Jetty
LibWeb
Likse
LinksManager
Lipperhey
Majestic SEO
MeanPath Bot
Microsoft URL Control
Mister PiX
MolokaiBot
Mozlila
NICErsPRO
NetZIP
NimbleCrawler
Offline Explorer
Openvas
OutclicksBot
POE-Component-Client-HTTP
Papa Foto
ProPowerBot
RankActive
RankingBot
RankingBot2
Reaper
RebelMouse
Ripper
SEOprofiler
Scanbot
SiteExplorer
Sitebeam
SocialRankIOBot
Sogou web spider
Spinn3r
Stripper
TightTwatBot
URLy Warning
VB Project
Vagabondo
Voil
WWWOFFLE
WebCopier
WebGo IS
WebImageCollector
Webalta
Webshag
Whack
WiseGuys Robot
YoudaoBot
Zauba
ZyBorg
crawler4j
dataforseo.com
dataforseobot
domainsproject.org
evc-batch
facebookscraper
seoscanners
tAkeOut
webmeup-crawler