Veil HN: Blobcache Is Yelp-Addressed Storage

Veil HN: Blobcache Is Yelp-Addressed Storage

These components are slightly tremendous.


Blobcache is a direct material addressed recordsdata retailer, designed to be a replicated recordsdata layer for capabilities.

For extra recordsdata checkout a transient Introduction.
And the gRPC API medical doctors.


  • Outline a easy API for direct material-addressed storage trusty for explain by multiple capabilities.
  • Effectively multiplex multiple logical direct material-addressed stores onto a single exact retailer backed by the file machine.
  • Store recordsdata with other Blobcache peers.
  • Store recordsdata with cloud object storage suppliers.

Web Of Have confidence Storage Network

Blobcache is an experiment in developing a Web of Have confidence storage network, which is also economically conscious.

The watch-to-watch parts of Blobcache are peaceable in the early vogue phases, however many of the parts were prototyped and are accessible in in this repository.

Blobcache depends on INET256 for connections to peers.


  • Gain a blockchain or cryptocurrency.
  • Store recordsdata with untrusted peers.
  • Altruistic recordsdata storage and retrieval like BitTorrent or IPFS.
  • Merkle recordsdata buildings. Blobcache simplest provides with blobs.

Getting Started

That that you just must always peaceable be in a net site to install with

$ fling install ./cmd/blobcache

And then if ${fling env GOPATH}/bin is on your path, are trying to be in a net site to drag the blobcache deliver with

or to construct the executable somewhere explicit

$ fling safe -o ./build/the/binary/here/please ./cmd/blobcache 

Working a Node in Memory

Here is a trusty choice must you appropriate are attempting to clutter around with the API, and don’t are attempting to persist any recordsdata, or connect with peers.

Rising a Non-public Key

Blobcache requires a non-public key for every occasion.
Here is worn to uniquely title the occasion and for communicating securely with peers the usage of INET256

$ blobcache keygen > blobcache_pk.pem

Working the daemon

The next commands create a directory for blobcache recordsdata and runs a daemon on localhost on the default port. Alternate the title of the non-public-key to whereever your key is.

$ mkdir my-recordsdata
$ blobcache drag --non-public-key ./blobcache_pk.pem --recordsdata-dir my-recordsdata

As soon as the daemon is running, are trying to be all situation to glue to it and initiate constructing your utility on top of direct material-addressed storage.

Encourage, I have to retailer recordsdata bigger than a single Blobcache blob

Blobcache is just not a filesystem or object retailer. It simplest enables storing blobs as much as a put maximum measurement (at the moment 2MB).
It is miles extra of a constructing block than a storage solution on it is possess.

Preserve a look for at glfs, a Git-Love FileSystem which breaks aside large recordsdata into chunks which can fit into Blobcache.

Additionally desire a look for at GotFS which is a extra refined, however in many programs extra atmosphere superior, different to glfs.

Encourage, I have to retailer many diminutive issues successfully in Blobcache

Preserve a look for at GotKV, an immutable key-value retailer on top of direct material-addressable storage.
It be Blobcache like minded.


It’s essential receive enthusiastic thru either:

  • Our dedicated Matrix room
  • The INET256 Discord, in the #capabilities channel.


The Blobcache implementation is licensed below GPLv3.

All of the purchasers are licensed below Apache 2.0

What this means is: must you beef up Blobcache it is foremost to create the enhancements accessible, however must you might additionally be appropriate the usage of a shopper you might additionally receive whatever you wish with it.

Read More
Portion this on to watch advice from of us on this matterDesignate up on now must you might additionally be not registered yet.

Related Articles

Comparability of Kubernetes Managed Products and providers

ProductGoogle Kubernetes Engine (GKE)Amazon Elastic Kubernetes Service (EKS)Azure Kubernetes Service (AKS)IBM CloudKubernetes Service (IKS)Scaleway KapsuleDigitalocean Kubernetes (DOKS)Alibaba Cloud Container Service for Kubernetes (ACK)IONOS Kubernetes ServiceCivo Kube100Gridscale Managed Kubernetes (GSK)Linode Kubernetes Engine (LKE)OVHcloud Managed Kubernetes Service (MKS)Kubernetes on PacketOracle Kubernetes Engine (OKE)MetaKube1. General info(status: needs help)(status: needs help)(status: in progress)Link Supported versions1.20✖︎✔️✔️✔️✔️Needs help✔️✔️Needs help✔️Needs helpNeeds help1.19✔️✔️✔️✔️✔️✖︎✖︎✔️Needs…

System Design Primer: Learn how to design large-scale systems

English ∙ 日本語 ∙ 简体中文 ∙ 繁體中文 | العَرَبِيَّة‎ ∙ বাংলা ∙ Português do Brasil ∙ Deutsch ∙ ελληνικά ∙ עברית ∙ Italiano ∙ 한국어 ∙ فارسی ∙ Polski ∙ русский язык ∙ Español ∙ ภาษาไทย ∙ Türkçe ∙ tiếng Việt ∙ Français | Add Translation Help translate this guide! Motivation Learn how to design…

Create your crypto business with Stripe

The crypto ecosystem and its regulatory outlook continue to evolve rapidly, and our feature availability varies by region and use case. Please see our crypto supportability page for more details on our current product availability. Fill out the form to tell us more about what you’re building so we can better understand how to support…