Object Stores (Containers)¶

Object Storage offers a scalable storage service which can be used by applications compatible with the Swift and Amazon S3 protocol. The ScienceCloud Object Store is built upon Ceph using RadosGW. The Ceph Service makes no additional backups and there is no provision within the service for disaster recovery. Users are therefore responsible for maintaining independent backups of their objects where they judge it important.

Available tools¶

ScienceCloud object storage can be managed using a variety of tools to match your workflow and requirements:

• S3-compatible API - for users familiar with S3 tools
• OpenStack Swift CLI (swift) - native command-line client
• Cyberduck (GUI) - graphical client for easy drag-and-drop management

Container layer¶

Is another layer of abstraction introduced in ScienceCloud object store architecture which allows you the possibility to assign different storage policy on a per-container basis. Containers are composed of the list of your objects and can be considered as a structural layer.

Objects¶

Objects are your files that are stored as binary files along with their metadata as a single unit on the filesystem. The swift CLI has a 5 GB limit on the size of a single uploaded object. However files larger than 5 GB can be dealt with segmenting them and uploading the resulting segments with a special manifest file that, when downloaded, sends all the segments concatenated as a single object. Read more here.