Amazon S3

Amazon S3 is an online file storage web service. It stores all types of objects through the web services interface. S3 stands for Simple Storage Service. In a web application, the static contents can pressurize the web server, S3 storage helps to load the images and videos quickly to scale up your website’s performance.
What are You Going to Learn?
  • Advantages
  • Prerequisites
  • Companies depending on Amazon S3
  • Terminology used in S3
  • How to setup and manage Amazon S3
  • Conclusion
Advantages of Amazon S3
  • Amazon S3 helps to improve the website/web application performance by loading the static contents and reduce the webserver load.
  • Amazon S3 can store any type of file/object in a container which is called ‘bucket’.
  • You can store a single object up to the size of 5TB
  • Amazon S3 allows you to set permissions to the buckets to read/write using unique key and the authentication setup will keep the data secure from unauthorized access.
  • Amazon S3 can be accessed through the Amazon’s management console or using the S3 organizer(S3fox) addon for firefox.
  • It is cost effective, quick and reliable storage infrastructure.
Prerequisites
  • You must signup for Amazon S3 in your aws account
Companies depending on Amazon S3
  • Amazon’s global network of websites using S3 services for storage service.
  • Dropbox
  • Tumblr
  • Storegrid
  • InstaGram
Terminology Used in Amazon S3
  • Objects
    Objects are the basic contents stored in Amazon S3. Each object has object data and meta data. Object data is the original data and the meta data describes the name value of the object. Meta data includes the default value, modified data and Http meta values. We can also customize the meta while storing the object.
  • Buckets
    A bucket is a container of objects. Every object stored in Amazon S3 is contained in a bucket. Buckets will help to organize the objects, identify the account responsible for storage and data transfer, access restrictions using ACL and easy to pull reports. Every object inside the buckets is identified by a key and unique version ID.
  • Regions
    We can choose to create the Amazon S3 buckets in any of the available across the globe.
Objects stored in one region can be transferred to other regions.
  • ACL (Access Control List)
In Amazon S3, Access Control List provides privileges to the buckets and objects. Each objects or buckets is associated with ACL and that defines the access to aws accounts and the type of privileges.
When an object is created, ACL offers full control to the owner of the resource. In ACL Grant is an element that identifies the ‘grantee’ (it may be a aws account or predefined group of users) and it is permission. The permission list are as follows, READ, WRITE, READ_ACP, WRITE_ACP and FULL_CONTROL.
In ACL, there are predefined grants available which are called Canned ACLs. The permission list are as follows, private, public-read, public-read-write, authenticated-read, bucket-owner-read, bucket-owner-full-control, log-delivery-write.
How to Setup and Manage S3?
  • Enter a bucket name and make sure it is unique. The bucket name cannot be changed and it is visible in the URL that points to the bucket and object.
  • In the Region drop down menu, select a region of your own.
  • Click the create button and the bucket will be created.
  • Inside you can create folders or upload objects.
  • To upload an object, click upload from the web user interface. You can also use S3 Organizer to upload files into the bucket.
  • Click Add files and select the file from your computer
  • Once it is selected, click Start Upload button to begin the file upload to Amazon S3
  • Finally the object will be uploaded and stored inside the bucket.
  • By default, the object will have Grantee to owner of the account with open, view and edit permissions.
  • By making it public you can set the Grantee to everyone with open/download permission.
  • You can use the Link to test your object.
  • You can move, copy or delete an object.
  • In the properties tab, you can set the permissions and add metadata to the object.
  • The Amazon S3 organizer (S3 fox) is an addon for firefox can be used to create buckets and upload/download objects from Amazon S3.
Conclusion
The pricing for Amazon S3 differs for every region and it is a pay for use model. There are three types of charges can be applicable for Amazon S3.
  • Storage pricing is for standard storage and reduced redundancy storage.
  • Request Pricing is for put,copy and post requests.
  • Data Transfer Pricing depends on the in and out data transferred using Amazon S3
    • All data transfer IN to Amazon S3 and data transfer OUT to from Amazon S3 to Same region Amazon EC2 are free
    • All other transfers are chargeable.
Amazon S3 is very less expensive and high redundancy service when comparing with other service providers and product features.

Comments

Post a Comment

Popular posts from this blog

HA-Proxy setup for Openstack Services

Image
HA-PROXY SETUP FOR OPENSTACK SERVICES INTRODUCTION: To obtain maximum uptime in openstack services we are in need of high availability (aka HA ) in this document we are using ha-proxy for openstack HA and keepalived for H a-proxy HA. Software topology As mentioned, we’ll use the following set of software: the services themselves; HAProxy for making the services HA; and Keepalived for making HAProxy HA. Getting hands-on Suppose we have two machines, from which we want to make an HA OpenStack controller pair, installing both the API services and Keepalived + HAProxy. Suppose machine 1 has address 192.168.56.200, machine 2 has address 192.168.56.201, and we want the services to be accessible through virtual IP 192.168.56.210. And suppose all these IPs are on eth1. Installing necessary packages $ sudo apt-get install haproxy keepalived Configuration of haproxy This configuration is identical on both nodes and resides in /et
Read more

Amazon CloudFront

Image
CloudFront is a CDN (Content Delivery Network) service which provides quick and faster delivery of web content. A Content Delivery Network helps the web page to load quickly in end user's(visitors) browser and also it helps to improve the Google SERPs. In a web page, the static contents (Images, videos and games) require more time to deliver from the web server. CloudFront distributes the static contents to multiple edge locations and delivers it to the end user quickly and helps to reduce latency. What are You Going to Learn? Advantages of CloudFront Prerequisites How to Deploy CloudFront How to Manage CloudFront Resources Most Common Problems Conclusion Advantages of CloudFront Amazon’s CloudFront has more than 40 edge locations from all over world to improve the content delivery quickly and with minimal errors. It is much cheaper than any other CDN providers. Since AWS is providing other services like EC2, ELB, CloudWatch and RDS, it is
Read more

Openstack to Cloudstack Template Migration

Image
This blog covers the image/template migration between Openstack to Cloudstack platform. To be precise, converting the image from QCOW2 format to VHD format and upload it to Cloudstack platform.   Requirements Root access privileges to openstack and cloudstack with Xen server platform Enough free space to do the conversion python 2.7 to run a http server Image Download This part is already covered in one of my existing blogs. Please refer  https://benyraja.blogspot.in/2017/03/templateimage-migration-with-reduced.html 'Image Download' section. Image Conversion Once we have downloaded the image to local disk, we have to convert it into VHD as it is the supported version of Cloudstack Xen hypervisor. If you are using KVM hypervisor, then we can skip to next step. Use the below command to convert the image from QCOW2 to VHD. $ qemu-img convert -O vpc Now you will have the converted image in VHD format. Image Upload/Register Template To register tem
Read more