Skip to main content


Showing posts from 2015

What is Docker Containers?

Docker, a new container technology, is hotter than hot because it makes it possible to get far more apps running on the same old servers 
Containers, use shared operating systems. That means they are much more efficient than hypervisors in system resource terms. Instead of virtualizing hardware, containers rest on top of a single Linux instance. This in turn means you can “leave behind the useless 99.9% VM junk, leaving you with a small, neat capsule containing your application,” Therefore , with a perfectly tuned container system, you can have as many as four-to-six times the number of server application instances as you can using Xen or KVM VMs on the same hardware Docker, however, is built on top of LXC. Like with any container technology, as far as the program is concerned, it has its own file system, storage, CPU, RAM, and so on. The key difference between containers and VMs is that while the hypervisor abstracts an entire device, containers just abstract the operating system kernel…

50 diagrams illustrating IoT to Cloud/Big Data Analytics interfaces

My colleague Bob Marcus  collected about 50 diagrams (with reference URLs) showing alternative architectural approaches to interfacing IoT to Cloud/Big Data Analytics. See the Link below. The diagrams are generally very high level with more details available on the source Web sites.  

50 diagrams illustrating IoT to Cloud/Big Data Analytics interfaces

Environmental Variables Explained

My 100th Blog: A milestone

To everyone who visited my blog on daily basis: A Big Thank you. Its little more than a year and i am writing today my 100th  blog post. its a milestone for me.

Below is some of my most important blogs. 

General Blogs ·        5 Technologies that every Entrepreneur Needs - markITwrite ·        IBM and HP: Two different talesof Tech Giants ·        Hyper Converged System: EVO RAIL ·        Hyper-Converged Building Blocks in the Open Software-Defined Data Center

Cloud Computing
·vCoud Director Installation and configuration ·Changing Face of Managed services: A Threat to Likes of HP, IBM ·HP CSA Implementation ·Are HP and Intel About to Revolutionize Virtual Desktops? (HPQ, INTC) ·HP CSA Vs VMware VCAC ·10 best practices for cloud design ·vCloud Suite Architecture-1 ·

Amazon Web Services: Route 53

In this blog we will discuss Route 53. It is also knowan as amazon distributed DNS. It is fully featured. It supports multiple DNS record types, multiple routing algorithm.It also has resource level IAM Control

Route 53 is distributed DNS. It is distributed geographically.

User in North America will use DNS locally located. It makes it faster

Route 53 supports all major record types. It has TTL control

Route 53 have 2 types of Algorithm

Weighted Round Robin (WRR)Latency Based Routing (LBR) So this is all about Route 53. Now you should have high  level understanding how amazon works

Amazon Web Services: Simple Notification Service

In this blog, we will discuss Simple notification service

SNS sends notices to internal assets from AWS:from Application to user OR to application or user. SNS is useful for monitoring, alerts and logging.

SNS Setup

To set up a SNS,

 Create a Topic. Think it as a mailbox or email aliasAdd Subscribers: Think of it like a  multiple recipients.If more than just emailSubscribers must confirm since this is an internal messageAnd you send messages to the Topic. All confirmed subscribers immedialy et the messageSNS Overview
it obviates the need to build custom messagingits push based messagingDeep integration with other AWS servicesit has API and AWS console support
.Next we identify SNS subscriber types

Http/semail/ email-JSONSMSSQSSNS Service integration
Autoscaling: Publish instance add/remove messagesEC2:Application on EC2 can leverage SNSS3Cloudwatch

Amazon Web Services: Virtual Private Cloud Advanced

In the last blog we  covered VPC. In this blog we will cover advance VPC
In this blog primarily the  focus will be on

Isolation internal tiers/Customers from each otherProgramatically connecting/disconnecting Internet gateway

Isolation internal tiers/Customers from each other

Please look at teh diagram below: There is a web/App tier and compute Tier Both are in AZ-A and AZ-B. Both have different VPC and Routing table
So this way you can isolate different tiers and customers from each other
Programatically connecting/disconnecting Internet gateway

Amazon Web Services: Virtual Private Cloud

In this blog, we will discuss Amazon Web Services,Virtual Private Cloud (VPC)

 Please have a look at the diagram below:

Customer 1 (C1), Customer 2(C2) and Customer 3 (C3) have their EC2 instances. Without VPC, C2 can ping and try to access easily C3 s EC2 instances.

VPC Benefits:

Logical isolation of your resources from other customers, from internal divisions and application tiers.Control Over:           --Address Spaces           --Subnets: Do you know minimum size of subnets should be /28 or 14 ip addresses and maximum size should be eual to size of VPC. We can have 200 Subnest per AZ           --Route Tables and NATs           --Network Gateway (VPN and Internet)           --Ingress and egress security groups           --Multiple Elastic Network Interface (ENI) on VPC EC2           --Control over dedicated hardware

VPC Limitations are: Only Select resources like ELB( w/support to balance web/app tier), EC2( and EBS, Autoscaling), RDS, Elasticache can be launched in a VPCYou will wan…

Amazon Web Services: ElastiCache

In This blog we will discuss Elastic Cache

ElastiCache is the in memory caching mechanism. It is the memcache under the hood. It is 100% API compliant.More appropriately it is a memcache cluster

Memcache is a popular , opensource in -memory cache. it is  very fast read and writes.It takes burden of backend resources

Memcache is a key value store.It is a NOSql DB. Its only access method is a key

ElastiCache is actually a memcache cluster. it is a distributed collection of cache nodes

Its available in only Single AZ Cache nodes are very user specified types very much like EC2 Instance typecan be wrapped with security groupscan buy capacity reservationsResizeable ( remove or add nodes)

To Setup and ElastiCache

Choose an AZChose node types, # of nodesLaunch ClusterConnect application by pointing to elasticache endpointBenchmark, resize ( if necessary)

Elasticache Expiry Expiring Key is controlled via the elasticache API (memcache commands)Scheduledon demand
ElastiCache Pricing It has per hou…

Amazon Web Services : CloudFront

In this blog we will discuss amazon cloudfront. What is cloudfront?

Cloudfront is a CDN or content delivery network. It utilizes Edge Locations near to user. Since its a CDN we need to remember content needs and origin and it can be expire also.

CDN are popular static websites.Using CDN, you can either make

Download distributions like products, documents and dataor Streaming distribution like audio or video Cloudfront has native integrations to AWS (S3 origins).It is very cost effective
To setup a cloudfront, one must create a distribution Must define Http or steamingMust Specify an origin: Any web accessible server will work ( EC2, S3, Private server)\Can also specify TTL, logging, Path matchesDistribution domain created for you for example like or can also easily create vanity URLS Use Distribution domain in links
When user access the CDN URL, Cloudfront directs them to their closest Edge. Everyone loads content faster.
Cloudfront is a pull mechanism.Each edge pu…

Amazon Web Services: Storage

In this blog we focus on Storage. We will discuss many storage options available in AWS.

So we will look at S3 Storage, RDS( Managed MySQL, Oracle and SQL) and DyanamoDB( NOSQL database)

Lets start with S3 Storage.

S3 Storage ( Simple Storage Service) is an object storageand is best used for static assests. It is the cheapest option to store and serve data. There is no limits on the number of the objects that you can create. It is extremely durable.

S3 is extremely scalable too. All objects are natively web accessible.It can also host static websites.

There are certain S3 limitations:

LatencyIts a WORM ( Write Once Read Many) Storage.It cannot serve Dynamic contentIts 100buckets and 5TB Max sizeon the objectsbare bones (write, read, delete)

RDS ( Relation Database service) is a hands off RDBMS (MySQL, Oracle and SQL). RDS is manually scalable like EC2. RDS has HA already baked in ( multi-AZ master/slave). RDS also has DR baked in with automated backups and real time snapshots. It is v…

Amazon Web Services: Cloudformation

In this blog, we will discuss Cloudformation.
cloudformation helps in codifying creation of stack of resources.

What are stack of resources? A stack could be:

ELBAuto scaling groupEC2RDS (Database)All connections between them
There are many benefits of cloudformation, namely:

Your infrastructure as a codecan be version controlledModularization ( templates can contain other templates)Enforce one way to deployCost nothing Signing up with Cloudformation means signing up with AWS services that Cloudformation can create
With Cloudformation you can setup billing alarms. To learn how to setup billing alarms go to 
There are 200-300 pre-packaged amazon templates available. The templates are JSON based. The templates can accespt run-time parameter [Instance type (small for test), Kep pair (prod vs Test)] Templates can also update running stack Templates have 7 section versiondescriptionparametersmappingresour…

Amazon Web Services: Auto scaling and Cloudwatch

In this blog, we will discuss Amazon Web Services: Auto scaling and Cloudwatch

The question is : What does Auto scaling provides?  The answer is:

Linear Horizontal Scaling HA
Second question is What Cloud watch enables? Cloud watch enables:

monitoring and alerting for resourcesAlarms Can fire auto scaling policies, SNS notifications
 auto scaling, ELB and Cloud watch makes up what Amazon calls Triangle services


To set up Auto scaling, we need to do the following things:

Create ELB( Its recommended but not necessary)Create Instances in 2 or more AZs ( Its recommended but not necessary               a) Create Launch Config: Launch config consists of
                          1) EC2 instance launch profile
                          2) Image ID (AMI)
                          3) Instance Type ( e.g t1.micro or m1.small)
                          4) key pair ( recommended)
                          5) Security Group
                          6) Name

Create Auto scaling Gro…