Log Management Authors: Dana Gardner, Pat Romanski, Elizabeth White, David H Deans, Carmen Gonzalez

Related Topics: @CloudExpo, Containers Expo Blog, Log Management

@CloudExpo: Blog Feed Post

Notes From the Cloud Academy

RAIC - Redundant Arrays of Inexpensive Cloud services

We have been running the Cloud Academy roundtables in several European countries. I’d like to share some of the more interesting questions, debates and insights around a number of topics, starting today with RAIC—Redundant Arrays of Inexpensive Cloud Services. Other topics will include:

  • A TV industry analogy: Competition for the IT department
  • Cloud Shortcuts: Can the Cloud make( internal) IT more agile
  • Service Level Management and the Cloud
  • Cloud R&R - Retained responsibilities for IT
  • Elastic Services: Everybody wants to be a manager

Redundant Arrays of Inexpensive Cloud services
Today’s post discusses whether we can ensure performance and availability of public cloud services. I’m not sure we can. Public cloud services are a bit like the weather: we are lucky if we can predict what it is going to be like, but cannot manage or change it as we don’t control the underlying elements. The same holds true trying to “manage” public cloud services.

So what do we do? Give up on public cloud services altogether? No, that would be throwing out the baby with the bathwater. Instead, we can follow a method we have been using in IT for a long time. If we cannot count on a certain item to be always available, we make sure we have a fail over option.

The best example comes from storage. At a certain moment, people realized that even the most expensive disks encountered failures now and then. So they developed a strategy where failure of an individual disk is not so important. The result was RAID, a redundant array of inexpensive disks that, transparently tot the user, served the requested data from other disks in the array when one of the disks failed. In typical IT fashion, we used the name RAID 0 for a configuration where we had no raid at all, RAID 2 for 2 disks etc. The benefit of higher raid numbers is is that the predicted availability increases significantly by adding marginally more redundant capacity.

How do we apply a similar “redundant array” approach to cloud services? The idea of contracting for two email services or two CRM systems is counter-intuitive for most IT folks, since for years we strived to standardize on one of each . And the reality is that if half the company uses one email system and the other half another, 50% of the people are still down if one fails. So instead of looking at email in isolation, we should look at all the employee communication options. These may include email, instant messaging , VOIP, even a social media functions similar to Facebook or Twitter. If based on different technologies and sourced from different vendors, the chances of them all being down at the same time is extremely unlikely.

Using chat or instant messaging as a backup for email is not how we traditionally think in IT---- and challenging such traditional thinking is exactly the idea of the Cloud Academy - but it aligns with the next generation of IT users. An example: Teenagers (like the two living in my home) instantly switch from MSN to Google chat or to Hyves or Facebook or even to hotmail or text messaging, if the service they are using is behaving strangely. They are not particularly interested in whether a particular service is down; their only interest is whether they can continue to communicate with their friends.

Of course, since today’s IT departments proactively monitor the infrastructure and know the status of systems, they rarely get a call saying “all systems are down.. But that’s not true with external cloud services. We need to find an alternative early- warning system, something like a weather report on the status of the external cloud services our user depend upon. An interesting site in this context is http://www.unifiedmonitoring.com/.

So what conclusions did we reach in our (sometime heated) Cloud Academy debate?

Using public cloud services is another step in giving up control of the underlying components. Years ago, when companies bought the first computers , they were expected to program these themselves in Assembler. Later, they bought higher- level language compilers, followed by complete off the shelf software packages followed now by infrastructure and software as a service. Along each step, IT has lost some control, but in exchange we are no longer required to do all the work.

We do, however ,have to make conscious decisions when to cede control. This differs by industry, type of application and possible risk. Using public cloud services in many cases already makes sense today. But when using them, we need to have some way to monitor availability and outcome so that we can make smart or pragmatic tradeoffs and precautions when the services are not available.

Read the original blog entry...

More Stories By Gregor Petri

Gregor Petri is a regular expert or keynote speaker at industry events throughout Europe and wrote the cloud primer “Shedding Light on Cloud Computing”. He was also a columnist at ITSM Portal, contributing author to the Dutch “Over Cloud Computing” book, member of the Computable expert panel and his LeanITmanager blog is syndicated across many sites worldwide. Gregor was named by Cloud Computing Journal as one of The Top 100 Bloggers on Cloud Computing.

Follow him on Twitter @GregorPetri or read his blog at blog.gregorpetri.com

IoT & Smart Cities Stories
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
To Really Work for Enterprises, MultiCloud Adoption Requires Far Better and Inclusive Cloud Monitoring and Cost Management … But How? Overwhelmingly, even as enterprises have adopted cloud computing and are expanding to multi-cloud computing, IT leaders remain concerned about how to monitor, manage and control costs across hybrid and multi-cloud deployments. It’s clear that traditional IT monitoring and management approaches, designed after all for on-premises data centers, are falling short in ...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...