We use a runbook template to document what processes occur automatically or on demand. Typically these events are either date-triggered or event-triggered. An example of a date-triggered process might be a scheduled email sent nightly at midnight. An example of an event-triggered process might be to send an email when any disk on a server… Continue reading Simple runbook template
Category: Templates
Working templates for business intelligence/decision support, collaborative decision making, IT operations, IT strategy, analytics, big data, machine learning, and natural language processing.
Fillable Hadoop reference architecture template for AWS clusters
Planning and Communicating Your Cluster Design When creating a new Amazon Web Services (AWS) hadoop cluster it is overwhelming for most people to put together a configuration plan or topology. Below is a Hadoop reference architecture template I’ve built that can be filled in that addresses the key aspects of planning, building, configuring, and communicating… Continue reading Fillable Hadoop reference architecture template for AWS clusters
A topology for a big data production environment
I’ve attached an excel file for a full-featured Big Data (hadoop) Production topology with a good starting place for an architecture that supports full Lambda architecture (streaming for seconds-old recency, batch for heavy lifting, and services to logically merge the two on demand). The cluster is composed of 21 AWS instances with EBS backing. The HDFS layer… Continue reading A topology for a big data production environment