Tuesday, January 31, 2012

Hadoop and MapReduce

Hadoop and MapReduce continue to pick up steam and generate "noise" in periodicals and online publications. As an Information Management Architect I get asked about the value of Hadoop and the impact to existing information and architecture roadmaps.

As such, a short entry to clarify the purpose of Hadoop, which I view as a complementary rather than a competing solution (assuming there is a majority of structured data to be managed) to addressing the need for highly distributed parallel cloud computing for unstructured and structured data in high volumes requiring fast performance. Thus the Yahoo, Facebook, and Google's of the world success stories and implementations.

Some of the drawbacks as of the day of this post include open-source components maturity & support (HDFS, HBASE, MapReduce, PIG, HIVE, AVRO, SQOOP, Chukwa, and Zookeeper), security, backup/recovery, integration to other systems, weak consistency, specialized resource skills/cost, and existing resource skills retraining.

Based on the expanding market, many of the enterprise Business Intelligence vendors (Informatica, SAP, etc..) are building plug-ins to ensure support of Hadoop in order to protect and expand their client base.

Thursday, November 18, 2010

ITIL in 30 days!

The month of November turned out to be a small detour from Information Management activities and very much in the weeds of IT governance as I lead the definition of an ITIL (Information Technology Infrastructure Library) initiative for my current client. Insane to think that anyone can do justice to, and actually implement ITIL in 30 days, right? My last run-in with ITIL at Cisco was as large of an initiative as they come.

Well, truth be told the current organization, much smaller in size, was already on board with ITIL as the preferred way to manage IT processes and practices. Furthermore, the initiative excluded the CMDB / technology implementation component. So in effect, we tackled IT governance under the ITIL framework and dug into documenting policies, processes, people (roles & responsibilities), and physical assets under management....on a shoestring. With a top down approach, tackling breadth first and depth as applicable, bi-weekly brainstorming and artifact review sessions, and management support of the initiative, we were able to create the executive overview, framework, documents, process charts, policies, RACIs, and publish the ITIL governance solution for corporate consumption…yes, within 30 days!

More emphasis (depth) was placed on Service Support (Incident Management & Service Desk, Problem Management, Change Management, Release & Deployment Management, Asset & Configuration Management) as well as Security Management, while Service Delivery (Service Level Management, Availability Management, Capacity Management, IT Financial Management, and IT Service Continuity Management) was framed so that internal resources can continue decomposition of processes, policies and responsibilities, without the need for help from outside consultants. To be fair, there is always more work that can be done, but implementing a structure, in quick fashion, that allows a client to continue execution independently is invaluable and very cost effective.

Now, ITIL might initially seem quite far from Architecture and Information Management; the heavy governance MDM initiatives however, overlap many of the same areas of interest that must be tackled (policy, procedures, roles, ownership, management support, executive sponsorship, metrics and reporting, knowledge management, etc...). Time well spend which should translate to cost savings due to reduction of issues and rework, as well as improved efficiency of operations; and all the "-ility" benefits of Service Delivery that come with ITIL.

It seems like December might include some time off to hit the slopes or visit Chicago with the family, so next entry will most likely be next year and who knows on what….the exciting life of consulting!

Thursday, March 4, 2010

SQL Server 2008 Master Data Services

Last week I installed SQL Server 2008 Enterprise R2 MDS customer, product, and chart of accounts sample domain models on a virtual x64 Windows Server 2008 sandbox. The same virtual houses Report Server for 2008 with Report Builder 3.0 and SQL Server 2005 with Report Services as well. Install was completed in minutes with no issues. Coincidentally, Report Builder 3.0 has had a make-over and seems more modular and flexible at first pass. Will be looking into report model migration since we are currently using Report Builder 2.0 at this client.

MDS did not strike me as the most intuitive tool to work with, and I did not find as much breadth as I would like. Jury is still out though, since this is the first release since the purchase of this product by Microsoft and I only had a limited amount of time to devote to this initial evaluation task. If anyone out there has success stories to share on MDS shoot me a note/link.

Time for zzzz's.

Wednesday, February 3, 2010

IBM to buy Initiate Systems

http://news.cnet.com/8301-27083_3-10446675-247.html

One more MDM consolidation. It will be interesting to see how MDM product lines get merged at IBM

Monday, September 21, 2009

Field Asset Services (FAS)

So the family is back from the annual Greek vacation (August) all happy and rejuvenated. I have started a short-term project with Field Asset Services (FAS) executing an Information Management Assessment which includes Master Data Management & Data Warehousing as well as helping out with the overall definition of the Enterprise Architecture Roadmap. Fun project and many familiar faces from prior project work.

Monday, July 20, 2009

Multidomain MDM for Business Success

http://www.information-management.com/specialreports/2009_153/mdm_master_data_management_analytics_manufacturing_marketing-10015747-1.html

Nice article by Marty Moseley of Initiate Systems on Multidomain MDM. The article provides real world examples and explains how multi-domain MDM adds value. I am pleased we are seeing more emphasis on multi-domain by the product vendors (Initiate has been a leader in the CDI space for a while now).

One comment on the following statement from the article:

"All data that flows through an enterprise can be categorized into six different types: who, what, when, where, how and why. Master data is about who, what, when and where. ...."

I would extend the definition of master data to include "how" and maybe "why". And to be clear I am still talking about entity and not transactional data. I view relations (intersections) across MDM domains which define the "how" as master data as well. Here are a few examples:
  • Hierarchies, define how like master data relates
  • Entitlements, define how customers and products relate
  • Pricing, defines how customers, products, and locations relate

I need to chew a little more on the classification of "why" as master data since not many real world examples of such master data does jumps out at me right away. Strategic business planning and metrics come to mind though, where information is very important from the executive and management levels through to the individual contributors, which I would make the case for inclusion as master data as well.

Monday, July 13, 2009

Dell

I was hired as a Senior MDM Consultant/Architect by Dell in late 2008 under the Information Management & Architecture group to provide MDM expertise and consulting services. Under confidentiality and non-disclosure I am unable to provide any details about my engagement which completed in July of 2009 (yes, time again for the annual trip to Greece). What I can do is provide a summary of references I found while searching Google which provide the reader potentially relevant landscape information through existing public information.


September 2007 - a reference from Dell on Financial MDM initiative and the use of SOA on the Oracle site. http://www.oracle.com/appserver/business-intelligence/docs/financial-mdm-at-dell.pdf

2008 – a reference on The MDM Institute (Aaron Zornes) showing Dell as a customer of Initiate Systems.
http://www.tcdii.com/initiatesystemsidentityhub.html

December 2008 - a reference on Dell’s CDI initiative from the Gartner MDM Summit presented by John Miller and summarized by Jill Dyche http://www.beyenetwork.be/blogs/dyche/archives/2008/12/dell_does_mdm_r.php

June 2009 - a reference from Oracle in their MDM Executive brief showing Dell as a client. http://www.oracle.com/master-data-management/master-data-management-executive-brief.pdf

June 2009 – multiple recruiting site references for talent acquisition around Master Data Management Enablement and Data Services utilizing AquaLogic Service Bus - ALSB (now: Oracle Service Bus - OSB) and Aqualogic Data Services Platform - ALDSP (now: Oracle Data Services Integrator - ODSI)
http://jobs.monsterindia.com/details/6991360.html http://jobs.monsterindia.com/details/7103559.html?sig=js-1-e8a98fc9f01d868eec37e666f84bf6cf-1 http://www.recruit.net/jobs/1243504796491/ http://www.careerenclave.com/jobs/index.php?topic=43392.msg%msg_id%


I thank everyone at Dell for the project opportunity and worthwhile experience. Our paths might cross again in the future since the Austin MDM market is not THAT large ;-).