
Business Architecture, Enterprise Architecture (EA), Information Management, Master Data Management (MDM), Customer Data Integration (CDI), Product Information Management (PIM), MDM Enablement, Service Oriented Architecture (SOA), Enterprise Data Services, Information as a Service (IaaS), Cloud Computing, In Memory Databases (IMDB), Data Warehousing and Business Intelligence (BI).
Monday, July 18, 2016
AT&T Cloud Business Intelligence Project

Thursday, November 1, 2012
Master Data Management (MDM) Landscape
![]() |
| yeah, yeah, reusing the same picture...it is MDM time again! (and I don't mean Mobile Device Management) |
- Market Consolidation (see mega vendors below)
- Tool Convergence (aka: multi-entity, multi-domain...yep called this 4 years ago)
- BPM for MDM (more governance automation as expected)
- Data Virtualization / MDM as a Service (have been writing about the MDM SOA intersection since 2007)
- Data Quality as a Service
- Address standardization / cleansing
- Cleanse/Dedup/Merge across multiple Salesforce installations in the cloud
- Data Profiling as a Service
- IMDBs & Big Data (see two prior posts on in memory databases)
- Forrester trends blog here: http://blogs.forrester.com/rob_karel/12-01-05-mdm_in_2012_what_was_what_will_be_and_what_wont_be
MDM mega vendors (and their associated product offerings)
- IBM
- InfoSphere MDM Server (formerly DWL and Trigo)
- Initiate Master Data Service (formerly Initiate)
- Informatica
- MDM (formerly Siperian)
- Oracle
- Customer, Product, Supplier, and Site Hubs (Oracle and Siebel)
- Data Relationship Management (formerly Hyperion)
- SAP
- NetWeaver MDM
- 2012 MDM (customer data solutions):
IBM, Oracle, Informatica - 2012 Data Integration:
Informatica, IBM, SAP, Oracle, SAS - 2012 Data Quality: Informatica, SAS, Trillium, IBM, SAP
- 2011 MDM (customer data solutions): IBM, Oracle, Informatica
- 2011 Data Integration: Informatica, IBM, SAP, Oracle, SAS
- 2011 Data Quality: SAS, Informatica, Trillium, IBM, SAP
According to Forrester, Informatica (Siperian) is the MDM leader followed by IBM (Initiate Systems), and per link below, the same two players are leading on data virtualization.
- http://blogs.forrester.com/business_process/2010/01/introducing-the-mdm-markets-newest-800lb-gorilla-informatica-acquires-siperian.html
- http://www.informatica.com/us/company/news-and-events-calendar/press-releases/01092012_forrester_data_virtualization_wave.aspx
Without having a personal preference on a specific technology (have an IBM / Initiate Systems certification and experience with Siperian and Oracle PIM) it seems that Informatica is moving towards taking the gold here, and (somewhat) coincidentally it will be the product of choice for my next CDI POC to concentrate on hierarchy management, data stewardship and data governance. Below are a few more Informatica reference links supporting leadership claims:
- http://globenewswire.com/news-release/2012/10/23/499182/10009539/en/Informatica-Positioned-in-Leaders-Quadrant-in-2012-Master-Data-Management-of-Customer-Data-Solutions-Report.html
- http://www.information-management.com/blogs/master_data_management_mdm_siperian_informatica-10017071-1.html
- http://www.informatica.com/Images/03031_7159_enable-business-agility-mdm-tech.pdf
Nice to see how far Informatica has come from the old ETL days over a decade ago...
John K
Wednesday, October 10, 2012
Starting with SAP HANA
And here is the link for developers "The Road to HANA" with great information to get you going: http://scn.sap.com/docs/DOC-31723
Happy in-memory computing!
John K.
Tuesday, October 9, 2012
IMDBs (In Memory Databases) gaining popularity
- Memory vs disk as primary storage (much faster performance)
- Column and row store vs tables (no indices, materialized views, or cubes - aggregations on the fly)
- Data compression
- Parallelism (both on hardware and processing)
- SAP HANA (to be merged in the future with Sybase IQ offering). Is the leader in the enterprise space. I am involved with an SAP HANA POC/Pilot to be compared vs a traditional DW and fully expect the IMDB to easily outperform the traditional system. Noteworthy that SAP HANA comes as an appliance (option of leading HW vendors) and only with certified configurations by SAP.
- Oracle TimesTen / Exadata X3
- IBM Solid DB (noteworthy that IBM is selling HW bundled with SAP HANA)
- Microsoft (updated per announcement on Oct 24th 2012)
- Microsoft HDInsight Server for Windows
- HDInsight Server for Windows connects to Microsoft SQL Server, Microsoft Excel, PowerPivot (for high-scale in-memory data exploration), Power View (data visualizatio) and works with Microsoft's virtualization platform. Microsoft is the first to deliver Hadoop on virtualized infrastructure. Office 2013 Excel includes: PowerPivot and Power View.
- http://www.informationweek.com/software/information-management/microsoft-releases-hadoop-on-windows/240009632
- Opensource
- Project Serengeti is an open-source effort that is coming right behind Microsoft from VMWare
- MySQL, other smaller players here
- Feedback welcome on opensource IMDB enterprise solutions you have had success with
- IMDBs Overview: http://en.wikipedia.org/wiki/In-memory_database
- Rise of IMDBs http://slashdot.org/topic/datacenter/the-rise-of-in-memory-databases/
- IMDB Q and A: http://www.mcobject.com/in_memory_database
- Comparison of IBM Solid DB vs Oracle TimesTen http://bigdatamatters.com/bigdatamatters/2009/12/oracle_ibm_database_comparison.html
Tuesday, January 31, 2012
Hadoop and MapReduce
As such, a short entry to clarify the purpose of Hadoop, which I view as a complementary rather than a competing solution (assuming there is a majority of structured data to be managed) to addressing the need for highly distributed parallel cloud computing for unstructured and structured data in high volumes requiring fast performance. Thus the Yahoo, Facebook, and Google's of the world success stories and implementations.
Some of the drawbacks as of the day of this post include open-source components maturity & support (HDFS, HBASE, MapReduce, PIG, HIVE, AVRO, SQOOP, Chukwa, and Zookeeper), security, backup/recovery, integration to other systems, weak consistency, specialized resource skills/cost, and existing resource skills retraining.
Based on the expanding market, many of the enterprise Business Intelligence vendors (Informatica, SAP, etc..) are building plug-ins to ensure support of Hadoop in order to protect and expand their client base.
Thursday, November 18, 2010
ITIL in 30 days!
Well, truth be told the current organization, much smaller in size, was already on board with ITIL as the preferred way to manage IT processes and practices. Furthermore, the initiative excluded the CMDB / technology implementation component. So in effect, we tackled IT governance under the ITIL framework and dug into documenting policies, processes, people (roles & responsibilities), and physical assets under management....on a shoestring. With a top down approach, tackling breadth first and depth as applicable, bi-weekly brainstorming and artifact review sessions, and management support of the initiative, we were able to create the executive overview, framework, documents, process charts, policies, RACIs, and publish the ITIL governance solution for corporate consumption…yes, within 30 days!
More emphasis (depth) was placed on Service Support (Incident Management & Service Desk, Problem Management, Change Management, Release & Deployment Management, Asset & Configuration Management) as well as Security Management, while Service Delivery (Service Level Management, Availability Management, Capacity Management, IT Financial Management, and IT Service Continuity Management) was framed so that internal resources can continue decomposition of processes, policies and responsibilities, without the need for help from outside consultants. To be fair, there is always more work that can be done, but implementing a structure, in quick fashion, that allows a client to continue execution independently is invaluable and very cost effective.
Now, ITIL might initially seem quite far from Architecture and Information Management; the heavy governance MDM initiatives however, overlap many of the same areas of interest that must be tackled (policy, procedures, roles, ownership, management support, executive sponsorship, metrics and reporting, knowledge management, etc...). Time well spend which should translate to cost savings due to reduction of issues and rework, as well as improved efficiency of operations; and all the "-ility" benefits of Service Delivery that come with ITIL.
It seems like December might include some time off to hit the slopes or visit Chicago with the family, so next entry will most likely be next year and who knows on what….the exciting life of consulting!
Thursday, March 4, 2010
SQL Server 2008 Master Data Services
MDS did not strike me as the most intuitive tool to work with, and I did not find as much breadth as I would like. Jury is still out though, since this is the first release since the purchase of this product by Microsoft and I only had a limited amount of time to devote to this initial evaluation task. If anyone out there has success stories to share on MDS shoot me a note/link.
Time for zzzz's.
Wednesday, February 3, 2010
IBM to buy Initiate Systems
One more MDM consolidation. It will be interesting to see how MDM product lines get merged at IBM
Monday, September 21, 2009
Field Asset Services (FAS)
Monday, July 20, 2009
Multidomain MDM for Business Success
Nice article by Marty Moseley of Initiate Systems on Multidomain MDM. The article provides real world examples and explains how multi-domain MDM adds value. I am pleased we are seeing more emphasis on multi-domain by the product vendors (Initiate has been a leader in the CDI space for a while now).
One comment on the following statement from the article:
"All data that flows through an enterprise can be categorized into six different types: who, what, when, where, how and why. Master data is about who, what, when and where. ...."
I would extend the definition of master data to include "how" and maybe "why". And to be clear I am still talking about entity and not transactional data. I view relations (intersections) across MDM domains which define the "how" as master data as well. Here are a few examples:
- Hierarchies, define how like master data relates
- Entitlements, define how customers and products relate
- Pricing, defines how customers, products, and locations relate
I need to chew a little more on the classification of "why" as master data since not many real world examples of such master data does jumps out at me right away. Strategic business planning and metrics come to mind though, where information is very important from the executive and management levels through to the individual contributors, which I would make the case for inclusion as master data as well.
Monday, July 13, 2009
Dell
September 2007 - a reference from Dell on Financial MDM initiative and the use of SOA on the Oracle site. http://www.oracle.com/appserver/business-intelligence/docs/financial-mdm-at-dell.pdf
2008 – a reference on The MDM Institute (Aaron Zornes) showing Dell as a customer of Initiate Systems.
http://www.tcdii.com/initiatesystemsidentityhub.html
December 2008 - a reference on Dell’s CDI initiative from the Gartner MDM Summit presented by John Miller and summarized by Jill Dyche http://www.beyenetwork.be/blogs/dyche/archives/2008/12/dell_does_mdm_r.php
June 2009 - a reference from Oracle in their MDM Executive brief showing Dell as a client. http://www.oracle.com/master-data-management/master-data-management-executive-brief.pdf
June 2009 – multiple recruiting site references for talent acquisition around Master Data Management Enablement and Data Services utilizing AquaLogic Service Bus - ALSB (now: Oracle Service Bus - OSB) and Aqualogic Data Services Platform - ALDSP (now: Oracle Data Services Integrator - ODSI)
http://jobs.monsterindia.com/details/6991360.html http://jobs.monsterindia.com/details/7103559.html?sig=js-1-e8a98fc9f01d868eec37e666f84bf6cf-1 http://www.recruit.net/jobs/1243504796491/ http://www.careerenclave.com/jobs/index.php?topic=43392.msg%msg_id%
I thank everyone at Dell for the project opportunity and worthwhile experience. Our paths might cross again in the future since the Austin MDM market is not THAT large ;-).
Wednesday, July 1, 2009
Multi-Domain MDM
If you attended conferences on MDM since late 2008, you might have noticed that most product vendors either already support (say they support) or are moving towards supporting multi-entity MDM. To be honest, very few vendors are close to mature multi-entity MDM as of early 2009; the direction however is clear. Most engagements I have worked on to-date involved multiple MDM domains and I foresee this continuing in the future. With multiple domains comes the need for MDM enablement which was introduced in a prior blog. Since MDM enablement involves commonalities across domains, there is more emphasis and need for enablement under the centralized MDM style / architectural pattern.
Which reminds me, there has been a slight change of terminology on MDM architectural styles as presented by Gartner on the November 2008 MDM conference. The table below shows the change (green replacing red) and consolidates/aligns the Gartner terms to the ones from IBM's and my first article on MDM which can be found under the links area.

(end of parenthesis)
"Multi-style MDM to increase.Through 2009 and 2010, Global 5000 enterprises will broaden their MDM business initiatives from single-use case, single entity to multi-style, multi-entity uses"
Aaron Zornes, founder and chief research officer, MDM Institute.
"I have seen positive momentum towards multi-data-domain operational MDM solutions."
Rob Karel, MDM analyst, Forrester.
"By 2012, more than 65% of Global 2000 organizations will deploy two or more domain-specific, MDM-supporting technologies that start out as specific business requirements but become part of a larger MDM initiative."
Andrew White, Research VP, Gartner Inc.
Wednesday, June 17, 2009
Multi-Entity MDM Enablement
The charter of MDM enablement is to identify common assets (people, information, processes, practices, policies, services, tools and technologies) across MDM domains (customer, product, service, employee), and to promote standardization and harmonization of such assets in order to maximize re-use, efficiency, effectiveness and value to the organization.
MDM enablement is sub-divided into logical groupings powered by people & groups who provide common processes & practices through the use of standardized tools & technology. Sample MDM enabler areas are depicted in the diagram below.
MDM enablement has been proven to reduce costs through asset re-use and IT simplification. Some examples of savings include: reduced product licensing, standardized integration, legacy system retirement, infrastructure simplification, streamlined development & support, simplified governance, and reduced training costs. (An article on MDM Enablement is currently in the works).


