Enterprise Information Meets the Digital Universe

During his opening EMC World keynote presentation, Joe Tucci talked about how enterprise information is dwarfed by data being created in the “digital universe” – outside the four walls of the organization. According to the IDC Digital Universe study sponsored by EMC, this data is growing at an astounding rate of more than 5,000 petabytes per day, and 80% of it is non-enterprise generated.

Enterprise Info Meets Digital UniverseWe also heard at the Data Science Summit that leading organizations are aggressively enhancing their enterprise information (structured ERP, CRM, POS data and unstructured consumer comments, emails, physician notes, claims descriptions) with information in the digital universe (social media, mobile, and machine-generated data) to create new products and services for their customers.

What really caught my attention was that while enterprise information provides an “internal” perspective on the business, the digital universe information provides an “outside-in” perspective on the business. Integrating enterprise information with the digital universe information provides unique, and in many cases higher-fidelity insights about your customers, products, markets, and competitors that can materially improve the organization’s value creation processes.

Digital Universe Data And An Outside-In Perspective On The Business

The Digital Universe information can also provide new insights into your internal operations to ensure that you are focused on building the right core competencies; that is, those competencies that drive business value and competitive advantage. Why optimize internal processes that have no value to your customers, partners, or markets?

The table below highlights some of the differences enabled between enterprise information and digital universe information.

Enterprise Information Digital Universe Information
Inside-out perspective Outside-in perspective
React to market opportunities Create market opportunities
Quick follower First mover
Marginal improvements (5%) Magnitude improvements (5x)
Data management Data monetization

The Digital Universe Information Challenges

Working with digital universe information poses some unique and difficult data management and analytic challenges, including:

  • Separating the information from the noise. There is lots of data being generated in the digital universe, but the vast majority of that data is only noise. Considerable thought and effort will be required in identifying which of that data is actually usable.
  • Getting comfortable with working with “good enough” data. The digital universe information contains lots of sporadic, incomplete, and sometimes inaccurate activities. But even within this “flawed” information, there are lots of valuable insights about your customers and market trends that can be monetized or help to make better business decisions.
  • Identifying the metrics that are the best predictors of performance. Building off of the “Moneyball” learnings, the digital universe information is a rich source of new metrics, only some of which will be better predictors of performance. Understanding your organization’s business initiatives will be key in determining which of these new metrics will actually be better predictors of performance.
  • Beware of false positives. Statistical models come with natural modeling biases (Type I and Type II errors). We need to help the business users understand the impact of these Type I and Type II errors on their business decisions. One cannot just make decisions blindly off of the analytic models without giving consideration to what’s reasonable from a business, or human, perspective.

Summary

Information outside the enterprise in the digital universe holds the potential to transform how companies analyze and value their businesses. Digital universe information yields insights on customers, partners, products, markets, and competitors that just cannot be gleaned from internal data sources. And this information can change the very nature of how companies and industries compete.

Big Data Transforms BusinessDigital universe information provides invaluable insights into your customers’ interests, passions, affiliations, and associations that can dramatically improve your customer acquisition, maturation, and retention lifecycle. It provides measurable insights on partners’ performance and behavioral trends that can improve your supply chain and inventory effectiveness. And it provides actionable insights on market trends and directions, and competitors’ behaviors and tendencies that can be used to drive competitive advantage.

Bill Schmarzo

About the Author: Bill Schmarzo

Bill Schmarzo is the Customer Advocate for Data Management Innovation at Dell Technologies. He is currently part of Dell Technology’s core data management leadership team, where he is responsible for spearheading customer co-creation engagement to identify and prioritize the customers' key data management, data science, and data monetization requirements. Bill is the former Chief Innovation Officer at Hitachi Vantara where he was responsible for driving Hitachi Vantara’s Data Science and “co-creation” efforts. Bill also has served as CTO at Dell EMC where he formulated the company’s Big Data Practice strategy, identified target markets, developed solution frameworks, and led Analytics client engagements. As the VP of Analytics at Yahoo, Bill delivered the analytics tools and applications that optimized customers’ online marketing spend. Bill is the author of four books and is currently an Adjunct Professor at Menlo College, an Honorary Professor at the University of Ireland – Galway, and an Executive Fellow at the University of San Francisco, School of Management. Bill holds a Master of Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.