The Future of Enterprise IT: Tasks & Tools vs. Command & Control

In the past 7 months CAN has expanded from 4 to 20 employees.  We have always been focused on providing our employees with the tools they need to accomplish their tasks.  We want them to love working and helping other people work smart.
As I plan for CAN’s growth I have been having a lot of conversations about CAN’s IT strategy with vendors and employees.  I have come to realize that a conversation about technology is a conversation about how people work, and that Traditional Enterprise IT doesn’t understand the future of work. (more…)

Formula 1 and Predictive Analytics

A couple weeks ago, I discussed the use of predictive analytics in the transportation industry, specifically the use of acoustic bearing monitors to predict bearing failures on Union Pacific freight trains. Today the conversation turns to predictive analytics in a very different type of transportation, Formula One (F1) racing. Download our Case Study on Mechanical Failure and Predictive Analytics.
F1 is to many the pinnacle of motor sports. F1 has the most technologically advanced cars, the most skilled drivers (some compensated $50+ million per year), the most exotic race locations, and yes, the most beautiful paddock girls. Formula One is a closely sanctioned “space race” creating and refining innovative and ground breaking technologies including traction control, anti-lock brakes, direct injection, synthetic oil, kinetic energy recovery systems (KERS), carbon fiber, and computational fluid dynamics (CFD). Many advancements made in technology by F1 teams have contributed to the efficiency and safety of everyday vehicles. (more…)

New Pew Survey on Big Data | Big Data is the new Oil | 'Minority Report' software hits the real world

Why data trumps experience in trial conversion: “Using predictive analytics to qualify trial users and focus on those that are most likely to convert can double conversion rates. In a 2012 study, the Aberdeen Group published a finding that companies using predictive analytics have a 73% sales lift versus companies that did not. … Publishers should use predictive analytics to develop trial scoring rules. These scoring rules can constantly prioritize trials in their likeliness to convert which increases close rates and sales productivity. These same predictive analytics are useful in design of trial parameters such as length and access limits.” (Business Insider) http://goo.gl/6P95I
Connect Big Data With Customer Behavior to Improve Social, Email, and Web ROI: “Since we have lots of data, we have lots of integration challenges. … Mastering that flow of data between the places that generate it (click-stream, communities, sentiment analysis, email and SMS messaging, and portals) and the systems that utilize it (marketing automation, messaging delivery, and social publishing) is creating complexity, as well as opportunity.” (more…)

What Is Data?

We get asked all the time at CAN “what is data?”  “Data” is a term to describe facts, processes, or events that are able to be recorded and measured. Whether descriptive or quantitative, nearly anything can be converted into data. Facebook profiles, sales numbers, interest rates, zip codes, twitter tweets, emails, DNA sequences, and flight tracking information are all examples of data – and we have a lot of it. Data is collected from many different places, and while humans can collect data, machines and technology can collect far more and do it quicker. Computing systems are designed to collect massive amounts of data on the processes they observe or facilitate, yet most of this is never used. Data sits idle because no one has figured how to use it. Technology on the processing side and collecting side have nearly caught up and this is starting to make all the difference.
Thanks to these advances in computer processing power and storage capacity, 90% of the data available to humankind were nonexistent 2 years ago. Think about that for a minute. In other words, data are this age’s most abundant raw material. (more…)

How Big Data Can Bring Big Sales / Insurance Industry See Vanlue in Analytics

How Big Data Can Bring Big Sales: The holy grail of retail has been to anticipate what consumers need even before they realize they need it. … Take printer cartridges, for example. There’s nothing worse than having to print a boarding pass with the taxi waiting outside and realizing you’re out of ink. Today, office supply retailers are able to track purchases of customers’ in-store credit cards and rewards cards and, based on purchase history, anticipate when a consumer might need to reorder a product. Marketing can send an email offer for printer cartridges as well as an accompanying promotion for paper, with a guaranteed delivery time of 24 hours. (ZDNet) http://goo.gl/grqOZ
 
Massachusetts Big Data Initiative: The initiative will lead to a grants-matching program for research and development into big data, create internships, and launch the Massachusetts Big Data Consortium. That group will bring together academia, industry, and government to foster new big data tools and technologies. And [Governor Deval] Patrick has tasked the Commonwealth to work with the consortium ‘to see how data analytics and applications can help improve the efficiency and effectiveness of government programs and services.’” (IT World) http://goo.gl/mr4x8
— “Chief among the initiatives is MIT’s new big data research center, known as bigdata(at)CSAIL, which will be run out of the school’s Computer Science and Artificial Intelligence Laboratory. The center will focus on data collections that are too big for current information technology systems and will call on industry, government and academic leaders to develop techniques to process, share, store and manage the large amount of data.” (AP) http://goo.gl/TZJJo
 
Data Driven Knowledge vs. Expert Knowledge: “…data-driven knowledge, as its name suggests, is based upon data—usually, lots of it. A few decades ago, a series of statistical techniques emerged with the intent of uncovering data patterns typically hidden to the human eye. Given that we capture data in an ever-increasing volume today, these techniques are proving indispensable to extracting value from data, making processes repeatable and accurate.”
–“The movie Moneyball exemplifies that really well. In the movie, a group of experienced recruiting agents offer their first-hand knowledge and hunches on which players should be pursued to be part of the team. That is contrasted with a data-driven approach in which knowledge is extracted from the data already available for each player, and a team assembled from that. Although Moneyball chooses one type of knowledge over another, in most cases, we should and do use expert knowledge and data-driven knowledge together.” (Smart Data Collective) http://goo.gl/OGBcL
 
Salesforce Intros Radian6 Insights for Social Big Data: “Acquired roughly 18 months ago, Radian6 is now expanding with this new platform to tackle sentiments, intents, demographics and more key metrics found within the most commonly used social media channels. The idea is to then convey this information in a way that will better enable business customers to optimize their marketing, customer service, and lead techniques.” (ZDNet) http://goo.gl/OZSXI
 
Top 10 Categories For Big Data Sources and Mining Technologies: “Since every answer will be different, this means there’s no one-size-fits-all solution. Success lies in recognizing the different types of Big Data sources, using the proper mining technologies to find the treasure within each type, and then integrating and presenting those new insights appropriately according to your unique goals, to enable your organization to make more effective steering decisions.” See the top 10 list here (ZDNet)
 
Insurance Industry See Vanlue in Analytics: “‘Insurers are investing in analytics, with the survey showing that North American insurers spend about nine percent of their IT budgets on data and analytics,’ says Mark Breading, partner with SMA. ‘What is even more interesting is that business units outside of IT are spending approximately the same amount. All together this represents almost $10 billion in spending each year.'” (Property Casualty 360) http://goo.gl/5X4si

Diapers VS Beer image

Diapers, Beer, and Data Science in Retail

When asked for white papers or case studies on how predictive analytics works, I often give a few stories on how different industries use analytics to find patterns in their data and then apply that knowledge to their existing data to predict what future trends are going to happen. Learn about how we applied predictive analytics to politics. 

I get asked specifically about legends that roam the retail world:  the study that found that milk is the most purchased item so it is always in the back of the store, making you walk by everything thing else they have before you get there, the fact that women’s shoes are always on the way to men’s clothes, and the fact that bananas are at the front of stores because they are found to be an impulse buy.  The one that seems to get the most requests though is the one that men who buy diapers for their kids are most likely to have beer also in their carts.

It doesn’t seem that far-fetched. (more…)

Big Data In The Travel Industry and More

How To Make The Most Of ‘Big Data’ In The Travel Industry: “There is a ‘big data’ revolution underway in the travel and hospitality industry but travel companies need to be clear about the challenges. … Data analytics is an interesting prospect for the travel sector as so many data streams can be combined. … Business analytics pulls insights from vast databases commonly referred to as ‘big data’. To be successful and maximise the value of this, firms need to be very focused and disciplined.”
— As firms plan to take the plunge, here are some expert recommendations: “Focus on areas where an impact can be made … Understand how to engage with consumers more efficiently … Identify patterns that can lead to insights around consumer acquisition, retention and marketing.” (Hospitality Net) http://goo.gl/Q7dwU
 
“Business analytics should itself be adaptive and regularly refined by new data that users feed back into the system as that is the whole purpose of predictive modeling…” [Brenda] Dietrich explained that data analysis allows companies to extrapolate outcomes linearly and decide what appropriate action to take next. Those actions also generate new data, which should be fed back into the analytics model so it is continuously refined, improved, and accurate, she said. …This notion of constantly ‘learning from the data’ is a new and exciting development in the analytics space, because it means a company can see, as time progresses in reality, whether it is moving toward X or Y, and decide the next step it should take, she said.” (ZDNet) http://goo.gl/23kaW
 
“Why is data science relevant?” “Benjamin Franklin is alleged to have said in response to the questioning of the value of the first hot air balloons, ‘What is the value of a newborn baby?’ Actually, data science is probably a long way from the newborn baby stage, although it still has a long way to go before it achieves full maturity.” (Network Computing) http://goo.gl/QdvJ3
 
Dell Provides Schools and Universities with Predictive Analytics: Schools and universities are turning to Dell’s Education Data Management (EDM) solution, a decision support system, to help personalize student learning, increase retention and graduation rates while improving planning, management and reporting. The solution integrates student performance and operational data with predictive analytics to help educators monitor student progress and intervene when needed to improve success. It tracks each student’s data between schools and over multiple years to help parents and educators monitor student progress and respond to developmental needs or hone in on specific interests and aptitudes. (EON) http://goo.gl/hE3y1
 
The Hadoop bone’s connected to the SQL bone: “Microsoft has been working with Hortonworks to build a distribution of Hadoop for Windows Azure, its cloud platform, and for Windows Server.  Right now the service is available as a cloud service in a by-invitation beta that just entered its third release.  … Why would Microsoft be so bullish on technology that is open source, Java-based and largely Linux-facing in pedigree? Most likely it’s because Microsoft runs Bing. By some counts, Bing and Yahoo Search (which is Bing-powered) together have about 30% search market share and Turner announced in his keynote that Bing is now leading Google in search relevance. (ZDNet) http://goo.gl/e8k3N
 
Adding Second-Tier analysis To Harness Big Data: The real challenge with Big Data is in going from individual siloes of data analytics to a bigger picture that successfully and meaningfully puts those analytics into the full-enterprise context. It’s how we map these analytical islands to each other that ultimately provides the support we need for improved quality in our decisions. … It is important that business and operational metrics be aligned to improve decisions and help ensure business survivability.
— A useful second-tier analysis effectively describes key business functions or processes and business assets, and then correlates operational reports and metrics to them. For example, linking accounts receivable to technology assets to operational practices and metrics can help expose significant enterprise risk. (SC Magazine) http://goo.gl/mPXg7

Union Pacific Railroad Predictive Analytics

For most, seeing a Union Pacific diesel-electric locomotive painted in the historic Armour Yellow, Signal Red, and Harbor Mist Gray does not bring predictive analytics to mind. However, the largest railroad network in the United States is showing the effectiveness of analyzing non-conventional data forms to increase operational efficiency.
Applications in industries including financial services, insurance, retail, and healthcare are what commonly come to mind when discussing predictive analytics. Thinking outside the box, Union Pacific is currently using bearing acoustic monitors to identify faulty or failing bearings on trains. The acoustic detectors have been used for years, but enough data has now been collected to show the correlation between failing bearings and certain frequency spectrums. This correlation has been applied to real time acoustic readings to help predict bearing failures and ultimately decrease derailments and costly train delays. Download our Case Study on Mechanical Failure and Predictive Analytics(more…)

Forbes: The Age of Big Data / A Looming Talent Gap For Data Scientists / Why Companies Are Spending More on Analytics

The Age of Big Data: “…Big Data has the potential to utterly transform the relationship that individuals have with institutions, customers with companies, patients with the healthcare system, students with universities, and voters with government. And that means once it has fully penetrated society and industry, the Big Data revolution may very well prove a turning point in our economic – and ultimately, cultural – history as great as the electronics revolution. . . perhaps even as great as the first and second Industrial Revolutions.”
–“Why? Because once the relationship of individuals to institutions transforms, the benefits to the individual consumer, citizen, patient and student will be profound.” (Forbes) http://goo.gl/kxAlq
 
How a Looming Talent Gap Will Crush Enterprise Hopes for Big Data: “’A lot of companies don’t know how to find data scientists, and don’t understand data science,’ … ‘These enterprise companies can’t implement a proper data analytical solution because they have no data talent.'”
— “Part of the problem is an overall lack of big data skills in the United States. In May 2011, the McKinsey Global Institute laid out the numbers: ‘By 2018, the United States alone could face a shortage of 140,000 to 190,000 people with deep analytical skills as well as 1.5 million managers and analysts with the know-how to use the analysis of big data to make effective decisions.’” (ReadWriteWeb) http://goo.gl/SQqyS
 
Big Data Security Is Inevitable: “There’s been a fair amount of discussion about the fact that security analytics is becoming a big data problem. … If you think that enterprises recognize these trends, boning up on Hadoop, Cassandra, and NoSQL, and hiring data scientists to tag along with security analysts, think again.  There’s a growing security skills shortage that will preclude these activities before they even start.(Network Worlds) http://goo.gl/tME2c
 
Big Data Holds Big Promise for Government: “Big data has the potential to transform the work of government agencies, unlocking advancements in efficiency, the speed and accuracy of decisions and the capability to forecast, according to a separate report from MeriTalk.”
–“…the Centre for Advanced Spatial Analysis (CASA) at University College London is combining data from London’s Oyster cards – used to pay for public transport – and Twitter messages. Tube-travel patterns are regular: people who enter the system at one station tend to leave it at a particular other one. Twitter messages reveal a city’s structure and its activity.” (Smart Data Collective) http://goo.gl/aqokm
 
Why are companies spending more on analytics despite cutbacks elsewhere? “Analyst Dan Vesset, author of IDC’s “Worldwide Business Analytics Software” report, credits ‘attention-grabbing headlines’ about big data, rather than the data stockpiles themselves, with helping to put business analytics on the agenda of senior executives. Goodnight seems equally dubious, saying big data is the hot new topic ‘because people got tired of talking about the cloud.'” (InformationWeek) http://goo.gl/feQ2o

Analytics Market Grows in 2012

Analytics Market Grows in 2012

“The global market for business analytics software grew roughly 14 percent in 2011, fueled by pervasive hype about ‘big data’ as well as new technological innovations, according to a report unveiled by analyst firm IDC yesterday. Between now and 2016, the business analytics market will have a compound annual growth rate of 9.8 percent, reaching US$50.7 billion, IDC said.” (Global Financial Network) http://goo.gl/HL4qA
— “As part of that overall business analytics segment, the data warehousing platform software portion represented the fastest growth, at 15.2 percent in 2011 compared with 2010. IDC also pegged analytic application growth at 13.3 percent last year from 2010, and BI and analytic tools at 13.2 percent last year from 2010.” (Information Management) http://goo.gl/FTX8Y (more…)

Featured Posts – Click the Brain
Archives
CAN Jewels