Automation and Big Data Initiatives
Overview:
Self-service analytics software has been one of the trends in software development for some time. Conceptually, there is not much novelty about it, though. Self-service as a concept has already been applied to fast food joints, financial services and other industries and the software domain is just customizing it according to its unique needs. Self-service analytics is specifically aimed at business users who need to easily manipulate data and create analytics without having to depend on technically qualified data personnel such as data scientists. There is this belief that self-service analytics are going to reduce dependence on data scientists. There is also this group of experts that believe that the absolute passing of analytics in the hands of business users can compromise governance and business users need quality training. Both views have substance. While the forecasts on the self-service analytics market are positive, it is important to train users to use the software properly. There is a lot of scope for business users to learn such software tools.
Also read – The Escalating Scope of Big Data Analytics
What is self-service in the context of big data and Business Intelligence (BI)?
Think of this use case: In an organization, the customer or market-facing personnel depend hugely on data to make decisions. Now, obtaining customized analytics is not easy because the data volume is huge and comes from multiple sources, it takes specific skills to manipulate data and generate analytics in an understandable format. So, data scientists and other technical people need to be involved. This creates a lot of problems. For example, the bandwidth of the technical personnel and data scientists is divided, too much dependence on technical personnel may delay obtaining analytics which may hamper decision making. This problem could be solved by empowering the business users. The business users will be equipped to manipulate data and generate custom reports. Now we are talking about self-service. Self-service in the context of big data and BI is the ability of business users to manipulate and generate analytics as per needs. Business users are independently generating reports just like the self-service concept in a fast food outlet. Of course, before such users can generate reports, the data have to be collected, processed and converted into a certain format which is not the responsibility of the business users. Self-service has many advantages as well as disadvantages. But a lot of self service products are now available in the market focused on the business users. These products have certain features in common: intuitive and friendly user interface, customized report generation, and business terminologies. It is assumed that such products have built-in capabilities to accept, mine and process big data without requiring the business user’s participation. So, you can say that self-service software has addressed the use case of empowering business users by reducing (but not eliminating) the dependency on technical personnel. According to the Forrester Research Inc consultancy, only 20% of the requests to generate reports and queries should be sent to the BI team or the IT department.
Also read – Is big data influencing crowd funding industry?
Advantages of self service
As might already be obvious, the main advantage of having self service software is the independence it offers to the business users. The users do not need to depend on the BI team or the IT department for running queries or generating reports. This also frees up the technical personnel to focus on other important assignments. Since the business users are able to independently create custom reports and analytics, they are able to find insights and take important decisions more quickly. According to James Foster, general manager of Southeast Asia for Solutions On Demand and high-performance computing at SAS, “As such, it can only be a good thing to have more decision-making capability embedded in the lines of business,” he said. “Plus, the shift to self-service also has a positive effect on IT, freeing them to think more strategically and focus on value-added activities for the company rather than just ‘keeping the lights on’.”
Also read – Exploring Big Data and Self-Service Analytics
Challenges with self service
The self-service model is based on empowering the business users to query and generate analytics while the BI team and the IT department take care of the backend systems and data integration. The challenges arise from this model. Technically, it is a complex task to integrate data with the BI systems. BI teams struggle to deliver a single, unified view of enterprise system.
The second challenge is about data governance. Giving business users total freedom in using the applications is fraught with risks. For example, it can result in duplicate data and reports, spike in queries and requests that leads to server breakdown, reports with outdated data or structure. Obviously, there needs to be a balance between data governance policy and user access.
Must Read – Data Center Challenges with Big Data
Case Studies
A number of organizations, big or small, have benefitted by adopting automation or self-service software. These companies have cut costs, improved productivity and clocked higher customer satisfaction. The first case was that of Microsoft call centers. The internal help desk at Microsoft supports more than 105,000, employees, vendors, contractors and clients. It wanted to reduce call volumes. So, it deployed several self-service tools, online support portal, and provided access to knowledge base articles. As a result, Microsoft was able to reduce calls by 15.4% at the rate of about $30 per call.
A research conducted by eVergance Partners LLC, a management consulting company shows that if a company responds to a customer question online, then the cost is 4 to 40 times lesser than that of having the question answered through a call center.
Also read – Big data (Hadoop) as a service – How does it work?
How to get the best out of self service and automation?
First of all, from the perspective of the industry, there is no going back on self-service and automation. But, these opportunities need to be carefully approached. Here are a few tips:
- Provide good automation experience to your customers. For example, if your customers use online chatting, website resources instead of call center, make sure that the process is hassle-free, quick and smooth. If customers encounter poor experience, chances are that they may never return.
- Train the business users to use the applications in compliance with the best practices. There should be extensive training given on application handling and there should be clear division of responsibilities between the BI teams and the business users.
- Build the automation tools incrementally and use your experience in improving them. According to Allen Bonde, senior vice president, strategy and marketing, at eVergance, “Take advantage of the plumbing that you have built up over the last decade.” There are a lot of things that you can do such as payroll business processes, automated interfaces for human resources, and call dispatch requests for mobile field service teams. That would not guarantee customer acquisition or retention though. Bonde adds, “Don’t assume that just because “you build it, they will come.”
Explore Big Data archive articles
Explore Analytics archive articles
Summary
Self-service and automation in industries that deal with the big data are considered huge opportunities. However, companies need to be careful while using these chances because careless execution may result in loss of reputation and customers. Proper training and intelligent policies are the way ahead.
