Escalation Prediction using Feature Engineering: Addressing Support Ticket Escalations within IBM's Ecosystem

by   Lloyd Montgomery, et al.

Large software organizations handle many customer support issues every day in the form of bug reports, feature requests, and general misunderstandings as submitted by customers. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. Whenever insufficient attention is given to support issues, there is a chance customers will escalate their issues, and escalation to management is time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. This thesis provides a step towards simplifying the job for support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, a design science methodology was employed to characterize the support process and data available to IBM analysts in managing escalations. Through iterative cycles of design and evaluation, support analysts' expert knowledge about their customers was translated into features of a support ticket model to be implemented into a Machine Learning model to predict support ticket escalations. The Machine Learning model was trained and evaluated on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 79.9 for support analysts looking to identify support tickets at risk of escalation. The features developed in the Support Ticket Model are designed to serve as a starting place for organizations interested in implementing the model to predict support ticket escalations, and for future researchers to build on to advance research in Escalation Prediction.



There are no comments yet.


page 1

page 2

page 3

page 4


ECrits - Visualizing Support Ticket Escalation Risk

Managing support tickets in large, multi-product organizations is diffic...

Customer Support Ticket Escalation Prediction using Feature Engineering

Understanding and keeping the customer happy is a central tenet of requi...

Constructing Effective Customer Feedback Systems – A Design Science Study Leveraging Blockchain Technology

Organizations have to adjust to changes in the ecosystem, and customer f...

How angry are your customers? Sentiment analysis of support tickets that escalate

Software support ticket escalations can be an extremely costly burden fo...

A Framework for Fairer Machine Learning in Organizations

With the increase in adoption of machine learning tools by organizations...

What to Prioritize? Natural Language Processing for the Development of a Modern Bug Tracking Solution in Hardware Development

Managing large numbers of incoming bug reports and finding the most crit...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.