Text Classification Intuition for Software Developers
Large language models are used to solve all kinds of language tasks. Text classification is one of the leading tasks these models are often deployed to solve. Let's look at two examples: Customer service and content moderation.
Large language models are used to solve all kinds of language tasks. Text classification is one of the leading tasks these models are often deployed to solve. For developers new to classification, a text classifier can be thought of as a piece of software that looks at a piece of text and assigns it a class label.
With this knowledge, we can look around and think about how this capability can enhance the systems we build. Let's look at two examples: Customer service and content moderation.
Customer Service
Improving customer service systems is one of the most active areas for deploying language understanding systems. Let’s look at a couple of examples where text classifiers improve these systems.
Topic classification and message routing
For businesses that deal with a large volume of inbound communication, a lot of time and effort can be saved by automatically routing customer messages to the people who can resolve them.
This routing can either be actually forwarding an email or integrating with Customer Service software (like Zendesk or Freshdesk) that assigns the relevant person to look at the ticket.
A more advanced system is one that can automatically answer frequently asked questions instead of routing them to agents to answer them repeatedly. This is a common use case for chatbots to handle.
Chatbots and intent classification
Modern chatbots can be used to answer commonly asked user questions.
Text classification is a cornerstone of how these systems work. More specifically, most chatbots employ a classifier that detects the intent behind the user’s message. Intents are broader than topic classifiers as they include intents like “greeting” that enable them to react when a user says “hi” or “bye”, for example.
Chatbots tend to pair intent classifiers with entity extractors – another language processing functionality to extract the “breakfast special” from a menu item question so the system knows exactly which item the user is asking about.
Content Moderation
A significant portion of human interaction now happens online through social media, online forums, and group chats (like Discord or Slack). More often than not, these online communities need moderation to keep their communities safe from different types of online harm. Language understanding systems can empower moderation teams in combating toxic, abusive, and hateful language.
A content filter can classify texts as either neutral or toxic:
In Content Moderation with Classify, we show how you can build such a classifier with Classify. This includes the ability to finetune a model on your labeled data so the classifier can specialize to solve this problem.
Other text classification problems
Building the best classifier and evaluating it for a specific dataset is a deep topic with a rich history and plenty of ongoing work. But for a developer just approaching the topic, this article aims to communicate the intuition of how to think of text classification as a language understanding capability that can improve software systems that handle text and communication.
If you're able to map real-world problems to text classification problems, that's a good first step to start your path in creating language processing systems.
Hope you find this intuition helpful! For more on evaluating classifiers, be sure to check out Classification Evaluation Metrics: Accuracy, Precision, Recall, and F1 Visually Explained.