textrecipes - Text Preprocessing Tools for ML Workflows
A comprehensive guide to using textrecipes for text preprocessing in machine learning workflows with R.
RMLText Analysis
Introduction
textrecipes extends the recipes package to provide steps for text preprocessing in machine learning workflows. It integrates seamlessly with the tidymodels ecosystem.
Key Features
- Text tokenization and normalization
- Term frequency calculations
- N-gram creation
- Text embedding
Example Usage
R
library(recipes)
library(textrecipes)
recipe(~ text, data = data) %>%
step_tokenize(text) %>%
step_tokenfilter(text, max_tokens = 1000) %>%
step_tfidf(text)Installation
R
install.packages("textrecipes")