Transformer RNN modelsLucidworks AI custom embedding model training

While recurring neural network (RNN) models are powerful for tasks that demand fast inference and domain-specific tuning, such as e-commerce, Transformer RNN models excel at handling complex language understanding and are well-suited for common AI tasks like classification, prediction, and sequence modeling.

Because a transformer RNN model uses a frozen pre-trained transformer (FPT) base, its customizability is limited. And due to the complexity of the transformer architecture, it requires more training and inference time than RNN-only models. However, it also delivers high-quality results with minimal tuning, even when your data is limited or noisy.

To help you get started faster, Lucidworks AI provides the models below as pre-trained bases: