Blog

Natural Language Processing Training a Custom Byte-Pair Encoding (BPE) Tokenizer using Hugging Face

Learn how to train a custom Byte-Pair Encoding (BPE) tokenizer on a dataset of domain names using the Hugging Face library. Improve your NLP models' performance with this efficient tokenization technique.

Tokenization

Processing of natural language text into atomic token.

Huggingface

Machine learning library for large language models.

February 15, 2024

Large Language Models Building a Generative Transformer Decoder in TensorFlow: A Step-by-Step Guide

Learn how to implement a generative transformer decoder model in TensorFlow using a domain name dataset. Improve your understanding of transformers and generative models with this comprehensive tutorial.

Transformers

Transformer neural network architecture

NLP

Natural language processing.

Generative

Generative machine learning model

Transformer Decoder

Decoder part of the transformer architecture.

February 22, 2024