The Notebook

Notes on natural language processing, machine learning, biomedical AI, and the practical details of building language systems.

The Doors Reimagined

music

text-analysis

nlp

A revisit of an earlier notebook on the music band The Doors.

Mar 30, 2026

A Minimal Transformer

nlp

translation

pytorch

Under 100 lines. English to Spanish with PyTorch’s nn.Transformer and OPUS Books.

Sep 18, 2025

What are tied Embeddings

nlp

embeddings

pytorch

Minimal explanation of tied embeddings in language models with a compact real-model demo.

Sep 17, 2025

IMIA Best Paper Award

award

Our 2023 paper On the effectiveness of compact biomedical transformers was selected as one of two Best Papers in NLP worldwide by IMIA’s Yearbook of Medical Informatics.

Jun 1, 2025

Omid Rohanian

Categories

The Doors Reimagined

A Minimal Transformer

What are tied Embeddings

IMIA Best Paper Award