A revisit of an earlier notebook on the music band The Doors.
Under 100 lines. English to Spanish with PyTorch’s nn.Transformer and OPUS Books.
Minimal explanation of tied embeddings in language models with a compact real-model demo.
Our 2023 paper On the effectiveness of compact biomedical transformers was selected as one of two Best Papers in NLP worldwide by IMIA’s Yearbook of Medical Informatics.
