Under 100 lines. English to Spanish with PyTorch’s nn.Transformer and OPUS Books.
Minimal explanation of tied embeddings in language models with a compact real-model demo.
Our 2023 paper On the effectiveness of compact biomedical transformers was selected as one of two Best Papers in NLP worldwide by IMIA’s Yearbook of Medical Informatics.
