185  Downloads Updated  1 year ago

RetroMAE-Small is a BERT-small model pre-trained with the RetroMAE objective on a Czech web corpus. This model was created at Seznam.cz as part of a project to create high-quality small Czech semantic embedding models.