RetroMAE-Small is a BERT-small model pre-trained with the RetroMAE objective on a Czech web corpus. This model was created at Seznam.cz as part of a project to create high-quality small Czech semantic embedding models.
185 Pulls 2 Tags Updated 1 year ago