Manx (gv) subword embeddings

Vocab size vocab model 25 dim 50 dim 100 dim 200 dim 300 dim
1000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
3000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
5000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
10000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
25000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix

Training corpus sample, encoded with different BPE vocabulary sizes

Vocab sizegvwiki sample
original ta coontey diploid 00 kroymasoomyn echey.. ta dagh ayrn jeh, er lhimmey jeh messyn appee, beggan nieunagh er y fa dy vel glycosaidyn keeanaganagh ayn.
ta'n vooir chaspagh (, , , , ) ny corpane ushtey smoo er y theihll rere eaghtyr, as t'ee coontit myr y logh smoo er y theihll ny myr mooir hene. ta'n
* ta'n chruinney soit 0.00 ± 0.00 au magh ass y ghrian. * ta'n eayst soit 0.0000 ± 0.0000 au magh ass y chruinney. * ta mart soit 0.00 ± 0.00 au magh
1000 ▁ta ▁coon tey ▁d i pl o id ▁00 ▁k ro ym as oo m yn ▁echey . . ▁ta ▁dagh ▁a yrn ▁jeh , ▁er ▁lhi mm ey ▁jeh ▁m es syn ▁a pp ee , ▁be gg an ▁n ie un agh ▁er ▁y ▁fa ▁dy ▁vel ▁gl y c os aid yn ▁kee an ag anagh ▁ayn .
▁ta ' n ▁voo ir ▁ch as pagh ▁( , ▁ , ▁ , ▁ , ▁ ) ▁ny ▁cor p ane ▁ushtey ▁smoo ▁er ▁y ▁the ih ll ▁rere ▁eaghtyr , ▁as ▁t ' ee ▁coon tit ▁myr ▁y ▁lo gh ▁smoo ▁er ▁y ▁the ih ll ▁ny ▁myr ▁moo ir ▁hene . ▁ta ' n
▁* ▁ta ' n ▁ch ru inney ▁soit ▁0 . 00 ▁ ± ▁0 . 00 ▁a u ▁magh ▁ass ▁y ▁gh ri an . ▁* ▁ta ' n ▁e a yst ▁soit ▁0 . 0000 ▁ ± ▁0 . 0000 ▁a u ▁magh ▁ass ▁y ▁ch ru inney . ▁* ▁ta ▁m art ▁soit ▁0 . 00 ▁ ± ▁0 . 00 ▁a u ▁magh
3000 ▁ta ▁coontey ▁di pl oid ▁00 ▁k ro ym as oo myn ▁echey .. ▁ta ▁dagh ▁ayrn ▁jeh , ▁er ▁lhi mmey ▁jeh ▁m es syn ▁a ppee , ▁beggan ▁nie un agh ▁er ▁y ▁fa ▁dy ▁vel ▁gl yc os aidyn ▁kee an ag anagh ▁ayn .
▁ta ' n ▁vooir ▁ch as pagh ▁(, ▁, ▁, ▁, ▁) ▁ny ▁corp ane ▁ushtey ▁smoo ▁er ▁y ▁theihll ▁rere ▁eaghtyr , ▁as ▁t ' ee ▁coontit ▁myr ▁y ▁logh ▁smoo ▁er ▁y ▁theihll ▁ny ▁myr ▁mooir ▁hene . ▁ta ' n
▁* ▁ta ' n ▁chruinney ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh ▁ass ▁y ▁ghrian . ▁* ▁ta ' n ▁ea yst ▁soit ▁0. 0000 ▁ ± ▁0. 0000 ▁au ▁magh ▁ass ▁y ▁chruinney . ▁* ▁ta ▁mart ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh
5000 ▁ta ▁coontey ▁di pl oid ▁00 ▁k ro ym as oo myn ▁echey .. ▁ta ▁dagh ▁ayrn ▁jeh , ▁er ▁lhimmey ▁jeh ▁mes syn ▁a ppee , ▁beggan ▁nieunagh ▁er ▁y ▁fa ▁dy ▁vel ▁gl yc os aidyn ▁kee an ag anagh ▁ayn .
▁ta ' n ▁vooir ▁chas pagh ▁(, ▁, ▁, ▁, ▁) ▁ny ▁corp ane ▁ushtey ▁smoo ▁er ▁y ▁theihll ▁rere ▁eaghtyr , ▁as ▁t ' ee ▁coontit ▁myr ▁y ▁logh ▁smoo ▁er ▁y ▁theihll ▁ny ▁myr ▁mooir ▁hene . ▁ta ' n
▁* ▁ta ' n ▁chruinney ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh ▁ass ▁y ▁ghrian . ▁* ▁ta ' n ▁ea yst ▁soit ▁0. 0000 ▁ ± ▁0. 0000 ▁au ▁magh ▁ass ▁y ▁chruinney . ▁* ▁ta ▁mart ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh
10000 ▁ta ▁coontey ▁dipl oid ▁00 ▁k ro ym as oomyn ▁echey .. ▁ta ▁dagh ▁ayrn ▁jeh , ▁er ▁lhimmey ▁jeh ▁messyn ▁a ppee , ▁beggan ▁nieunagh ▁er ▁y ▁fa ▁dy ▁vel ▁gl yc os aidyn ▁kee an ag anagh ▁ayn .
▁ta ' n ▁vooir ▁chas pagh ▁(, ▁, ▁, ▁, ▁) ▁ny ▁corpane ▁ushtey ▁smoo ▁er ▁y ▁theihll ▁rere ▁eaghtyr , ▁as ▁t ' ee ▁coontit ▁myr ▁y ▁logh ▁smoo ▁er ▁y ▁theihll ▁ny ▁myr ▁mooir ▁hene . ▁ta ' n
▁* ▁ta ' n ▁chruinney ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh ▁ass ▁y ▁ghrian . ▁* ▁ta ' n ▁eayst ▁soit ▁0. 0000 ▁ ± ▁0. 0000 ▁au ▁magh ▁ass ▁y ▁chruinney . ▁* ▁ta ▁mart ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh
25000 ▁ta ▁coontey ▁diploid ▁00 ▁kro ymasoomyn ▁echey .. ▁ta ▁dagh ▁ayrn ▁jeh , ▁er ▁lhimmey ▁jeh ▁messyn ▁appee , ▁beggan ▁nieunagh ▁er ▁y ▁fa ▁dy ▁vel ▁glyc os aidyn ▁keean aganagh ▁ayn .
▁ta ' n ▁vooir ▁chaspagh ▁(, ▁, ▁, ▁, ▁) ▁ny ▁corpane ▁ushtey ▁smoo ▁er ▁y ▁theihll ▁rere ▁eaghtyr , ▁as ▁t ' ee ▁coontit ▁myr ▁y ▁logh ▁smoo ▁er ▁y ▁theihll ▁ny ▁myr ▁mooir ▁hene . ▁ta ' n
▁* ▁ta ' n ▁chruinney ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh ▁ass ▁y ▁ghrian . ▁* ▁ta ' n ▁eayst ▁soit ▁0.0000 ▁ ± ▁0.0000 ▁au ▁magh ▁ass ▁y ▁chruinney . ▁* ▁ta ▁mart ▁soit ▁0.00 ▁ ± ▁0.00 ▁au ▁magh