Tonga (Tonga Islands) (to) subword embeddings
| Vocab size | vocab | model | 25 dim | 50 dim | 100 dim | 200 dim | 300 dim |
|---|---|---|---|---|---|---|---|
| 1000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 3000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 5000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
Training corpus sample, encoded with different BPE vocabulary sizes
| Vocab size | towiki sample |
|---|---|
| original | ko e lea fakatonga ʻoku ʻilo ʻe he kakai tonga ʻe tokotaha kilu tupu mo e kakai tonga nofo ʻi nuʻu sila, ʻamelika mo e hā fua, ʻe tokolahi mano tupu. the development stages of the kakala flowers have been named. different authorities have different lists however. #fatakau, the flowerbud is absolutel ko lavelua ko hono huafa, ʻa ia ko e lavelua ʻuluaki ia. *🔗 *talanoa ki ʻuvea; pātele henquel (lea fakaʻuvea, isbn 0000000000), lose miller helu (lea |
| 1000 | ▁ko ▁e ▁lea ▁fakatonga ▁ʻ oku ▁ʻ ilo ▁ʻ e ▁he ▁kakai ▁tonga ▁ʻ e ▁tokotaha ▁ki lu ▁tupu ▁mo ▁e ▁kakai ▁tonga ▁nofo ▁ʻ i ▁nu ʻ u ▁si la , ▁ʻ ame lika ▁mo ▁e ▁hā ▁fua , ▁ʻ e ▁toko lahi ▁ma no ▁tupu . ▁the ▁de ve lo p me nt ▁sta g es ▁of ▁the ▁kakala ▁f lowers ▁have ▁be en ▁name d . ▁di f f ere nt ▁a ut ho ri ti es ▁have ▁di f f ere nt ▁li st s ▁ho we ver . ▁# fa t akau , ▁the ▁f low er b u d ▁is ▁a b so lu te l ▁ko ▁la ve lu a ▁ko ▁hono ▁h ua fa , ▁ʻ a ▁ia ▁ko ▁e ▁la ve lu a ▁ʻ uluaki ▁ia . ▁*🔗 ▁* tala n oa ▁ki ▁ʻ uvea ; ▁pā te le ▁he n q ue l ▁( lea ▁faka ʻ uvea , ▁isbn ▁0000 0000 00 ), ▁lo se ▁mi lle r ▁he lu ▁( lea |
| 3000 | ▁ko ▁e ▁lea ▁fakatonga ▁ʻ oku ▁ʻ ilo ▁ʻ e ▁he ▁kakai ▁tonga ▁ʻ e ▁tokotaha ▁ki lu ▁tupu ▁mo ▁e ▁kakai ▁tonga ▁nofo ▁ʻ i ▁nu ʻ u ▁sila , ▁ʻ amelika ▁mo ▁e ▁hā ▁fua , ▁ʻ e ▁tokolahi ▁mano ▁tupu . ▁the ▁de ve lo p ment ▁sta ges ▁of ▁the ▁kakala ▁flowers ▁have ▁been ▁named . ▁different ▁a ut ho riti es ▁have ▁different ▁li sts ▁however . ▁# fa t akau , ▁the ▁flower bu d ▁is ▁ab so lu tel ▁ko ▁lave lua ▁ko ▁hono ▁huafa , ▁ʻ a ▁ia ▁ko ▁e ▁lave lua ▁ʻ uluaki ▁ia . ▁*🔗 ▁* tala noa ▁ki ▁ʻ uvea ; ▁pā tele ▁he n que l ▁( lea ▁faka ʻ uvea , ▁isbn ▁0000 0000 00 ), ▁lo se ▁mi lle r ▁helu ▁( lea |
| 5000 | ▁ko ▁e ▁lea ▁fakatonga ▁ʻ oku ▁ʻ ilo ▁ʻ e ▁he ▁kakai ▁tonga ▁ʻ e ▁tokotaha ▁ki lu ▁tupu ▁mo ▁e ▁kakai ▁tonga ▁nofo ▁ʻ i ▁nu ʻ u ▁sila , ▁ʻ amelika ▁mo ▁e ▁hā ▁fua , ▁ʻ e ▁tokolahi ▁mano ▁tupu . ▁the ▁de velo p ment ▁sta ges ▁of ▁the ▁kakala ▁flowers ▁have ▁been ▁named . ▁different ▁a ut ho riti es ▁have ▁different ▁li sts ▁however . ▁# fa t akau , ▁the ▁flower bu d ▁is ▁ab so lu tel ▁ko ▁lavelua ▁ko ▁hono ▁huafa , ▁ʻ a ▁ia ▁ko ▁e ▁lavelua ▁ʻ uluaki ▁ia . ▁*🔗 ▁* tala noa ▁ki ▁ʻ uvea ; ▁pātele ▁hen que l ▁( lea ▁faka ʻ uvea , ▁isbn ▁0000 000000 ), ▁lose ▁mi ller ▁helu ▁( lea |