Pitcairn-Norfolk (pih) subword embeddings
| Vocab size | vocab | model | 25 dim | 50 dim | 100 dim | 200 dim | 300 dim |
|---|---|---|---|---|---|---|---|
| 1000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 3000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 5000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
Training corpus sample, encoded with different BPE vocabulary sizes
| Vocab size | pihwiki sample |
|---|---|
| original | norfuk inglic es a'langgwidc tat es spokn a'sefrral koontriis. tis langgwidc es cerret n'aal tiis koontriis. tis langgwidc es taot a'maenii skuulls aa david ernest buffett am (born 00 oktoeba 0000) es a politikel figure f' t' ostrielyan teratri a' norfuk ailen. he served as chief miinista a' norfuk a nuuk () es t' kapitel an biges citii a' griinland. it es t' seat a' government, as well as t' kuntrii's biges kulchural an economic center. t' major c |
| 1000 | ▁norfuk ▁ing l ic ▁es ▁a ' l ang gwidc ▁t at ▁es ▁spok n ▁a ' se fr r al ▁k oon tri is . ▁t is ▁lang gwidc ▁es ▁c er r et ▁n ' a al ▁t iis ▁k oon tri is . ▁t is ▁lang gwidc ▁es ▁ta ot ▁a ' ma en ii ▁sk u ul ls ▁a a ▁d av id ▁ ern est ▁b u f fet t ▁am ▁( bor n ▁00 ▁o k t oe ba ▁0000) ▁es ▁a ▁pol it ik el ▁f ig ure ▁f ' ▁t ' ▁ostrielyan ▁ter at ri ▁a ' ▁norfuk ▁ailen . ▁he ▁s er v ed ▁as ▁ch ie f ▁m iin is ta ▁a ' ▁norfuk ▁a ▁n u uk ▁( ) ▁es ▁t ' ▁kapitel ▁an ▁biges ▁citii ▁a ' ▁griin land . ▁it ▁es ▁t ' ▁se at ▁a ' ▁gov ern ment , ▁as ▁w ell ▁as ▁t ' ▁kuntrii ' s ▁biges ▁kul chur al ▁an ▁e c onom ic ▁cent er . ▁t ' ▁ma j or ▁c |
| 3000 | ▁norfuk ▁inglic ▁es ▁a ' langgwidc ▁tat ▁es ▁spokn ▁a ' se fr ral ▁koontriis . ▁tis ▁langgwidc ▁es ▁c err et ▁n ' a al ▁t iis ▁koontriis . ▁tis ▁langgwidc ▁es ▁ta ot ▁a ' ma enii ▁sk u ul ls ▁a a ▁david ▁ernest ▁bu ffett ▁am ▁( bor n ▁00 ▁oktoeba ▁0000) ▁es ▁a ▁polit ikel ▁fig ure ▁f ' ▁t ' ▁ostrielyan ▁teratri ▁a ' ▁norfuk ▁ailen . ▁he ▁served ▁as ▁ch ie f ▁m iin ista ▁a ' ▁norfuk ▁a ▁nuuk ▁() ▁es ▁t ' ▁kapitel ▁an ▁biges ▁citii ▁a ' ▁griinland . ▁it ▁es ▁t ' ▁seat ▁a ' ▁government , ▁as ▁w ell ▁as ▁t ' ▁kuntrii ' s ▁biges ▁kulchur al ▁an ▁econom ic ▁cent er . ▁t ' ▁major ▁c |
| 5000 | ▁norfuk ▁inglic ▁es ▁a ' langgwidc ▁tat ▁es ▁spokn ▁a ' se fr ral ▁koontriis . ▁tis ▁langgwidc ▁es ▁cerret ▁n ' a al ▁tiis ▁koontriis . ▁tis ▁langgwidc ▁es ▁taot ▁a ' ma enii ▁skuul ls ▁a a ▁david ▁ernest ▁bu ffett ▁am ▁( born ▁00 ▁oktoeba ▁0000) ▁es ▁a ▁polit ikel ▁figure ▁f ' ▁t ' ▁ostrielyan ▁teratri ▁a ' ▁norfuk ▁ailen . ▁he ▁served ▁as ▁chief ▁miin ista ▁a ' ▁norfuk ▁a ▁nuuk ▁() ▁es ▁t ' ▁kapitel ▁an ▁biges ▁citii ▁a ' ▁griinland . ▁it ▁es ▁t ' ▁seat ▁a ' ▁government , ▁as ▁well ▁as ▁t ' ▁kuntrii ' s ▁biges ▁kulchur al ▁an ▁econom ic ▁cent er . ▁t ' ▁major ▁c |