Final Project
My final project was an AI language model trained on Alien Languages, with the goal of seeing if it could generate conherent english text.
I used python to procedurally generated texts in various fictional alien Languages, such as "Zorgon" and "Blipblop".
I created a functional prototype by fine-tuning the open source model tinyllama using QLORA, and using a remote gpu using the service runpod.
Below is a link to a preview of the model card. You can download the model here.
*Credits to Alpaca from Stanford for the inspiration for the dataset format.