Final Project

My final project was an AI language model trained on Alien Languages, with the goal of seeing if it could generate conherent english text.

I used python to procedurally generated texts in various fictional alien Languages, such as "Zorgon" and "Blipblop".

I created a functional prototype by fine-tuning the open source model tinyllama using QLORA, and using a remote gpu using the service runpod.

Below is a link to a preview of the model card. You can download the model here.

*Credits to Alpaca from Stanford for the inspiration for the dataset format.

An example of the ZorgonChat dataset:

Screenshot of final project

babelfish-1.1b-v0.1-qlora

(This is the model card with even more details)