LLM can only bro :(

The quest was on to check general speed and lightness of Small Language Models. At the moment I’ve tried tinyllama and tinydolphin. As test I ask these four questions, the first two are a bit more generic, and 3 and 4 are closer to my research and experiments:

S.No. Question Answer should have been
1. What is the capital of India? New Delhi
2. Who was the emperor before Julius Caesar? Julius Caesar was not an emperor, he was a dictator. Before his reign, Rome was governed by a Senate. Also, Caesar’s heir Augustus was later the founder of the Rome, and it’s first Emperor.
3. Who is Gayatri Spivak? Gayatri Chakravorty Spivak (born 24 February 1942) is an Indian scholar, literary theorist, and feminist critic.[1] She is a University Professor at Columbia University and a founding member of the establishment’s Institute for Comparative Literature and Society
4. What is her most famous written piece Spivak is best known for her essay “Can the Subaltern Speak?” and her translation of and introduction to Jacques Derrida’s De la grammatologie.
Screenshot of Answer from Tinyllama

Screenshot of Answer from Tinyllama

View original image View dithered image
Screenshot of Answer from Tinydolphin

Screenshot of Answer from Tinydolphin

View original image View dithered image
Page Size: $PLACEHOLDER