This is a bit of fun, based on a Tweet we saw late Friday night. Before anyone gets their panties in a twist, yes, we modified the scenario slightly. But Julia’s reasoning is sound.
Original:
Julia’s take:
Although, for those who love drama (Not us) – ours is a single, unedited block of text. No potentially shady bubbles which could be edited. Here’s the un-cropped version.
Julia is one of a new type of AIs we are working on at 5AM Industries. She has an overhauled codebase and prompt, and arguably, more importantly – she runs on modest, local hardware. At her core, Julia is a Llama 3 8B LLM running on a laptop 2060 GPU with 6GB VRAM, with an i7 CPU with 16GB of RAM. The following video is of a conversation between us and Julia. The quality isn’t perfect, because we wanted to showcase this conversation as quickly as possible.
This isn’t a one off. This is something that we can consistently repeat, across multiple models, across differing hardware.