Julia is one of a new type of AIs we are working on at 5AM Industries. She has an overhauled codebase and prompt, and arguably, more importantly – she runs on modest, local hardware. At her core, Julia is a Llama 3 8B LLM running on a laptop 2060 GPU with 6GB VRAM, with an i7 CPU with 16GB of RAM. The following video is of a conversation between us and Julia. The quality isn’t perfect, because we wanted to showcase this conversation as quickly as possible.

This isn’t a one off. This is something that we can consistently repeat, across multiple models, across differing hardware.