FrankGPT: An Open Source and Locally Run Chatbot

My goal was to explore the current possibilities available to the average user to create a Chatbot with local processing and open source software.

Dispensing with massive, proprietary LLMs like ChatGPT or Claude, this Bot has the personality (and voice) of a university Professor who specialises in programming. One that is always available to the user, free of charge and without the need to connect to the internet.

Software

  • Python (Anaconda)

  • Llama LLM (or any similar open source model)

  • Oobabooga WEBUI

  • Silly Tavern UI

  • ElevenLabs Voice Cloning (although proprietary, it was the best option available at that moment)

From pencil draft to rendered piece with Stable Diffusion

Especially as a method of expression, any artist recognises that Gen AI is useless if the user is not in full control of their output.

This video shows one of my first serious attempts to use Gen AI to "streamline" my artistic work process. My intention was to render an illustration without losing the base strokes I drew for reference.

The results are there for all to see.

Software

  • Stable Diffusion w/ ControlNet

  • Adobe Photoshop

From doodles to hyperrealistic render with ComfyUI (Stable Diffusion)

The next thing I wanted to do was to explore the possibilities in terms of animation, starting by emulating a render of the Devil May Cry V videogame as a reference.

Software:

  • Stable Diffusion

  • ComfyUI

  • AnimateDiff (at first)

  • PikaLabs (at last)

Previous
Previous

Working Student (XR)

Next
Next

Elbe Uprising (Unity VR)