7  Introduction

Why use local AI?

Recent advances in both hardware and software have made it possible to run powerful language models locally on a personal computer. You can create LLM workflows and agentic systems of any complexity and run them locally, with or without internet access. There are a few reasons why you might choose to use a such a local LLM/Agentic AI system.

• Privacy: A lot of our work involves private and/or sensitive data. Local models guarantee complete privacy as no data leaves your machine.
• Cost: Using state-of-the-art open models can eliminate API costs.
• Development: Access to local models can allow iterative local development before deployment.