AI
A powerful, lightweight, and cross-platform AI engine built into SQLite
SQLite-AI
SQLite-AI is a groundbreaking extension that brings powerful AI capabilities directly into SQLite. By embedding llama and whisper, it enables local LLM inference, text generation, embedding creation, speech recognition, translation, and even multimodal support—all from within the database itself. With a simple SQL interface, you can chat with a model, stream tokens in real time, generate high-quality embeddings, or transcribe and translate audio using Whisper. Multimodal features allow image processing and embedding, making SQLite-AI a versatile foundation for modern AI applications.
What makes SQLite-AI truly revolutionary?
What makes SQLite-AI truly revolutionary is its zero-dependency design: there’s nothing to install, build, or configure beyond the extension itself. It works out of the box on a wide range of hardware, from desktops to edge devices, with state-of-the-art performance. This radically simplifies the deployment of LLM and ASR features, transforming SQLite from a lightweight database into a powerful local AI engine. With SQLite-AI, you can build intelligent, responsive applications that run entirely on-device—securely, offline, and without cloud dependencies.
AI at the Edge. Instantly.
<Sample Code>
SQLite-AI provides a simple SQL interface to interact with LLMs and ASR models.
-- 1. Load the extension
.load ./ai
-- 2. Load the model
SELECT ai_model_load('/full_path_to_model.gguf', 'n_predict=512,n_gpu_layers=99');
-- 3. Perform inference
SELECT llm_text_generate('Write a short story about a robot who learns to run a company like SQLite Cloud, Inc');