Local RAG Using Llama 3, Ollama, and PostgreSQL

Build a fully local, private RAG Application with Open Source Tools (Meta Llama 3, Ollama, PostgreSQL and pgai)

🛠 𝗥𝗲𝗹𝗲𝘃𝗮𝗻𝘁 𝗥𝗲𝘀𝗼𝘂𝗿𝗰𝗲𝘀
📌 Try pgai PostgreSQL extension ⇒ https://github.com/timescale/pgai
📌 Github repo with code used in the video: https://github.com/timescale/private-rag-example
📌 Use Open-source LLMs in PostgreSQL with Ollama and pgai ⇒ https://www.timescale.com/blog/use-open-source-llms-in-postgresql-with-ollama-and-pgai/
📌 What is pgai? ⇒ https://www.timescale.com/blog/pgai-giving-postgresql-developers-ai-engineering-superpowers/
📌 Install TimescaleDB / PostgreSQL using Docker ⇒ https://docs.timescale.com/self-hosted/latest/install/installation-docker/
📌 Ollama ⇒ https://ollama.com/
📌 Nomic Embed ⇒ https://www.nomic.ai/blog/posts/nomic-embed-matryoshka
📌 Meta Llama 3 ⇒ https://www.llama.com
📌 Try pgai on Timescale free for 30 days ⇒ https://tsdb.co/ai-signup

Join Hervé Ishimye, a Developer Advocate at Timescale, as he demonstrates how to create a private Retrieval Augmented Generation (RAG) application using open-source tools. Learn to integrate Meta Llama 3.2 as your language model, leverage Ollama for model execution, and employ PostgreSQL as your vector database. Ensure data privacy by running these elements locally and benefit from enhanced control, speed, and reduced costs. Hervé walks through the process of setting up your RAG application using Docker, configuring Olama and PostgreSQL, and embedding models effectively. This tutorial emphasizes data safety and the integration of tools like pgai and pgvector in your local environment.

📚 𝗖𝗵𝗮𝗽𝘁𝗲𝗿𝘀
00:00 Why private RAG?
02:28 Tools for Building a Private RAG Application
03:02 Deep Dive into Ollama and PostgreSQL
06:09 Setting Up Your Local Environment
10:38 Implementing the RAG Application
14:31 Conclusion and Final Thoughts

🐯 𝗔𝗯𝗼𝘂𝘁 𝗧𝗶𝗺𝗲𝘀𝗰𝗮𝗹𝗲
At Timescale, we see a world made better via innovative technologies, and we are dedicated to serving software developers and businesses worldwide, enabling them to build the next wave of computing. Timescale is a remote-first company with a global workforce backed by top-tier investors with a track record of success in the industry.

💻 𝗙𝗶𝗻𝗱 𝗨𝘀 𝗢𝗻𝗹𝗶𝗻𝗲!
🔍 Website ⇒ https://tsdb.co/homepage-24
🔍 Slack ⇒ https://slack.timescale.com
🔍 GitHub ⇒ https://github.com/timescale
🔍 Twitter ⇒ https://twitter.com/timescaledb
🔍 Twitch ⇒ https://www.twitch.tv/timescaledb
🔍 LinkedIn ⇒ https://www.linkedin.com/company/timescaledb
🔍 Timescale Blog ⇒ https://tsdb.co/blog-24
🔍 Timescale Documentation ⇒ https://tsdb.co/docs-24