Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Deepseek Local RAG via Flowise
Learn how to build a local RAG system using Deepseek-r1:7b and Flowise. This talk demonstrates extracting data from SQL, generating queries, and creating user-friendly answers, all offline.
With the recent evolution in small performant models, it is quite possible now to replace openai api with a locally running deepseek-r1:7b model. In this demo will showcase how you can quickly run a completely locally Hosted RAG flow retreiving data from an sql based database when prompting for data such as list the companies with highest sales last year in technology sector, the flow will extraxt the ddl, understand the schema, generate the required sql query statement and then return the results and run them through deepseek again to generate a user friendly answer in a chat experience.