Intelligenza Artificiale LLM e NLP

Offline LLM: Local Language Models with Ollama

Install and use LLMs locally with Ollama: Llama 3.1, Deepseek, Open WebUI, model comparison, LLAVA multimodal and custom Modelfiles.

Course description

Offline LLM with Ollama: AI on Your PC, No Cloud Required

Stop depending on ChatGPT or paid APIs. With Ollama you can download and run powerful language models directly on your computer, using your GPU or even just the CPU. In this course I show you how to do it practically, from downloading the model to a full graphical interface and custom models.

What You'll Learn

  • Download and install Ollama and load models like Llama 3.1 or Deepseek
  • Start Ollama and configure Open WebUI with Docker to get a graphical interface
  • Use the advanced features of Open WebUI, compare different models against each other and work with LLAVA (multimodal model for images)
  • Create a custom model with a JSON Modelfile, with system prompt, parameters and tailored behavior

Privacy, Speed and Zero API Costs

Everything runs locally: your data never leaves your PC, you pay no API calls, you're not tied to any external service. It's the ideal solution for those who want to experiment with AI models, protect confidential documents or simply understand how these tools work without relying on remote black boxes.

Who This Course Is For

Designed for developers, IT professionals and AI enthusiasts who want to get started with local LLMs. No machine learning experience required: basic command line and Docker knowledge is enough. The setup is guided step by step.

Lessons list

I'll guide you through downloading and installing Ollama and loading your first local LLM — Llama 3.1 or Deepseek — directly on your PC, with no cloud and no API costs.

Guarda lezione

Let's see how to start Ollama as a service and configure Open WebUI via Docker to get a full graphical interface for your local LLM models.

Guarda lezione

Let's explore the main features of Open WebUI: using the chat interface, comparing multiple models in parallel, and interacting with LLAVA — the multimodal model that also analyzes images.

Guarda lezione

I'll show you how to create a custom LLM model with Ollama using a JSON Modelfile: defining the system prompt, parameters, and tailored behavior for your specific use case.

Guarda lezione
Giovanni Pace

Giovanni Pace

Ingegnere Informatico · Pratola Peligna

  • 107 Courses
About the teacher

Sono un ingegnere informatico con oltre 15 anni di esperienza nel settore ICT. Mi occupo di sviluppo software, cybersecurity, data science e intelligenza artificiale, con particolare attenzione all’innovazione e all’automazione dei processi aziendali. Da anni svolgo anche attività di docenza e formazione, creando percorsi pratici e coinvolgenti su programmazione, DevOps, AI e sicurezza informatica.

This course includes

  • Lessons 4
  • Duration 0h 56m
  • Difficulty base
  • Language it
  • Certificate No

Recently viewed