DLSEI 3.0 Cohort 3 registration has been closed.

Local LLMs with llamafile

Included with DLSEI 3.0

Guided Project

Learn, practice, and apply job-ready skills with expert guidance

1.75

Rating out of 5

Guided project Level

Recommended experience

3.00 Hours

Learn at your own pace

Computer Science

Domain

About this guided project

In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examples

What skills will you gain?

Computer Science

Python Programming

Computer Programming