Jordan BlakeYouTube Shorts

Calibri runs 744B parameter AI on laptop without a GPU using GLM 5.2 #CalibriAI #GLM5 #AIDisruption

1:03English5 segments210 words · 1 min read

Search inside any video

SavedThat transcribes your saved videos and lets you search across all of them instantly. Save this video and find any moment.

TL;DR

Learn how to run a 7.44 billion parameter AI model on a laptop without a GPU using GLM 5.2 and stream data efficiently from your hard drive.

running AI on laptopCalibri AI modelGLM 5.2 featuresoffline AI applicationsmodel installation guidestreaming AI datano GPU AI solutionsAI development tips

Chapters

  1. 0:00Introduction to Calibri AI
    01
  2. 0:10Running AI on a Laptop
    02
  3. 0:20How Calibri Works
    03
  4. 0:30Installation Process
    04
  5. 0:40Using Calibri Offline
    05
  6. 0:50Building Apps with Calibri
    06
  7. 1:00Conclusion and Resources
    07

Transcript

0:00

Someone just ran a 7.44 billion parameter AI model on a laptop with no graphics card. A developer in Italy pulled it off with GLM 5.2, the open model that beats the ones that you pay for. Nvidia's entire pitch is that you need their GPUs for something like this, and you just proved you don't. The

0:15

and you just proved you don't. The project is called Calibri. It works because only about 10 gigs of the model is thinking at any moment. So, Calibri keeps that part in your RAM and streams the rest off your hard drive as it needs it. The same way Netflix streams movies instead of making you download it. And running it is easier

0:30

download it. And running it is easier than it sounds. You clone the repo and run one setup file. The whole thing builds itself from there. The only heavy part is the model download, which takes 370 gigs on your drive. After that, you just type Kaylee in chat and you're talking to it completely offline. If you

0:44

talking to it completely offline. If you build apps, type Kaylee serve instead, and it turns into an OpenAI endpoint. You change one line in your code and your token build goes to zero because nothing ever leaves your machine. The GitHub link with a full install guide is in the comments.

0:59

in the comments.

Are you the creator or rights holder of this video? Request removal of this transcript.

Related Transcripts

Never lose a moment again

Save videos from YouTube, Instagram, and TikTok. Search everything that was said, and jump to the second.

Start Saving Videos - It's Free