zhenbo_endleM to TIL about Computer ScienceEnglish · 4 months ago

Running Local LLMs, CPU vs. GPU - a Quick Speed Test

1

5

Running Local LLMs, CPU vs. GPU - a Quick Speed Test

zhenbo_endleM to TIL about Computer ScienceEnglish · 4 months ago

1

May 12 Update Putting together a table with all the results from the comments. Putting at the top...

loginwall at Dev.to

Chat

ALERT@sh.itjust.works
link
fedilink
English
arrow-up
2·
4 months ago
tl;dr CPU is slow, GPU is faster

TIL about Computer Science

til_about_computer_science

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

A place to share everything you like about Computer Science. Feel free to consider here as a public “Read it Later” service.

Rules:

Any posting, commenting and voting means you’d like to follow these rules:

You follow the rules of lemmy.ca.
Only post things you like.
No piracy and respect paywalls.
Share the original link when possible.
Upload images only if necessary. Proper alt text is a must.
Self-promotion for your own blog/project is allowed, but please be honest.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

6 users / day
6 users / week
6 users / month
21 users / 6 months
5 local subscribers
46 subscribers
4 Posts
1 Comment
Modlog

mods:
zhenbo_endle