For a data point about the effectiveness of hyperthreading, to compress all the textures on my Ryzen 1600 it takes 68 seconds with 6 threads (one per physical core) and 64 seconds with 12 threads (one per logical core).

Follow

@gentoobro I get similarly worse performance using HT with LLMs on an i7-8550U. I only have one channel of DDR4 RAM though for now, gotta see if adding a second module improves things due to doubled memory bandwidth.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.