Simon @spoltier@qoto.org

If you’re generating code, and you’re *not* doing it with an LLM, is it reasonable to use metrics like F1 and recall to measure how well the tools you use are doing? This is bothering me because it feels a bit weird to apply metrics like this to static analyses, build tooling frameworks, or things that just plain don’t have any recall to begin with.

Earlier this year, I worked on a side project to hack a car in JavaScript and finally found the energy to write the blog post about it! 🚙 📡

https://charliegerard.dev/blog/replay-attacks-javascript-hackrf

I have played a little bit with OpenAI's new iteration of GPT, GPT-o1, which performs an initial reasoning step before running the LLM. It is certainly a more capable tool than previous iterations, though still struggling with the most advanced research mathematical tasks.

Here are some concrete experiments (with a prototype version of the model that I was granted access to). In https://chatgpt.com/share/2ecd7b73-3607-46b3-b855-b29003333b87 I repeated an experiment from https://mathstodon.xyz/@tao/109948249160170335 in which I asked GPT to answer a vaguely worded mathematical query which could be solved by identifying a suitable theorem (Cramer's theorem) from the literature. Previously, GPT was able to mention some relevant concepts but the details were hallucinated nonsense. This time around, Cramer's theorem was identified and a perfectly satisfactory answer was given. (1/3)

Omg I'm laughing so much 😂😂😂😂
https://onerpm.link/EatingTheCats

#Music #Song

"I don't want to live in a world where five companies dictate everything we do."

#Nextcloud founder kicking off the conference

This is a really random question but: has anyone got a decent photo of a solar fence (ie where solar panels are the actual fencing material) that I could use with their explicit permission, citing them? It could literally be a snap of your neighbours' solar fence (without anything privacy-violating in the background).

This is for a TEDx talk at the end of October.

Hallo, Berlin. Ich bin hier!

I don't share networking posts lightly. But I just had such an interesting poignant call with someone who feels stuck in web dev freelancing but has an amazing background in theology, ethnography, analytical philosophy and is so struggling to be seen for his immense systems thinking skills.

I wonder if anyone in my community here has recs for where he might look to network in human-centered communities in software that would value his experience in, as he put it, "metaphysical engineering" :)

@charliermarsh @freakboy3742 @jacob @sgillies I certainly hope you succeed. I think there are ways that this could go bad, but I don’t think it *needs* to go bad. There are some significant challenges on the way there which need to be addressed as they come, there’s nothing to do or say right now, today, that can fully address those concerns

Gathered a few notes on the insightful conversation about uv happening in the Python Mastodon community right now https://simonwillison.net/2024/Sep/8/uv-under-discussion-on-mastodon/

@freakboy3742 @glyph @jacob @sgillies Honestly I try to be really open about this stuff in my writing, on podcasts, in 1:1 conversations, Q&A at events, etc. I really have nothing to hide here, and people ask me about it all the time, I just probably haven't done enough proactive sharing.

@tilde getting the dirt! The really old dirt 😁

I love reading ancient cuneiform tablets. Classics such as "Fuck you, this copper sucks." (Ea Nasir), "I should get more new clothes, my dad's employee gets new clothes twice a month and it's embarrassing.", and of course "The sesame harvest will die — let nobody say I did not warn you!", which is absolutely a set up for "Per my last clay tablet.".

Social media & email may be part of the problem. But if we're still like this when we have to carve our petty bullshit into clay then it's clear that we're the problem. It's us.

Really I think it's all a conspiracy to prevent you from typing ☭

Also, while I'm complaining about the stickers, it drives me

u p t h e w a l l

that "emoji keyboard" features in both phones and desktop PCs offer "emoji searches" which do not include non-emoji unicode codepoints. Sometimes I want to type the greek letter "mu", or the german "umlaut" symbol. Sometimes I want to type the not equals symbol? TOO BAD, says the Microsoft WIN+. key, those are NOT EMOJI and we will NOT BE HELPING YOU. COLORS OR YOU CAN'T TYPE IT!