Simon @spoltier@qoto.org

If you’re generating code, and you’re *not* doing it with an LLM, is it reasonable to use metrics like F1 and recall to measure how well the tools you use are doing? This is bothering me because it feels a bit weird to apply metrics like this to static analyses, build tooling frameworks, or things that just plain don’t have any recall to begin with.

Earlier this year, I worked on a side project to hack a car in JavaScript and finally found the energy to write the blog post about it! 🚙 📡

https://charliegerard.dev/blog/replay-attacks-javascript-hackrf

I have played a little bit with OpenAI's new iteration of GPT, GPT-o1, which performs an initial reasoning step before running the LLM. It is certainly a more capable tool than previous iterations, though still struggling with the most advanced research mathematical tasks.

Here are some concrete experiments (with a prototype version of the model that I was granted access to). In https://chatgpt.com/share/2ecd7b73-3607-46b3-b855-b29003333b87 I repeated an experiment from https://mathstodon.xyz/@tao/109948249160170335 in which I asked GPT to answer a vaguely worded mathematical query which could be solved by identifying a suitable theorem (Cramer's theorem) from the literature. Previously, GPT was able to mention some relevant concepts but the details were hallucinated nonsense. This time around, Cramer's theorem was identified and a perfectly satisfactory answer was given. (1/3)

Omg I'm laughing so much 😂😂😂😂
https://onerpm.link/EatingTheCats

#Music #Song

"I don't want to live in a world where five companies dictate everything we do."

#Nextcloud founder kicking off the conference

This is a really random question but: has anyone got a decent photo of a solar fence (ie where solar panels are the actual fencing material) that I could use with their explicit permission, citing them? It could literally be a snap of your neighbours' solar fence (without anything privacy-violating in the background).

This is for a TEDx talk at the end of October.

Hallo, Berlin. Ich bin hier!

I don't share networking posts lightly. But I just had such an interesting poignant call with someone who feels stuck in web dev freelancing but has an amazing background in theology, ethnography, analytical philosophy and is so struggling to be seen for his immense systems thinking skills.

I wonder if anyone in my community here has recs for where he might look to network in human-centered communities in software that would value his experience in, as he put it, "metaphysical engineering" :)

@charliermarsh @freakboy3742 @jacob @sgillies I certainly hope you succeed. I think there are ways that this could go bad, but I don’t think it *needs* to go bad. There are some significant challenges on the way there which need to be addressed as they come, there’s nothing to do or say right now, today, that can fully address those concerns