HW/FW security researcher & Demoscene elder.

I started having arguments online back on Fidonet and Usenet. I’m too tired to care now.

  • 4 Posts
  • 32 Comments
Joined 3 years ago
cake
Cake day: June 12th, 2023

help-circle





  • Of course it’s not necessary. I’m a way-beyond-senior dev who laughed at LLMs up until a few months ago when trusted friends, whose competence is not in question, told me they got good usage out of them.

    I decided to challenge my convictions and sat down and took the time to learn how to use LLM assistants (I tried everyting from full vibe coding to manual gatekeeping of suggestions).

    Now I use them for my own personal projects, and I’m much more productive (for various reasons - but one is that the initial friction of oh yet another thing I have to learn just to do X is much lower. I have no boss telling me what to do, and I select my projects myself. If they didn’t bring any benefits I wouldn’t use them.












  • I run a quant of Qwen 35B A3B (Qwen3.6-35B-A3B-GGUF:UD_Q4_K_XL) at the moment, using Opencode and llama.cpp. I’m getting useful work out of it - but it’s of course not Claude. My hardware is a 5060Ti with 16GB VRAM and then ~20GB or so of system mem is getting used as well.

    It’s important to put boundaries on less capable models though, so I have two plugins in Opencode as well that really makes a big difference to the results: @tarquinen/opencode-dcp@latest and superpowers@git+https://github.com/obra/superpowers.git.

    I want to work in small steps with good control over what the models do so it’s not very similar to what you describe with just having them run away for half an hour and do everything.




  • I have since many years back documented most tasks in a digital note taker app. Over the years I’ve transferred them between systems, right now they’re in Nextcloud.

    I also have configured a local AI on the server and since Nextcloud has built in support for using local AI it has now indexed all my notes so I can pose queries to a local AI that has all that info I’ve ever written down backing it.

    “When is it time to re-apply for the garage building permit” and “Which one of our kids was the tallest at birth” are examples of questions I can now do.