But that's not the point; the point is understanding these things better by seeing how they are made (or grown, if you prefer). Building something at a level further down the stack than you will ever go forces you to confront details that shape the layers above that you do deal with. This is one reason why Crafting Interpreters is such a beloved book here on HN.
LLMs are now at the core of tools we all use everyday... don't you want to know how they are made? Maybe not everyone has this itch to understand the platforms and tools they use, but I sure do, and it's helped me over and over again. Sure, LLMs aren't like operating systems or compilers. They're a quasi-organic mass of billions of parameters learned during training and honestly nobody (not even the mech interp folks) really deeply understands why they work so well. But that's no reason to completely give up and there is still a lot you can learn.
Take RLVR ("Reinforcement Learning from Verifiable Rewards"). This is the training technique that made LLMs get so good at programming and math in 2025 and 2026. A lot of people who confidently talk about LLM capabilities either haven't heard of it (and thus end up parroting out-of-date factoids about LLM training derived from the pre-2025 era) or have only a very dim idea of what it is. In this course you actually do RL training of an LLM to get it solving math problems better. You're right down in the details. It's interesting for its own sake but it will also give you a grounding for discussing questions such as: "why did LLM writing get so weird and bad in mid-2026?" and "why is it so hard to train LLMs to be good at things that aren't like math and programming?"
Anyway, Sebastian's two books are great and highly recommended; I worked through the first one a year ago and it was one of the best investments of my time in all of 2025. If you prefer video for learning this is great as well (although I'd still say - try the books first).
Whenever I've tried to learn about LLMs, machine learning, etc. I always come out with a bad feeling, compared to learning about software.
Theoretical courses make me feel like it's all baby steps, unless you assume a level of commitment equivalent to a math degree. Practical/applied stuff seems to require levels of compute, training data, etc. that make it unapproachable for a home hacker for everything beyond basic exercises like a handwritten digit classifier.
Now this feeling of "impracticality" is perfectly fine. It would be the expected outcome if I was taking a course on classic literature or modern art. But machine learning stuff feels like it could have room for learning-by-doing applications that aren't entirely pointless, so I wonder if there's some way to approach the topic I'm simply not finding.
Did anyone have the same experience? any tips if so?
Apple famously put "if you run to the press and trash us, it never helps" into their App Store Guidelines for developers, but the only reason they did have to do that is because it's a lie. Running to the press is the only thing that helps, which is why people do it.
> https://github.com/DilawarShafiq/nietzschian-debugger#setup
Step one to setup: "Set your Anthropic API key"...
- Quoted phrase in the opening sentence
- Opening quote: “colonialism”
The article states three reasons for doing so, but all of them are very cringe baity words.
Low paid workers are due to local economy government doing jack to improve their wages in the first place. In China, competition is high, thus low pay (with other reasons such as real estate crashes, etc)
Visualization makes sense but does not mean it's colonialism as colonialism requires forced intervention, and there is no such play here.
Cool project bad political motivated wordings in the post.
- Quoted phrase in the opening sentence
- Opening quote: “hello”
ofcourse its not great, but afaik we still can't do much better. Perhaps if universities and their medical centers got proper budget they could grow humans and human parts to test on. theres many things like artificial wombs and 3d printing of tissue etc. but afaik these will be hugely expensive and way outside their budget.
Or does peta prefer only big pharma to be able to do research and sell simple medicines for ludicrious prices (as we've all seen them do already).
Wonder what other people's take on it is.
i also wonder why they dont fight for human rights instead of animal rights. i mean, sure animals are essential, and sentient, and know what is suffering and incarceration, but so do many humans around the globe, even in 'developed' countries.
maybe they should put them in a childrens' hospital full of kids with incurable diseases and ailments -_-. i've been there and seen _that_ and its a ton more depressing and horrible and a few monkeys suffering (which is still horrible but magnitudes less i can tell u).
try looking one of those kids in the eyes and tell them you are advocating for something that will prevent their chance of a cure how slim it might be. im quite sure u need to be pretty unempathic to be able to do that to say it lightly....
this kind of advocating causes litterally violence to some of these researchers... completely bonkers.
- Quoted phrase in the opening sentence
- Opening quote: “ProMotion”
non-starter
- Quoted phrase in the opening sentence
- Opening quote: “ProMotion”
non-starter
0-3 yrs old: no screens at all. No TV playing when they are in the room, even if they can only hear the sound. Refrain from using your phone too long when they are in the room with you, they need to see your face react to them to learn human interaction.
3-6: no screens used alone. No internet. Interactive content with a parent is ok, not regularly, not in the bedroom.
6-9: may discover safe internet spaces, with help from parents.
9-12: can learn to manage their screen time, protect their private life, develop critical thinking.
12+: no screens at night, talk to your kid about what they do online, more autonomy.
This is what we follow (refraining from using the phone ourselves is prolly the hardest to do), they have never watched cartoons alone, they love old point'n'click games on the PC with me, we share the mouse, and I thought they would ask for more and more screen time, they don't. They actually want to read books with parents, paint, draw, build, go outside, ride a bicycle, invite friends. Maybe we're lucky. They don't throw tantrums in their seat, they sometimes do while grocery shopping, it's difficult, but I would never use a screen to stop it.
So, I don't see how this kind of device can be useful and safe at any age. It seems designed to cause the infamous "iPad kid" syndrome or get them hooked on Amazon products even younger than before.
But there's even worse in stores today: AI assistant integrated plushies.
- Quoted phrase in the opening sentence
- Opening quote: “Kids want a real tablet, not a toy,”
- Opening sentence uses a quote to challenge or distance a term
- Opening sentence challenges the term “Kids want a real tablet, not a toy,”
That's probably true, but kids want a lot of things they shouldn't have. I'm sure I would have loved to have a real phone as a toddler, but my sister and I got a lot of mileage out of our Fisher Price phone, making lots of pretend calls, which was probably better for our developing brains than a real phone.
I recently watched Toy Story 5 on a long flight. I almost felt it should come with a trigger warning - I thought it was a spot on, brilliant yet inherently depressing commentary on our current relationship with tech.
(Minor spoiler alert) One of my favorite scenes was when a slew of toys were running through a house with a family inside. Normally in the Toy Story world when a human see the toys they need to "play dead", but since all the humans were glued to their screens they could run by unimpeded.
- Quoted phrase in the opening sentence
- Opening quote: “Kids want a real tablet, not a toy,”
- Opening sentence uses a quote to challenge or distance a term
- Opening sentence challenges the term “Kids want a real tablet, not a toy,”
An almost verbatim line from Toy Story. Incredible. Only the main character was quite a bit older than 3.
- Quoted phrase in the opening sentence
- Opening quote: “x is good for your brain”
- Opening sentence uses a quote to challenge or distance a term
- Opening sentence challenges the term “x is good for your brain”
The same way we got gyms when people realized physical inactivity is super unhealthy.
A lot of, "birdwatchers" I see travelling to remote parts of Scotland and other places in the UK are generally wealthy retirees, with nice kit (Rab clothing, telephoto lenses, VW campervans).
Cognitive decline is shown to impact disproportionately on less wealthy people. So is there a trend with economic wealth and outdoor hobbies like birdwatching? I'd hazard a yes.
On a side note, the Merlin bird ID app from Cornell University is great.
- Quoted phrase in the opening sentence
- Opening quote: “before it was cheap”
- Opening sentence uses a quote to challenge or distance a term
- Opening sentence challenges the term “before it was cheap”
I have seen too many examples of people trying to earn money on apps they clearly vibe coded in an hour. Why would I pay for that - might as well make it and sideload it myself. I might even publish it for free to the app store to spite them.
I really don't think you are in a position to be asking for money if you just made something using an LLM. You didn't put in much work yourself, and anyone could replicate it for the "low cost" of their LLM subscription.
Did someone make 1x1x1 wooden cubes and remade Switzerland? Oh no, the tiny tiny text above the gigantic title says "Minecraft".
"Exactly as tall and as steep". How is a mountain that exists in a video game exactly as tall and steep as the real one?
Then there's an embedded map that is an attempt to convey information that I still can't figure out what.
How to run it? Aha, download Prism Launcher (not a clickable link), import the zip... and oh, you need to have purchased Minecraft too!
What an exercise in convolution...
- Ordinary term used more than once in the same comment
- “Denmark in Minecraft” appears 2 times
https://geoboxers.com/denmark-in-minecraft/
> ‘Denmark in Minecraft’ was released in April 2014 by the Danish Geodata Agency. The project was conceived, developed and operated by Simon Lyngby Kokkendorff, Thorbjørn Kjærshøj Nielsen and Nynne Sole Dalå, the founders of GeoBoxers.
> The work was funded and carried out by the Danish Geodata Agency as an initiative following the 2013 “basic data programme”, where a significant amount of public Danish data were made available for free. The purpose was to make geographical and topographical data available through Minecraft, and help disseminate the free data to a broader audience and specifically reach children.
> Denmark in Minecraft was released with an invitation to teachers and schools to use the data in geography, math, science and history lessons, and within the first few months Minecraft-data were downloaded 300.000 times from the Geodata Agency, and around 37.000 unique users logged in to the agency’s Minecraft-servers.
> January 1st, 2016 the Danish Geodata Agency changed into the Agency for Data Supply and Efficiency, and links in English regarding “Denmark in Minecraft” were removed. Since 2020 Denmark in Minecraft can no longer be downloaded.
One Google search (yeah I'm old, sorry, nobody "Googles" anymore) for "rust pdf library" shows this. Yet people now redo and redo and redo everything again just to have "their" semi-broken copy of a HTML -> PDF renderer (and then run into the same edge cases that were already fixed before). There are lots of edge cases in typography especially, I recently had a lot of fixes as I was trying to ocr-and-cleanup a 1732 scan of some books with Claude auto-extracting the font. There were a ton of edge cases in the layout, esp. related to column, footnote and sidebar handling, or things like "Hebrew RTL text accidentally disappears if text breaks weirdly", "1-bit image compression", etc.
I have nothing against AI, I use it heavily myself, but what is annoying is people completely ignoring the years of work of existing projects that do the exact same thing - instead of just forking, but instead re-tokenizing the exact same work again. Most likely the author didn't research "does this already exist" and that's annoying, then you get 100 of similar projects reinventing the world with tokens again and again. Sometimes its beneficial and can lead to faster exploration of new approaches, but in most cases its not and misses edge cases that were solved before.
- Quoted phrase in the opening sentence
- Opening quote: “judge writing by its quality instead of its source”
Over time NeoGeo realized they could sell you the hardware to play at home (“on-prem”) at arcade quality albeit at a price out of reach to most people. Alongside them, Nintendo and Atari gave you 80% of the fun at 20% of the cost. History will view games arcades as a flash in the pan compared to gaming at home.
Namco, Capcom, and Konami went into selling software instead of hardware but it feels hard to imagine buying a home copy of Fable** for $X,000 any time soon.
⸻
* That’s for video games. In fairground arcades you’d literally pay for tokens then use tokens for play. The analogy almost writes itself.
** The model, not the video game.
- Quoted phrase in the opening sentence
- Opening quote: “son of a failed coup organizer”
But, his dad:
> Former Brazilian President Jair Bolsonaro is serving a 27-year prison sentence after being convicted by Brazil's Supreme Court for plotting a coup following his 2022 election defeat
I don’t see how to read it any other way. Explain?
The extreme case which you want to avoid is "politicians" (dictators) desperately clinging to power, because they did things that would get them killed if they ever lost their power, which is a vicious cycle.
- Quoted phrase in the opening sentence
- Opening quote: “heavily”
- Quoted phrase in the opening sentence
- Opening quote: “They even extended voting time, a move that directly benefiting him”
Both candidates supported that decision.
- Ordinary term used more than once in the same comment
- “profits” appears 2 times
Also, just for the record, some carriers in Japan are offering financing that gives you the option of paying over 48 months and Apple offers 36 months. Is that quite absurd to most people? Absolutely, but for the average person who wants a bigger screen sometimes, the cost is not even going up much on a monthly basis.
For the record, especially in Japan, folio cases where you open your phone like a book are already the default. Effectively most people on the train have their phone open in some "Duo-ish" form-factor already. So the jump from a folio case to a folding phone is already substantially lower.
Obviously the gimmick nature of folding is not the compelling reason why people want folding phones. The question is more about tradeoffs, and I think that especially in asia, the demand for folding phones is quite obvious: upgrade your primary PC to have a huge display when you want it that way, otherwise it stays compact enough to be with you all the time.
At some level I know I'm seeing these pictures through rose-colored glasses, and these early-ish tech folks had plenty of gripes about office life. But man, I came into the workforce just in time for the idea of "working with people in person" to die. And I like working from home, but... man, working on truly new stuff, in person, with people who also care, looks like it was so much fun.
There is more to it than just reducing content in context. LLMs attention mechanism works by finding graphs of related words and concepts and it works best when the relevant relationships are close together in the text. Length matters but how well the information is organized matters as well.
It's useful to be familiar with the concept of dependency length. The two sentences in this image ( https://benoitessiambre.com/img/dependencylength.png ) have the same words and same meaning but sentence C is organised to minimize the distance between related words.
This can also apply to paragraphs and sections. Ordering them so that related information is recursively closer together, helps AIs think better (also helps humans, Dependency Length Minimization, DLM is an idea from psycho-linguistics).
This is one reason progressive disclosure and sub agents are important. Including unnecessary information spreads apart surrounding information and makes it more difficult for AIs to figure things out.
For eg. optimizing skills, it can help to put more important information at the bottom of a skill. Usually after a skill is loaded, the AI will start “thinking”, talking to itself to try to reason through a problem. The thinking block will have an easier time considering the text closest to it, the last part of the skill, than information farther up.
Thinking blocks can produce a lot of text (a lot of it often hidden from users) that also spreads information apart. Sometimes, when an early instruction is still relevant but there’s been a lot of thinking and discussion added to the context since, it’s worth repeating a summary the early information ( keeping in mind that too many reminders can also spread other information apart ). I think however, LLMs are tuned to overweight very early information so that they don't disregard system prompts. You might be able to exploit this by placing some important facts near the very beginning of a conversation.
If you've ever written compression algorithms where repeated blocks are referenced instead of encoded, you'll be familiar with how related information being clustered allows for better compression. It's another example of the parallels between intelligence and compression and it hints at the information theoretic aspect of DLM.
- Quoted phrase in the opening sentence
- Opening quote: “regulation”
Regulation might inconvenience them a little, but the upside is huge if it means open models out of China get banned.
- Ordinary term used more than once in the same comment
- “cybersecurity” appears 2 times
- Quoted phrase in the opening sentence
- Opening quote: “good friends”
Interesting times.
To put it another way, it helps me recognize which tabs I am using. And which I am saving for later without having to evaluate the content of the tab.
One tweak… the coverage percentage can it be adjustable? Max = 100% looses all information about the pages contents, except the title.
Also also… if the images can be made translucent… you can make old timey effects like yellowing and decay.
I claim no great historical authority here but, since I grew up mostly within sight of the hillfort, we were taught about its history at school to an extent that, at the time, felt unrelenting, cruelly repetitive, and utterly tedious. In reality though, it probably lasted for a single term at the fag end of 1985 when we learned about the Celts[0].
But what we learned was that General Vespasian captured Maiden Castle after a brutal one day battle in AD 43 in which Maiden Castle’s Celtic defenders were slaughtered in what amounted to a one-sided rout due to the superior weapons, tactics, and discipline of the Romans. This is what I remembered, but I wanted to look it up to ensure my facts were straight.
Welp… TIL because subsequent investigation and analysis has shown that it didn’t happen at all so, no, dear reader, my “facts” were not straight.
There never was any big battle.
There might have been the odd smaller skirmish during the Roman period, but the bodies we found that were all supposed to have died in the big battle actually span several generations, dying at different times over a period of a couple of hundred years, and the evidence of violence in their deaths was in the vast majority of cases inter-tribal and occurred before the Romans even showed up.
Maiden Castle had already fallen into decline by the time the Romans arrived and was mostly abandoned for a long period until a temple (that you can still visit the ruins of) was built early in the 4th century.
So the reason the battle of Maiden Castle doesn’t appear on the site isn’t because the site is carelessly built AI-slop but because no such battle ever happened.
I have been… disillusioned. Hats off to the human behind the AI that built the site.
[0] I remember this with such precision because it was the first period of history we learned about at middle school, and matters didn’t improve significantly, because next it was the domestic matters of the bleeding Victorians, and lots of episodes of “How we used to live”.
Demanding that everyone use our alphabet because we're too dumb to recognize the difference between google.com and xn--ggle-55da.com is the worst kind of "security through superior firepower"
(the fact that HN shows these correctly in the EDIT window but have to dump to punycode in display is sad, tbh)
- Quoted phrase in the opening sentence
- Opening quote: “stage IIB–IV melanoma that had been surgically removed prior to entering the trial.”
> lost my dad to cancer because of cancer medication
Please don’t phrase it like this. Loss is hard. But desperate people have skipped treatment because they misread something online.
Yes. A whole bunch of the prominent "MAHA" folks sell/promote supplements, peptides, miracle cures.
https://en.wikipedia.org/wiki/Children's_Health_Defense
https://www.cspi.org/press-release/peptides-fda-urged-overru...
https://www.washingtonpost.com/health/2024/12/03/dr-oz-influ...
There's a shitload of money in alternative medicine, and you can get away with more.
- Quoted phrase in the opening sentence
- Opening quote: “not bothered”
1. AI generated text is just hard to read and verbose, if you worked so hard on your docs/specs, why would you want your README to be unreadable?
2. There's so much garbage written with AI that I'm just going to assume yours also is. Would you sign up to a gym with broken windows? It could be the best gym ever, but I wouldn't count on it.
Now my agents mainly write code under my direction and I review it either in the harness or on GitHub.
I hadn’t opened it in ages and when I did need an IDE something like Zed was more than sufficient.
There was a letter from Dolly to him that ended “I will always love you”. Made my wife tear up.
...and fifteen years after Stross' Accelerando opened with a man who spent every waking hour doing what his autonomous AI agents told him to do via his smartglasses...
...and twenty-seven years after AT&T's "You Will" ad campaign sold a future including agents, teleconferences, gps navigation, video on demand, and many more things, pretty much none of which were actually brought into daily life by AT&T...
Another one that comes to mind constantly is 'The Peripheral'.
https://en.wikipedia.org/wiki/The_Peripheral_(novel)
I'm pretty sure Gibson has a wormhole with a lens attached stashed away somewhere.
So this guy admits he did things that he shouldn't have then contends that he shouldn't have to say sorry for them? Am I reading this right? Isn't the point of an apology to acknowledge the bad outcome and signal to aggrieved parties that the offender will try avoid repeating the negative behavior? If yes and this guy is refusing to do it then what does that say about his world view?