Fooling AI

Cyber-security is a broken-window fallacy, but there’s something delightful about this little bot tarpit:

The attacking bot reads the hidden prompt and often traverses the infinite tarpit looking for the good stuff. From Prompt Injection as a Defense Against LLM-drive Cyberattacks (two GMU authors!). HTT Unsupervised Learning (Daniel Miessler)

Timescale argues that special vector databases are the wrong idea because vectors are more like a special index derived from the data.

“Let the [general] database handle the complexity” of updating that “index” when the data changes. Because it will.

Share%20Selection%20 %20square.

Substack | The Chronicle

For some reason it’s hard to hold this in mind.


❝   In MAGAworld, declarative statements ... serve as identity markers.... They are not for conveying Facts, Truth, Reality.... Whether ... Democrats have and deploy weather weapons could not be more irrelevant; what matters is that _this is the kind of thing we say about Democrats_

Would people who talk about weather weapons agree?

And was “Defund the police” similar?

Earlier AJ linked from a recent post. Insightful as usual. teachers at the margins – The Homebound Symphony

Bizarre editing glitch in a new Science article about possible image manipulation in Alzheimer’s studies:

Accordingalpha-synuclein and might to Prothena, the drug blocks the spread of toxic slow the progression of Parkinson’s movement disorders and dementia.

❝   the peril of AI is the same as the promise of AI: it’s a thoughtlessness enabler.

Quote by Kozyrkov.
❝   The difficulty of getting the answer was often a filter that ensured only those who understood the problem deeply would arrive at a solution.

kozyrkov.medium.com/strawberrys-paradox, by Cassie Kozyrkov

An excellent article, though reading in full probably requires you join Medium.

Interesting abstract from Herzenstein et al suggests that replicable studies are transparent and confident relative to non-replicable ones.

Alas for itself, the abstract is timid. They “allude to the possibility that”.

Even if true, likely temporarily so. But I’ve requested the full text.

Daniel Lakens on why we won’t move beyond p<.05. Key: few really offered alternatives.

Part 2 of an excellent 2-part reflection on the APA special issue 5 years ago.

In-depth review of pending Metascience reforms at NIH by Stuart Buck at GoodScience. Excellent in-depth commentary.

This newsletter covers no fewer than four exciting metascience developments, with huge potential for improving science and medicine at NIH and elsewhere.

Including:

  • FY24 Appropriations Bill
  • Senate Report of 2023
  • Cassidy Report
  • House Report

This is promising: you can run LLM inference and training on 13W of power. I’ve yet to read the research paper, but they found you don’t need matrix multiplication if you adopt ternary [-1, 0, 1] values.

Daniel Miessler suggests the Left is fueling Trump with a defeatist and anti-American narrative.

I started following Miessler for cyber-security. I like his generally centrist and wide-ranging take, and respect what he’s accomplished with hard work and self study. He’s onto something here.

The Shackles of Convenience, from Dan Miessler.

Found an old tab with a reminder that misinfo isn’t just on the Right.

I like being wrong?

Chesterton - on The Family


❝   The best way that a man could test his readiness to encounter the common variety of mankind would be to climb down a chimney into any house at random, and get on as well as possible with the people inside. And that is essentially what each one of us did on the day that he was born.

Chesterton, Heretics -- On Certain Modern Writers and the Institution of the Family.

In praise of idleness - Bertrand Russel


❝   The modern man thinks that everything ought to be done for the sake of something else, and never for its own sake.

In praise of idleness, by Bertrand Russel. (HTT Daniel Miessler.)

My neighbor’s astonishingly vivid azalea

Starting Harrow by Tamsyn Muir. 📚

Finished The Difficult Subject by (pen name) Molly Macallen, book 2 in the Maddy Shanks mystery series. 📚

Dr Shanks tries to resume her academic life while the trial from book one begins in Philadelphia. But her chair wants her to investigate the the surprising death of her predecessor.

Wim Vanderbauwhede estimates ChatGPT uses ~60x as much energy as Google search. (Geometric mean of other estimates, with analysis.)

“The first step is to draw a diagram. When you draw a diagram you’re loading it into your GPU. That is the key.” ~Casey Handmar on solving problems

The analogical case with humans would be where established authors, for example, sued new and upcoming authors for having learned their craft, in part, by reading the works of established authors.

I suggest the answer, however, is not twisting existing copyright law into performing new functions badly, but in writing new laws that directly address the new problems

~Kevin Korb, Generative AI Does Not Violate Copyright but Needs To


❝   Consider that Amazon has had to cap the number of self-published “books” an author can submit to a mere three books per day

~Cory Doctorow [The Coprophagic AI Crisis](https://pluralistic.net/2024/03/14/inhuman-centipede/#enshittibottification)

Infant Mortality & Decline of the West


❝   Infant mortality, the telltale metric that led him to predict the Soviet collapse half a century ago, is higher in Mr. Biden’s America (5.4 per thousand) than in Mr. Putin’s Russia.

~NYT on [Emmanual Todd & the Decline of the West](https://www.nytimes.com/2024/03/09/opinion/emmanuel-todd-decline-west.html)

Thoughts

The US has infant and maternal mortality problems, but is it this bad, or is it just Russia finally catching up?

  • The CIA World Fact Book estimates 2023 Russia still behind at 6.6 infant deaths per thousand live births, versus 5.1 for the US. For comparison, it estimates 35 European countries are below 5 per thousand, and the US is on par with Poland.
CIA World Factbook table showing estimated 2023 Russian & US infant mortality as 6.6 (Rank 162) and 5.1 (Rank 174) respectively.
  • In contrast, Macrotrends data says Russia has edged ahead at 4.8, while it rates the US worse at 5.5. (US and RU data here.) That’s in line with Todd’s US number, and they claim to source from the UN World Population Prospects, so I’ll presume some overlap there. I don’t know the sources myself.

But here’s a combined trend using Macrotrend’s data, from 1960-2024 (omitting Russia’s disastrous 1950s). Even this data has the US slowly improving, so the story is Russia catching up.

Russia & US Infant Mortality 1960-2024

Possibly relevant: birth rates are similar at 11 & 12 per thousand (Macrotrends).

Either way, Russia is close to the US now, and I’m surprised – my impressions were outdated. But this graph doesn’t seem cause for concern about the US. Comparison to peer democracies might. I’d have to read Todd’s book for the argument.

Other striking thoughts:

A specialist in the anthropology of families, Mr. Todd warns that a lot of the values Americans are currently spreading are less universal than Americans think.

Which thought continues:

In a similar way, during the Cold War, the Soviet Union’s official atheism was a deal-breaker for many people who might otherwise have been well disposed toward Communism.

And despite the US haing ~2.5x Russia’s population (per US Census):

Mr. Todd calculates that the United States produces fewer engineers than Russia does, not just per capita but in absolute numbers.

Though this may reflect his values for what counts as productive (my emphasis):

It is experiencing an “internal brain drain,” as its young people drift from demanding, high-skill, high-value-added occupations to law, finance and various occupations that merely transfer value around the economy and in some cases may even destroy it. (He asks us to consider the ravages of the opioid industry, for instance.)


❝   this plutocratic assumption behind progressive fads

An arresting phrase from Chesterton, What’s Wrong with the World. He says:

modern movements… generally repose upon some experience peculiar to the rich.