The reason LLMs will never work

“Facebook parent company Meta Platforms recently claimed the largest version of their upcoming Llama 3 model — which has not yet been released — has been trained on up to 15 trillion tokens, each of which can represent a piece of a word.”

This is not the way language works! This is the doctrine of “logical atomism,” brainchild of Bertrand Russell and his posse, which was roundly discredited in the 1940s (even though Russell continued to believe it, much like a Japanese soldier on a remote island refusing to accept the end of WW II).

They’re using a model of language that is essentially a laughingstock in the 21st century.

If this model were correct, then *people* would “run out of training data,” but they don’t, because that’s not a thing.

Part of Wittgenstein’s refutation of logical atomism was the “rule-following paradox.” You can’t say that people learn or use language by following rules, because for every rule, if you want it to be explicit you need a meta-rule that tells how to apply the rule, and there’s an infinite regress.

The AI people are running up against this in real life (and vindicating Wittgenstein). They have to employ armies of third-world wage slaves to e.g, tag images. “This is a shoe, this is a coat,” etc. They have rule books for when to call something this or that, but the rule books have become insanely bloated and complex, demonstrating the infinite regress of the rule-based approach.

It will never work.

Posted in Uncategorized | Leave a comment

A sitcom about trying to launch the Boeing Starliner. Every episode is about some new brainy (or harebrained) idea about how to fix it, but in the end it always fails.

Posted in Uncategorized | Leave a comment

Amazon’s Swag Store Sells Neck Fans to Prevent Workers from Overheating

Employees can buy the fans at an in-warehouse store with “Swag Bucks” they earn for good behavior and team bonding activities.

Posted in Uncategorized | Leave a comment

Ann Coulter does everything Joseph Goebbels did, but backwards and in high heels.

Posted in Uncategorized | Leave a comment

New Hampshire primary proves we need ranked-choice voting for president

Ranked-choice voting tells us not just who everyone’s first choice is, but who everyone could agree on.

Posted in Politics | Leave a comment

Amazon is opening a supermarket with no cashiers. Is Whole Foods next?

Posted in Corporate greed | Leave a comment

RIP Larry Tesler, the Inventor of Copy-Paste

Tesler, who worked at Apple for decades, invented copy-paste functionality while at Xerox PARC and is responsible for a major deal that helped turn ARM into a dominant force in computers.

Posted in Tech History | Leave a comment

The Dumbest Business Idea Ever. The Myth of Maximizing Shareholder Value

Posted in Corporate greed | Leave a comment

Accomplishments of the “Democratic Establishment”

Women's suffrage
  • Civil Rights Act –
  • Voting Rights Act –
  • Women’s Right to Vote –
  • Equal Pay Act –
  • Clean Air Act –
  • Minimum wage –
  • 40-hour work week –
  • Overtime –
  • Unemployment Insurance –
  • Putting people on the Moon –
  • Inventing the Internet
  • First black president
  • First female major-party candidate
  • Saving the country from a GOP-caused depression (twice)
  • Social Security
  • Medicare
  • Medicaid
  • Healthcare Reform
  • Food Safety
  • New Deal
  • Great Society
  • Peace Corps,
  • Vista,
  • Job Corps
  • Motor Voter
  • Consumer Protection
  • FDIC
  • Banking and Wall Street Regulations
  • SEC
  • Federal Reserve System
  • Anti-trust Legislation
  • Head Start
  • School Lunch and Breakfast Programs
  • Endangered Species Act
  • Veterans’ Benefits
  • GI Bill
  • UN
  • NATO
  • Marshall Plan
  • Vehicles Safety Requirements, Reduced Emissions, and Fuel Economy Standards (CAFE)
  • TVA
  • PBS, NPR

Posted in Politics | Leave a comment

Why Term Limits are Bad

  • Term limits are a corporate scam to give corporations even more political power than they already have.
  • Term limits just guarantee that elected officials will be perpetual amateurs, while corporations can hire career professional lobbyists who will run circles around them.
  • Term limits to NOT guarantee you get better people in government, but they DO ensure the people you want to keep have to leave.
  • They also discourage dedicated public-minded individuals from entering public service, since they can have no career stability.
  • They also guarantee a speedup of the revolving door, where newly elected legislators will pass legislation that favors corporations, and then get rewarded by those corporations with cushy jobs when their term limit expires.
  • Or alternatively, they encourage politicians to jump up the ladder to ever-higher office instead of sticking around to serve their constituents. The only way to move up fast is to get money from corporations and special interest groups, who then own the offices they paid for.
  • Also term limits will encourage exactly the kind of behavior they are intended to prevent, since legislators who have no chance of being re-elected will have no incentive to pass laws that benefit their constituents.
Posted in Politics | Leave a comment