The Horse Costume Problem

How the future is accidentally invented

How the future is accidentally invented

Gideon Lewis-Kraus reviews “Kobuk the Destroyer, and Other Tales from the Wild, Unseen World of Test Engineering,” by Alex Davies.

Four in five air freight quotes on cargo.one now go out without human review. Here are the six patterns that build forwarder trust in AI quoting.
We have run enough of these deployments to see the same six patterns emerge.

In the 1960s, worm-training experiments and their strange implications captivated the nation. Columnist Claire L. Evans follows the neuroscientists who attempted to recapture the magic.
In the 1960s, an eccentric behavioral psychologist named James McConnell convinced the scientific establishment that planarian worms, like Pavlov’s dogs, could be classically conditioned — and that memories of this training could be transferred from worm to worm through cannibalism. These bizarre…

On the heels of WWII, a team of psychologists set out to solve global conflict. Their lab? Boys summer camps. Their goal? Set the 11- and 12-year-old boys against one another to discover what, if anything, could restore peace. The result? One of psychology’s most enduring and…
intergroup conflict
manufacture conflict

Everyone knows RCTs are the gold standard of evidence. ….Right?
It is a rare randomized trial (studying a particular intervention with a sufficiently large and well-distributed sample population) that can detect an 0.3% difference in a binary random variable — but Laplace could, more than 200 years ago.
You can be relatively sure that a p-value in one clinical trial conveys the same information as it does in another clinical trial, at least as far as the mathematical model is concerned.

A quick reference

How all good entrepreneurs run experiments at the earliest stages of a business, and how you can use this approach for your own career.
good ‘product conjectures’ have three properties:
They are debatable (that is, it is not immediately obvious that it would work). They are testable (the bet is verifiable using some kind of experiment). They are meaningful (the outcome of the bet, if it works, generates a meaningful impact on some output that leadership cares about).

Seasoned product leader and Slack’s CPO Noah Desai Weiss shares the three-step framework he leans on to make quality product decisions with just the right amount of risk.

Knowing what to test and how to interpret the results based on nuances and oddities of experiments is an important skill for people, not automations.

When solving a difficult problem, re-ask the problem so the solution helps you learn faster.

Running an A/B test is easy. Screwing up an A/B test is even easier.

Have you heard? My new book Continuous Discovery Habits is now available. Get the product trio's guide to a structured and sustainable approach to continuous discovery. I’ve found a visual […]

Increasingly, companies are using experiments to guide them in their decision making—but many are still missing opportunities, or are failing to implement experiments well. When it comes to the rollout of new products, one particularly effective new kind of experiment involves…

Update, Dec 12, 2016: There is a follow up post discussing the outcome of all of this after the election results were known.