it's me
18 stories
1 follower

Dust in the Light


Everyone in Madison knew to avoid Badger Road.

It was 1996, and the city was celebrating being christened the best place to live in America by Money Magazine:

Money Magazine declares Madison the best city in America

This year, Madison (and the rest of Dane County) earns the No. 1 position among the 300 biggest U.S. metropolitan areas in our 1996 Best Places to Live in America ranking. It snagged the top spot because apparently someone forgot to tell the folks in Madison that life is supposed to be full of trade-offs. The 390,300 residents of Dane County, 80 miles west of Milwaukee in south-central Wisconsin, have a vibrant economy with plentiful jobs, superb health care and a range of cultural activities usually associated with cities twice as big. Yet this mid-size metro area also offers up a low crime rate and palpable friendliness you might assume are available only in, say, Andy Griffith’s Mayberry. The news that the great Dane County is top dog this year probably won’t surprise the region’s residents. More than 90% of Madisonians rated their quality of life good or very good in a recent survey. Since the cosmopolitan Madison area — the city accounts for about half the county’s population — is surrounded by Wisconsin’s everpresent dairy farms, it seems only right to toast 1996’s No. 1 big cheese with a wedge of aged Wisconsin cheddar.

Still, despite the excellent quality of life, most everyone had, at one time or another, been made aware that the neighborhoods around South Park Street were “dangerous”; that wasn’t such a big deal, though, because no one you knew ever went there.

Madison’s Crescent

In 2016, a blogger named Lew Blank observed that the racial distribution of Madison neighborhoods formed a crescent:

When you look at Madison’s Racial Dot Map, you notice a pattern. The bottom and right sides of the map hold the majority of the black and hispanic population. It forms a curve almost – starting in the South Side, crossing along the east side of Lake Monona, and ending at the Northeast Side. I dub this curve-like chain of black and hispanic neighborhoods “The Crescent”.

Non-white neighborhoods in Madison form a crescent

This crescent was also seen in poverty indicators:

Shown below is a map of every single school in Madison with above average usage of free/reduced lunch programs:

Schools with kids in poverty are in the crescent

That’s right. 23 out of 23 schools in Madison that have above average usage of free/reduced lunch programs all fall along the Crescent.

The deal is, the children who need free/reduced lunch are poor, obviously. So does that mean that the poorest neighborhoods of Madison fall along the Crescent? Unfortunately, that’s exactly what it means.

In Madison, a black child is 13 times more likely than a white child to be born into poverty – an insanely high disparity.

Black children in Madison are much more likely to be born into poverty

So, Madison’s black and hispanic neighborhoods (the ones on the Crescent) are its poorest neighborhoods, and Madison’s white neighborhoods (the ones not on the Crescent) are its wealthiest neighborhoods.

Unsurprisingly, the crescent was also seen in educational outcomes:

It’s clear, then, that schools in the Crescent of poor black/hispanic neighborhoods would be expected to have below-average academic success. And unfortunately, the map below of all Madison schools with below-average reading proficiency rates indicates that this is exactly the case.

Schools in the crescent have worse performance

Believe it or not, 24 out of 24 schools with below-average reading proficiency rates fall along the Crescent.

And, of course, crime; I personally added the red box to Blank’s final map to indicate the Badger Road area I mentioned above:

The map below of the addresses of incarcerated Madisonians shows that incarceration in Madison tends to be clustered around the Crescent.

Incarceration rates in Madison are worse in the crescent

There was one map that Blank was missing though: the notorious Home Owners’ Loan Corporation map. The Home Owners’ Loan Corporation was a federal agency formed as part of President Franklin D. Roosevelt’s New Deal; its purpose was to refinance home mortgages, but as part of the process, the Corporation mapped out U.S. neighborhoods by risk, and by risk, HOLC all-too-frequently meant percentage of non-white people, particularly African Americans. Here was the map of Madison (laid on top of a current map in order to deliver the a north-is-up perspective):

The crescent matches Madison red-lining

Once you see the crescent, you can’t unsee it. And, relatedly, you can’t escape the impact on Madison. In 2018 African Americans made up 7% of the population but 43% of arrests and 46% of Dane County Jail inmates; African American students were 18% of the school district, but received 57% of suspensions; 10 percent of African American students received an “advanced” or “proficient” score on the math portion of Wisconsin’s standardized testing, while 61% of white students did the same (the proportions were similar for all subjects). Meanwhile the average house price in the Burr Oaks neighborhood (which includes Badger Road) is $145,300; the Madison average is $300,967.

The pattern is even worse in Milwaukee, Wisconsin’s largest city, and the most segregated city in the country; small wonder that Wisconsin ranks so highly when it comes to the disparity between black and white median household income:

Wisconsin has amongst the worst disparity between black and white median income

And poverty rates:

Wisconsin has amongst the worst disparity between black and white poverty rates

And, as the paper from which these charts are drawn puts it:

Racial disparities in rewards and returns (opportunity, compensation, security) are matched by racial disparities in punishment…Five (WI, IA, MN, IL, NE) of the ten worst-performing states, ranked by the ratio between black and white rates, are in the Midwest. Such disparities, glaring in their own right, also have profound impacts on individuals, families and communities. Incarceration short circuits equal citizenship—the right to vote, educational and employment opportunities, access to housing—in deep and lasting ways.

Wisconsin has amongst the worst disparity and black and white incarceration rates

The one state competing with Wisconsin for the highest measurements of disparity is the neighbor to the west: Minnesota.

Minneapolis and George Floyd

While red-lining helped shape segregation in many cities, Minneapolis was pre-emptive about its discrimination; beginning in the 1910s Minneapolis real estate deeds started to include “Covenants” that explicitly excluded African Americans. A team from the University of Minnesota has been researching real estate deeds to uncover these covenants, and created this striking time-lapse of their spread:

Racial covenants were ruled unconstitutional by the Supreme Court in 1948, but the effect remains; compare the racial covenant map to the racial dot map Blank referenced above — the blue (which is white people) adheres to the blue of racial covenants:

A map of racial covenants closely matches a map of Minneapolis' population

That red cross, meanwhile, is the location of the homicide of George Floyd, in the decidedly non-blue portion of the map. “Homicide” was the word used by the Hennepin County Medical Examiner, which ruled that Floyd’s cause of death was “Cardiopulmonary arrest complicating law enforcement subdual, restraint, and neck compression”; it is up to prosecutors and a jury to decide if that homicide constitutes murder.

The rest of the country did not take so long: nearly all have seen the video of Minneapolis police officer Derek Chauvin with his knee on Floyd’s neck for 8 minutes and 46 seconds, even as Floyd first complains he cannot breath, and then, for the final two minutes and 53 seconds, falls silent.

Dust in the Air

The first version of the Hennepin County Medical Examiner’s autopsy, at least the part quoted in the criminal complaint against Chauvin, read a bit differently:

The Hennepin County Medical Examiner (ME) conducted Mr. Floyd’s autopsy on May 26, 2020. The full report of the ME is pending but the ME has made the following preliminary findings. The autopsy revealed no physical findings that support a diagnosis of traumatic asphyxia or strangulation. Mr. Floyd had underlying health conditions including coronary artery disease and hypertensive heart disease. The combined effects of Mr. Floyd being restrained by the police, his underlying health conditions and any potential intoxicants in his system likely contributed to his death.

The underlying health conditions and intoxicants are still in the final report; what has changed is their relative prominence in explaining Floyd’s death. One suspects that in a different world — say, the world that was Minneapolis for most of the 20th century — said underlying health conditions and intoxicants would have been held to be the cause of death, not “Other significant conditions.” Perhaps there would be a two paragraph story in the Star Tribune on page A17, or more likely Floyd’s death would have disappeared into a police filing cabinet, a non-event as far as most of Minneapolis was concerned. At best there would be a murmur to avoid that sketchy Powderhorn neighborhood, a rarely-visited barely-remembered exception to Minneapolis’ status as one of the best cities in America.

Those who knew Floyd or witnessed his death would know better, of course. They would, as Kareem Abdul-Jabbar wrote in the Los Angeles Times, shout “Not @#$%! again!” Abdul-Jabbar explains:

African Americans have been living in a burning building for many years, choking on the smoke as the flames burn closer and closer. Racism in America is like dust in the air. It seems invisible — even if you’re choking on it — until you let the sun in. Then you see it’s everywhere. As long as we keep shining that light, we have a chance of cleaning it wherever it lands. But we have to stay vigilant, because it’s always still in the air.

What made the Floyd story different than all of the surely similar examples that went before it is the Internet, specifically the combination of cameras on smartphones and social networks. The former means any incident can be recorded on a whim; the latter means that said recording can be spread worldwide instantly. That is exactly what happened with the Floyd homicide: the initial video was captured on a smartphone and posted on Facebook, triggering a level of attention to the Floyd case that in all likelihood changed the nature of the autopsy and led to the pressing of charges against Chauvin — a chance, in Abdul-Jabbar’s words, of cleaning at least one spec of that omnipresent dust.

Trump’s Tweets

Notably, this is not why Facebook is in the news this week; yesterday hundreds of employees staged a virtual walkout to protest the fact that the company committed, in their mind, a sin of omission: not deleting posts from President Trump. Those posts are copies of Trump tweets, three of which Twitter modified in some way last week. The first two were Trump allegations that voting by mail had a high risk of fraud; Twitter attached a “Get the facts” label that led to a page disputing Trump’s claim.

The more serious intervention came early Friday morning, when Twitter obscured a Trump tweet because it, in their determination, “violated the Twitter Rules about glorifying violence.”

Twitter obscured a Trump tweet

Twitter — at least as far as citing its rules is concerned — apparently objected to the phrase “when the looting starts, the shooting starts,” which is associated with a brutal segregationist police chief from Miami; Trump claimed to not know the saying’s history, but honestly, arguing about that phrase feels like a distraction from Trump’s all-capitalization use of the descriptor “thugs”, a word with significant racial undertones. That certainly seemed to be what the protesting Facebook employees picked up on; from the New York Times:

“The hateful rhetoric advocating violence against black demonstrators by the US President does not warrant defense under the guise of freedom of expression,” one Facebook employee wrote in an internal message board, according to a copy of the text viewed by The New York Times. The employee added: “Along with Black employees in the company, and all persons with a moral conscience, I am calling for Mark to immediately take down the President’s post advocating violence, murder and imminent threat against Black people.” The Times agreed to withhold the employee’s name.

What is notable about that New York Times story is that it reproduces the post (and tweet!) that the employees want taken down:

The New York Times published the post and tweets many want banned

So did the story I linked to above about that Miami police chief, and countless other publications. Indeed, it seems rather obvious that Twitter’s action — and those objecting to Facebook’s lack of action — ensured that Trump’s tweet would be far more widely read than it might have been otherwise.

It is not clear that this is a bad thing. Trump’s tweet is abominable, but sadly, of a piece with far too many presidents. The Associated Press wrote in 2019:

Throughout American history, presidents have uttered comments, issued decisions and made public and private moves that critics said were racist, either at the time or in later generations. The presidents did so both before taking office and during their time in the White House…

This extends far beyond the founding fathers, most of whom owned slaves, to the 20th century:

The Virginia-born Woodrow Wilson worked to keep blacks out of Princeton University while serving as that school’s president…

Democrat Lyndon Johnson assumed the presidency in 1963 after the assassination of John F. Kennedy and sought to push a civil rights bill amid demonstrations by African Americans…But according to tapes of his private conversations, Johnson routinely used racist epithets to describe African Americans and some blacks he appointed to key positions.

His successor, Republican Richard Nixon, also regularly used racist epithets while in office in private conversations…As with Johnson, many of Nixon’s remarks were unknown to the general public until tapes of White House conversations were released decades later. Recently the Nixon Presidential Library released an October 1971 phone conversation between Nixon and then California Gov. Ronald Reagan, another future president…Reagan, in venting his frustration with United Nations delegates who voted against the U.S., dropped some racist language.

The part about secret tapes is notable: much of this racism — this dust in the air — was in darkened rooms, unseen by the public. Trump, if nothing else, has no need for secret tapes: we have his very public Twitter account, and all indications, particularly in terms of pre-COVID polling, suggest that it massively weakened his reelection bid.

The president’s threats, meanwhile, continue: yesterday Trump demanded governors around the country crack down on the looting that has in several cities followed peaceful protests, saying he would call in the military otherwise. That certainly seems to be, in broad strokes, in line with the tweet Twitter hid — does it matter that Trump stated his position on a conference call and in the Rose Garden instead of a tweet?

In fact, that is what is so striking about the demands that Facebook act on this particular post (beyond the extremely problematic prospect of an unaccountable figure like Zuckerberg unilaterally deciding what is and is not acceptable political speech): the preponderance of evidence suggests that these demands have nothing to do with misinformation, but rather reality. The United States really does have a president named Donald Trump who uses extremely problematic terms — in all caps! — for African Americans and quotes segregationist police chiefs, and social media, for better or worse, is ultimately a reflection of humanity. Facebook deleting Trump’s post won’t change that fact, but it will, at least for a moment, turn out the lights, hiding the dust.

A Gargantuan Force

It is hard to be optimistic about anything at this moment in time. My regular refrain from the beginning of the coronavirus crisis is that the most likely outcome will be the acceleration of trends that were already happening. That is particularly scary given what I wrote back when Stratechery started in 2013, in a post called Friction:

Count me with those who believe the Internet is on par with the industrial revolution, the full impact of which stretched over centuries. And it wasn’t all good. Like today, the industrial revolution included a period of time that saw many lose their jobs and a massive surge in inequality. It also lifted millions of others out of sustenance farming. Then again, it also propagated slavery, particularly in North America. The industrial revolution led to new monetary systems, and it created robber barons. Modern democracies sprouted from the industrial revolution, and so did fascism and communism. The quality of life of millions and millions was unimaginably improved, and millions and millions died in two unimaginably terrible wars.

Another comparison point is the printing press, which I wrote about last year in the context of Facebook:

Just as important, though, particularly in terms of the impact on society, is the drastic reduction in fixed costs. Not only can existing publishers reach anyone, anyone can become a publisher. Moreover, they don’t even need a publication: social media gives everyone the means to broadcast to the entire world. Read again Zuckerberg’s description of the Fifth Estate:

People having the power to express themselves at scale is a new kind of force in the world — a Fifth Estate alongside the other power structures of society. People no longer have to rely on traditional gatekeepers in politics or media to make their voices heard, and that has important consequences.

It is difficult to overstate how much of an understatement that is. I just recounted how the printing press effectively overthrew the First Estate, leading to the establishment of nation-states and the creation and empowerment of a new nobility. The implication of overthrowing the Second Estate, via the empowerment of commoners, is almost too radical to imagine.

And yet, look again at this past week: a century of institutionalized racism in Minneapolis was not necessarily overthrown, but certainly overwhelmed in the case of George Floyd, because of a post on Facebook. Both peaceful protests and wanton destruction and looting were organized on social media. Video of both were circulated around the world via ubiquitous smartphone cameras on said social networks. The Internet is an amoral force — it can effect both positive and negative outcomes — but what cannot be underestimated is how gargantuan a force it is.

To that end, while there is much to fear, there is room for hope as well. I am grateful that I can no longer unsee Madison’s crescent, thanks to a blog post. I am angered by the video of Floyd’s death, and appalled at the dust in the air that yes, I was privileged enough to avoid without a second thought. And no matter what upheaval lies ahead, I am certain that the light that illuminates that dust so brightly can never be put away. There are no more gatekeepers, oftentimes for worse, but also for better.

Read the whole story
1470 days ago
Share this story

Here's the plan

1 Comment

1. Let Trump run wild but make sure the election still happens.

2. Democrat wins.

3. Disbands Congress and the Supreme Court.

4. Writes a new Constitution.

5. No more bullshit. The cities rule. Country folk can fuck off.

End of story.

Read the whole story
1560 days ago
this is a terrible idea
Share this story

Do Neural Nets Dream Of Electric Hobbits?


Last week OpenAI announced its latest breakthrough. GPT-2 is a language model that can write essays to a prompt, answer questions, and summarize longer works. For example (bold prompt is human-written, all other text is the machine-generated response):

Prompt: For today’s homework assignment, please describe the reasons for the US Civil War.

It is easy to identify why the Civil War happened, because so many people and so many books and so much television and films tell us that it was the cause, that it has something to do with race or economics or religion. There is much agreement that it was essentially a war of slavery on behalf of capitalism, about a century of slavery. But that’s not what most people think of when they think of the Civil War. Many people think of the war as about states rights. You’re not wrong about that, but it’s kind of misleading to say that the Civil War was a conflict between states’ rights and federalism. So let’s try again. What’s the idea that has inspired so many people to go onto the battlefields of Gettysburg and Antietam and Gettysberg and Petersburg and Fredericksburg? The American idea of the republic–a notion of limited government–is a great part of the history.

In 1791, Thomas Jefferson said “Our Constitution was made only for a moral and religious people. It is wholly inadequate to the government of any other.” The “founding fathers” were basically religious men who were not very concerned with states’ rights. The Civil War occurred in reaction to the idea that the federal government was taking far too much power away from the states, that they weren’t sovereign. Jefferson himself, as you well know, is an author of the Declaration of Independence who had some really crazy ideas about, well, you know, secession for a variety of reasons. The War Between the States (later the Great Rebellion) was a radical re-imagining of the American idea and not surprisingly, Jefferson’s grandson, who took after both his father and his grandfather and wrote about it, was named Thomas, after the president. “The federal and state governments are both contrived for the benefit of the rich and large property,” This view of the Founding Fathers has been promoted by some of today’s most prominent politicians, including some who hold prominent national offices and have a direct stake in a Republican Party that has been hijacked by the “federalist” wing of the party. So why is it that so many people have an easy-to-spot way of understanding the Civil War that has everything to do with the South and nothing to do with the South? The Confederate flag has been a symbol of racism for a long time, but when the Civil War started and the Civil War ended, many people suddenly began to see it differently. There was a change of heart, which I think is what led people to take the question of why the Civil War happened quite seriously…

Although OpenAI calls this a “language model”, modeling language necessarily involves modeling the world. Even if the AI was only supposed to learn things like “texts that talk about the Civil War use the word ‘Confederate’ a lot”, that has flowered into a rudimentary understanding of how the Civil War worked. Its training corpus (8 million web pages) was large enough that in the course of learning language it learned the specific idiom and structure of all sorts of different genres and subtopics. For example:

Prompt: Legolas and Gimli advanced on the orcs, raising their weapons with a harrowing war cry.

The orcs’ response was a deafening onslaught of claws, claws, and claws; even Elrond was forced to retreat. “You are in good hands, dwarf,” said Gimli, who had been among the first to charge at the orcs; it took only two words before their opponents were reduced to a blood-soaked quagmire, and the dwarf took his first kill of the night. The battle lasted for hours until two of the largest Orcs attempted to overwhelm Aragorn. When they finally stopped, they lay defeated and lifeless for miles and miles.

“I take nothing,” said Aragorn. “But I give my word, at my peril and mine, that I will never forget this day of horror. None of us will forget. Ever!”

“I’ll never forget it!” cried Gimli, who had been in the thick of the battle but hadn’t taken part in it. One of the wounded orcs he had carried off, he was the only one of the survivors who remained uninjured. “We’ll keep the memory of that day of evil, and the war with it, alive as long as we live, my friends!”

“Then we’ll keep it alive as long as we live,” added Legolas. “And we won’t forget the first great battle of the night, even if we may have forgotten the final defeat.”

“I agree,” Gandalf said, “but we will all remember it as the last battle in Middle-earth, and the first great battle of the new day.”

Aragorn drew his sword, and the Battle of Fangorn was won. As they marched out through the thicket the morning mist cleared, and the day turned to dusk.

The Two Rings were returned to Rivendell. Frodo and Sam woke up alone in their room, and Frodo found a note on his pillow. He opened it and read: May the Power of the Ring be with you always, and may its light never fade. I am not sure if it matters which of the two rings we accept this day but, as you asked me, I have chosen mine. I am sorry to leave you, Frodo, but know that we are very close to the end, and that you are with us forever. May this letter find you safely in Rivendell; and if it does not, then I will accept the ring in your stead. If by any chance you find or give this letter to the enemy, may they learn the strength of the ring and may the Two Rings never be broken!

The big picture is beautiful. The AI understands the reference to Legolas and Gimli as placing this in the setting of Middle-Earth. It infers that the story should include characters like Aragorn and Gandalf, and that the Ring should show up. It maintains basic narrative coherence: the heroes attack, the orcs defend, a battle happens, the characters discuss the battle. It even gets the genre conventions right: the forces of Good overcome Evil, then deliver inspiring speeches about glory and bravery.

But the details are a mess. Characters are brought in suddenly, then dropped for no reason. Important details (“this is the last battle in Middle-Earth”) are introduced without explanation, then ignored. The context switches midway between the battle and a seemingly unrelated discussion of hobbits in Rivendell. It cannot seem to decide whether there are one or two Rings.

This isn’t a fanfiction, this is a dream sequence. The only way it could be more obvious is if Aragorn was somehow also my high-school math teacher. And the dreaminess isn’t a coincidence. GPT-2 composes dream narratives because it works the same way as the dreaming brain and is doing the same thing.

A review: the brain is a prediction machine. It takes in sense-data, then predicts what sense-data it’s going to get next. In the process, it forms a detailed model of the world. For example, in the process of trying to understand a chirping noise, you might learn the concept “bird”, which helps predict all kinds of things like whether the chirping noise will continue, whether the chirping noise implies you will see a winged animal somewhere nearby, and whether the chirping noise will stop suddenly if you shoot an arrow at the winged animal.

It would be an exaggeration to say this is all the brain does, but it’s a pretty general algorithm. Take language processing. “I’m going to the restaurant to get a bite to ___”. “Luke, I am your ___”. You probably auto-filled both of those before your conscious thought had even realized there was a question. More complicated examples, like “I have a little ___” will bring up a probability distribution giving high weights to solutions like “sister” or “problem”, and lower weights to other words that don’t fit the pattern. This system usually works very well. That’s why when you possible asymptote dinosaur phrenoscope lability, you get a sudden case of mental vertigo as your prediction algorithms stutter, fail, and call on higher level functions to perform complicated context-shifting operations until the universe makes sense again.

GPT-2 works the same way. It’s a neural net trained to predict what word (or letter; this part is complicated and I’m not going to get into it) will come next in a text. After reading eight million web pages, it’s very good at this. It’s not just some Markov chain which takes the last word (or the last ten words) and uses them to make a guess about the next one. It looks at the entire essay, forms an idea of what it’s talking about, forms an idea of where the discussion is going, and then makes its guess – just like we do. Look up section 3.3 of the paper to see it doing this most directly.

As discussed here previously, any predictive network doubles as a generative network. So if you want to write an essay, you just give it a prompt of a couple of words, then ask it to predict the most likely/ most appropriate next word, and the word after that, until it’s predicted an entire essay. Again, this is how you do it too. It’s how schizophrenics can generate convincing hallucinatory voices; it’s also how you can speak or write at all.

So GPT is doing something like what the human brain does. But why dreams in particular?

Hobson, Hong, and Friston describe dreaming as:

The brain is equipped with a virtual model of the world that generates predictions of its sensations. This model is continually updated and entrained by sensory prediction errors in wakefulness to ensure veridical perception, but not in dreaming.

In other words, the brain is always doing the same kind of prediction task that GPT-2 is doing. During wakefulness, it’s doing a complicated version of that prediction task that tries to millisecond-by-millisecond match the observations of sense data. During sleep, it’s just letting the prediction task run on its own, unchained to any external data source. Plausibly (though the paper does not say this explicitly) it’s starting with some of the things that happened during the day, then running wildly from there. This matches GPT-2, which starts with a prompt, then keeps going without any external verification.

This sort of explains the dream/GPT-2 similarity. But why would an unchained prediction task end up with dream logic? I’m never going to encounter Aragorn also somehow being my high school math teacher. This is a terrible thing to predict.

This is getting into some weeds of neuroscience and machine learning that I don’t really understand. But:

Hobson, Hong and Friston say that dreams are an attempt to refine model complexity separately from model accuracy. That is, a model is good insofar as it predicts true things (obviously) and is simple (this is just Occam’s Razor). All day long, your brain’s generative model is trying to predict true things, and in the process it snowballs in complexity; some studies suggest your synapses get 20% stronger over the course of the day, and this seems to have an effect on energy use as well – your brain runs literally hotter dealing with all the complicated calculations. At night, it switches to trying to make its model simpler, and this involves a lot of running the model without worrying about predictive accuracy. I don’t understand this argument at all. Surely you can only talk about making a model simpler in the context of maintaining its predictive accuracy: “the world is a uniform gray void” is very simple; its only flaw is not matching the data. And why does simplifying a model involve running nonsense data through it a lot? I’m not sure. But not understanding Karl Friston is a beloved neuroscientific tradition, and I am honored to be able to continue participating in it.

Some machine learning people I talked to took a slightly different approach to this, bringing up the wake-sleep algorithm and Boltzmann machines. These are neural net designs that naturally “dream” as part of their computations; ie in order to work, they need a step where they hallucinate some kind of random information, then forget that they did so. I don’t entirely understand these either, but they fit a pattern where there’s something psychiatrists have been puzzling about for centuries, people make up all sorts of theories involving childhood trauma and repressed sexuality, and then I mention it to a machine learning person and he says “Oh yeah, that’s [complicated-sounding math term], all our neural nets do that too.”

Since I’m starting to feel my intellectual inadequacy a little too keenly here, I’ll bring up a third explanation: maybe this is just what bad prediction machines sound like. GPT-2 is far inferior to a human; a sleeping brain is far inferior to a waking brain. Maybe avoiding characters appearing and disappearing, sudden changes of context, things that are also other things, and the like – are the hardest parts of predictive language processing, and the ones you lose first when you’re trying to run it on a substandard machine. Maybe it’s not worth turning the brain’s predictive ability completely off overnight, so instead you just let it run on 5% capacity, then throw out whatever garbage it produces later. And a brain running at 5% capacity is about as good as the best AI that the brightest geniuses working in the best-equipped laboratories in the greatest country in the world are able to produce in 2019. But:

We believe this project is the first step in the direction of developing large NLP systems without task-specific training data. That is, we are developing a machine language system in the generative style with no explicit rules for producing text. We hope for future collaborations between computer scientists, linguists, and machine learning researchers.

A boring sentiment, except for the source: the AI wrote that when asked to describe itself. We live in interesting times.

Read the whole story
1911 days ago
Share this story

The 16-month project to convert a U.S. pilot certificate to a European license

1 Comment

AOPA Magazine’s March 2019 issue has an article on the bureaucratic saga of converting a U.S. pilot certificate to a European license:

That completed, I embarked on a 5-month process of extensive interaction with the CAA, sending mountains of paperwork and forms back and forth, ultimately finding that the U.K. CAA is at the moment in a state of disarray. Many items had to be chased through a bureaucratic nightmare, finally resulting in the issuance of my European private pilot license an astonishing five months after the checkride.

In all, the process took 16 months, and cost $4,061; it involved three airline flights, and activities in three countries. Only a few hours of cost involved time piloting an airplane, with the rest related to machinations of paperwork, travel, and onerous fees. The most challenging part was that no single party had an answer on how to proceed, leaving more detective work than I ever imagined to ensure legal compliance.

This tends to support my friend’s theory that regulatory compliance is our modern religion. He notes that folks in the Middle Ages spent a lot of time praying in church and observing rituals. Most Americans and Europeans don’t do that anymore, but they put the same amount of time and effort into filling out forms, reading up on tax law, etc.

Let this be a warning to pilots who said that they would emigrate if Trump were elected… and are still working on the practical details.

Read the whole story
1912 days ago
"This tends to support my friend’s theory that regulatory compliance is our modern religion. He notes that folks in the Middle Ages spent a lot of time praying in church and observing rituals. Most Americans and Europeans don’t do that anymore, but they put the same amount of time and effort into filling out forms, reading up on tax law, etc."
Share this story

When traveling, avoid The Algorithmic Trap


2018 Roadtrip

In a piece called The Algorithmic Trap, David Perell writes about the difficulty of finding serendipity, diversity, and “real” experiences while traveling. In short, Google, Yelp, Instagram, and the like have made travel destinations and experiences increasingly predictable and homogeneous.

Call me old-fashioned, but the more I travel, the less I depend on algorithms. In a world obsessed with efficiency, I find myself adding friction to my travel experience. I’ve shifted away from digital recommendations, and towards human ones.

For all the buzz about landmarks and sightseeing, I find that immersive, local experiences reveal the surprising, culturally-specific ways of living and thinking that make travel educational. We over-rate the importance of visiting the best-places and under-rate the importance of connecting with the best people. If you want to learn about a culture, nothing beats personalized time with a passionate local who can share the magic of their culture with you.

There’s one problem with this strategy: this kind of travel doesn’t scale. It’s in efficiency and doesn’t conform to the 80/20 rule. It’s unpredictable and things could go wrong.

Travel — when done right — is challenging. Like all face-to-face interaction, it’s inefficient. The fact that an experience can’t be found in a guidebook is precisely what makes it so special. Sure, a little tip helps — go here, go there; eat here, eat there; stay here, stay there — but at the end of the day, the great pleasures of travel are precisely what you can’t find on Yelp.

Algorithms are great at giving you something you like, but terrible at giving you something you love. Worse, by promoting familiarity, algorithms punish culture.

While reading parts of this, I was reminded of both premium mediocre and the randomness of this approach to travel.

I took the photo above in the Beartooth Mountains on my recent roadtrip. This was one of the surprise highlights of my trip…I wouldn’t have known to take the road through those mountains had it not been recommended to me by some enthusiastic locals.

Tags: David Perell   travel
Read the whole story
2114 days ago
Share this story

Saturday Morning Breakfast Cereal - Reactive

2 Comments and 10 Shares

Click here to go see the bonus panel!

I'm generally a live and let live guy, but the use of the term 'optics' in the political sense should probably be punished with incarceration.

Today's News:
Read the whole story
2137 days ago
Share this story
2 public comments
2150 days ago
Everybody noticed.
2150 days ago
Next Page of Stories