Monday, May 28, 2012

GATCACA

In many American states it is legal to screen and select on the basis of sex, for non-medical reasons. In fact, a 2006 study (see below) found that 9% of [preimplanation genetic diagnosis] procedures carried out in [in-vitro fertilization] clinics in the U.S. were performed for this reason. Other reasons include screening for an embryo with the same immune type (“HLA type”) as a current child who is ill and requires a transplant of some sort. Screening for these “savior siblings” was done in 1% of PGD procedures. And 3% used it for a reason I personally find jarring – to specifically select embryos with a mutation causing a genetic condition. This is usually in cases where both parents have either deafness or dwarfism and they want their child to be similarly affected. This gets into the political movement objecting to society labelling conditions as “disabilities”. I can sympathise with that to some degree – more for some conditions than others – but I think, if it were my child, I would still rather he or she could hear.
That's Kevin Mitchell, discussing GATTACA, an entertaining sci-fi movie with a respectable 7.8 imdb rating. Spoiler alert, the premise of the movie is that at some point in the future there will be strong stratification of people into two classes, the "valids" and the "invalids", based on whether they had healthy traits selected for via preimplanation genetic diagnosis.

It seems to me highly unlikely (<0.01%) that a nightmare scenario of this sort would actually occur. One of the main reasons is because of the large plurality of values among parents, as seen above. A prevailing reason people have kids is to propagate a form of themselves into the future, and in many ways it defeats the purpose when you select against certain traits or even perform some sort of genetic engineering.

The other reason is something we know now better than we did 15 years ago, when GATTACA was released. And that is that DNA doesn't actually explain all that much of physiology and behavior--there are also strong epigenetic effects as well as stochastic effects of gene expression

Sunday, May 27, 2012

No Darkness But Ignorance

Here's Nancy Kanwisher's suggestion on how to improve the field of neuroimaging:
NIH sets up a web lottery, for real money, in which neuroscientists place bets on the replicability of any published neuroimaging paper. NIH further assembles a consortium of respected neuroimagers to attempt to replicate either a random subset of published studies, or perhaps any studies that a lot of people are betting on. Importantly, the purchased bets are made public immediately (the amount and number of bets, not the name of the bettors), so you get to see the whole neuroimaging community’s collective bet on which results are replicable and which are not. Now of course most studies will never be subjected to the NIH replication test. But because they MIGHT be, the votes of the community are real.... 
First and foremost, it would serve as a deterrent against publishing nonreplicable crap: If your colleagues may vote publicly against the replicability of your results, you might think twice before you publish them. Second, because the bets are public, you can get an immediate read of the opinion of the field on whether a given paper will replicate or not.
This is very similar to Robin Hanson's suggestion, and since I assume she came up with the idea independently, it bodes well for its success. Both Hanson and Kanwisher are motivated to promote an honest consensus on scientific questions.

When John Ioannidis came to give a talk at the NIH (which was interesting), I asked him (skip to 101:30) for his thoughts on this idea. He laughed and said that he has proposed something similar.

Could this actually happen? Over the next ten years, I'd guess almost certainly not in this precise form; first, gambling is illegal in the US, and second, the markets seem unlikely to scale all that well.

However, the randomized replication portion of the idea seems doable in the near term. This is actually now being done for psychology, which is a laudable effort. It seems to me that randomized replications are likely precursors to any prediction markets, so this is what interested parties should be pushing now.

One objection is that these systems might encourage scientists to undertake more iterative research, as opposed to game-changing research. I have two responses. First, given the current incentives in science (i.e., the primacy of sexy publications), this might actually be a useful countervailing force.

Second, it seems possible (and useful) to set up long-standing prediction markets for a field, such as, "will the FDA approve an anti-amyloid antibody drug to treat Alzheimer's disease in the next ten years?". This would allow scientists to point to the impact that their work had on major questions, quantified by (log) changes in the time series of that market after a publication. 

Saturday, May 26, 2012

Evaluating The Regret Heuristic, Part II

In a comment to my post on how our regrets change over time, Eric Schwitzgebel asks, 
But why adopt regret minimization as a goal at all? Regret seems distorted by hindsight bias, status quo bias, and sunk cost bias, at least.
I've written before that projecting your future views about your present actions can be a good way to make decisions. So, Eric's prompting is a good occasion to re-evaluate that.

Given perfect information, the theoretically best way to make decisions is to 1) calculate the costs and benefits of each possible outcome, 2) estimate how your choice affects the relative probability of those outcomes, 3) use the costs and benefits as inputs to some sort of valuation function, and 4) make the decision with the highest probabilistic value. 

Cost-benefit analysis is a common way to implement this, with, say, QALYs as the value measure. If you have perfect information, this is just math. 

But as Ben Casnocha says, if you don't have enough information, that framework can break down. In particular, even when #2 is pretty straightforward, #1 can still be very tricky. For example, although studying for the LSAT makes it much more likely that I will earn a JD, it's still hard to quantify the precise costs and benefits of entering that earning that degree. 

Here is where the regret heuristic can be useful. Instead of explicitly tallying each cost and benefit, it asks: in total, which would you regret more: studying or not studying? 

This is in fact a simplifying measure, but there remains oodles of freedom in how you perform the regret estimation. For example, you can:
Ultimately, I still think that the regret heuristic can be a useful one. But tread carefully, as there are many crucial micro-decisions to make; it's not magic. 

Friday, May 25, 2012

Age's Stealing Steps

Michael Wolff has written a gripping but narrative-heavy article about the troubles he has experienced in addressing his mother's worsening dementia. It is hard not to feel for him and his family. Still, I think there are two perspectives which his piece underemphasized:

1) Many debilitated but cognitively intact individuals do have a good quality of life. For example, in a recent survey of 62 seniors with an average of 2.4 daily living dependencies and fairly good cognitive well-being (≥ 17/30 on the MMSE), 87% reported that they had a quality of life somewhere in the fair to very good range. I consider this to be a testimony to the resiliency of the human psyche. Also, it makes me worry that people will read the article and think that LTC insurance is only useful for those with dementia, which Wolff implies, when that is far from the case.

2) Why is it that many of the doctors depicted his story seem so unhelpful? There's little doubt that fear of litigation plays a role. For example, in a Mar '12 study, over half of the 600+ palliative care physicians surveyed reported being accused of euthanasia or murder within the past five years. In many respects this is a legislative issue, and I wish his article had discussed that angle more.

Many pointers in this post go to the excellent blog GeriPal

Thursday, May 24, 2012

Should Revenge Have Bounds?

I recently finished Steven Pinker's book attempting to explain the decline of human-on-human violence over the last twenty thousand years. All in all, I recommend it. It has noteworthy psychology nuggets on nearly every page, explained with good data and lucid metaphors. I especially enjoyed how he built up many cute explanations of various phenomena--like the Freakonomics-popularized abortion theory of the crime rate decrease in the 1990s--only to soundly and evenly debunk them. My two major points of disagreement:

1) As Tyler Cowen argues, it is possible that although the mean number of causalities from interstate conflicts has been falling, the variance has been increasing. Aside from WWII, we can't easily observe this variance, though we can see signs of it in events like the Cuban Missile Crisis. Pinker employs per-capita log-scales for many of his charts and on these WWII does not seem quite as bad, but still it sticks out indelibly.

Wisely, Pinker does not project the decrease in violence indefinitely into the future, rather seeking to explain what we have observed so far, so his thesis is technically immune to this critique. Still, I imagine that there have been some not-easily observed historical aberrations which, if they had gone differently, would have meant that this book would never had been written. The winner's curse comes to mind.

2) As one reads about the incredible violence that occurs in US prisons, it is difficult not to wonder whether the benefits to decreasing violence always outweigh the costs. I have previously written about the protection vs freedom trade-off. The laudable decrease in person-to-person violence comes at the cost of constraining the actions of individuals by probabilistically putting them in prison. This is an imperfect process and has negative externalities in that it further exacerbates the burden of those locked up for non-violent crimes.

So, I would have liked to see more discussion about the violence in modern-day prisons and whether it is more apt to say that violence has been displaced rather than decreased. In a provocative article, Christopher Glazek argues that the US should be more like the UK and have slightly looser violent crime convictions which would make the conditions in prison slightly less awful. In most cases I would probably come down in favor of protecting innocent bystanders, but it is a conversation that needs to happen and that I wish Pinker had addressed.