Q: Goal line or touchback?
Pretend you're an NFL kicker about to take a kickoff. Should you always aim for a touchback, kicking the ball as far past the endzone as you can manage? Or should you try to kick it just before the goal line, forcing the receiver to attempt an return?
I tried to get at this question empirically, using as data every kickoff and its respective return in all games of the 2002 - 2012 seasons. (This includes the post-seasons as well; see below for the source data.) I've removed onside kicks, kicks that went out of bounds, and kicks that the receiver took as touchbacks, so that the resulting dataset can be thought of as all "normal" kickoffs that the receiver returned.
20,703 normal kickoff returns
A 2D histogram of this data can be seen below. The x-axis is the yard line the ball was kicked to (i.e. the yard the kick was caught at), and the y-axis is the yard the receiver returned the kick to (i.e the yard the receiver was tackled at).
The color of each square represents the number of times the respective kickoff return occurred in the data. For example, the black square at (x=98, y=76) tells us that kicks caught at the receiving team's 2-yard line (i.e. 98 yards from the goal) and returned to the receiving team's 24-yard line happened relatively often.
I've also added a few colored layers to the graph, which you can toggle on/off with the controls at the side, to make this graph easier to read.
A: If you're a kicker, aim for a touchback every single time.
This graph makes the answer fairly clear: Judging by the number of dark squares not covered by the "Returned before 20 yd line" layer, most receivers take their kickoff return further than the 20. As a kicker, then, you'd always prefer them to take a touchback than to attempt a return.
That's kind of obvious though, isn't it? If you only kick it to the receiving team's 30-yard line, of course the return will be better than a touchback! In truth, the graph above may be interesting, but it doesn't answer the initial question that thoughtfully at all.
A better sample: kickoffs to the endzone
The kickoffs to the endzone (highlighted by the "Kicked to endzone" layer in the graph above) might be a better place to focus. Of all the kickoffs to the endzone, how far did the receivers usually make it down the field when they didn't take the touchback? It's hard to tell from the above graph, but it looks like most of the returns made it beyond the 20-yard line. If this is true, it would seem that receivers are making the judgment call of touchback-vs-return fairly well; on average, they'll do better than a touchback.
The below plot, showing the outcomes of all kickoffs to the endzone that the receiver returned [1], tells a simpler story: The higher the bar, the more often the receiver made it to that yard line.
From this plot it looks like the majority of kicks received in the endzone were returned to exactly the 20-yard line. However, there were more total kicks returned past the 20-yard line than before or exactly to it. The average return, as opposed to the mode return, was to the 24-yard line—a good four yards more than the receiver would have gotten had he taken the touchback. [2]
But now this is view is too simplified, as it hides any variation that might exist between returns on kickoffs right to the goal line and, say, those for kicks to the very back of the endzone.
The final graph, below, shows the chances that a return won't make it past the 20-yard line, given the yard at which the kickoff was caught.
There's definitely a strong upward trend in the kicker's favor, the further the kickoff goes. But keep in mind that the % of returns that were better than a touchback, the inverse of this graph, remains better than 50% regardless of which yard the kickoff goes to. Which brings us back, I think, to the same conclusion: If you're an NFL kicker, kick it as far as you can. You're hoping for a touchback.
DATA
Data for the above graphs is available here.
Original NFL play data for the 2002-2012 seasons is available here.
FOOTNOTES
[1] Remember that the data in the plots above only considers kickoffs that the receiver chose to return. If the average endzone kickoff return in this data was to a location before the 20-yard line, we could potentially conclude that receivers were, on average, not taking enough touchbacks. In our case, however, it seems like receivers are doing a pretty good job of knowing when to return a kickoff caught in the endzone.
[2] Really though, since football is won by scoring points, this analysis of kickoff returns from the endzone should really consider the relative advantage (in terms of average points scored) of beginning a drive from the 24-yard line as opposed to the 20-yard line. Or even just the risks and gains of returning the ball versus taking a touchback. (If the receiver takes a return instead of a touchback, for example, he stands to score a touchdown but he also risks fumbling and losing possession.)
Unfortunately, the dataset of NFL plays that most people (including myself) have access to is relatively useless for anything involving points scored. But it was interesting, at least, to make it this far.