We don't need fair and unbiased inputs. In the real world these don't exist, and the field of statistics has devoted extensive effort to the problem of getting good answers out of bad inputs.
E.g., for an unbiased measurement (m = x+g, g ~ N(0,\sigma^2)), you use the likelihood function G(x-m,\sigma^2). For a biased measurement g ~ N(b, \sigma^2), you use the likelihood function G(x-m+b, \sigma^2). Here G(x,\sigma^2) is the pdf of the distribution the noise g is drawn from.
But this is mainly just something that can be determined by studying the process. Mandating specific outcomes is just a way of ensuring that the predictor can't discover certain facts.
> and the field of statistics has devoted extensive effort to the problem of getting good answers out of bad inputs.
You are talking about measurement bias. Social bias is not measurement bias. Social bias may be a real statistical distribution; it is called "bias" because it is caused (in the sense of physical causality) and reinforced by biased human perception and the actions that follow. When we talk about "fixing bias" we don't mean "offset measurement errors", but change the actual distribution through action.
> Mandating specific outcomes is just a way of ensuring that the predictor can't discover certain facts.
Exactly. And neglecting feedback from the equations mandates a specific (conservative) outcome. See my reply to barry-cotter for examples of dynamical systems where conservative assumptions can lead to empirically valid yet mathematically wrong results, by failing to detect other stable states: https://news.ycombinator.com/item?id=10874683
If your dynamic system contains feedback, it is quite possible (and very likely) to come up with a model that may be completely predictive, yet quite wrong, and then use that mistake to justify conservatism (what's worse, it is ironically a mathematical error that helps paint a political view as a neutral, "mathematical" one).
I'm not sure what your example is supposed to prove. Besides the fact that your likelihood function isn't an "unbiased algorithm" like your original comment was talking about, it assumes the bias of the input is known and accepted rather than heavily contested.
We certainly shouldn't mandate specific outcomes. We should analyze processes, outcomes, and inputs alike for bias.
The algorithm would be Bayesian inference using the aforementioned likelihood.
The example is a simple illustration of how to fix bias. If bias is unknown then treat it as another unknown variable and use bayesian inference to identify it. If this is unfamiliar, I'm actually publishing a blog post about it tomorrow (how to find the bias in your phone's compass) which you might find helpful.
Yes, I used that when I worked on sensor fusion algorithms and we had to overcome both random and bias errors in measurements provided by radars. In this case, however, your math is wrong. Radars and compasses don't change the actual position of aircraft or the north, but social predictions really do change future real outcomes (we know that thanks to research in history, social psychology and sociology). The system is dynamic, not static, and has a very strong feedback[1]. Neglecting that feedback makes you miss other stable states; or, in other words: gives you a wrong answer.
Just to show you how tricky that feedback can be, I can tell you that in our tracking algorithms we had to carefully track the error's growth with time, as well as allow for unpredictable change in the model (how the aircraft behaves). But if your system has self-reinforcing bias -- i.e. the feedback is stabilizing (as in my example of the {-1, 1} dynamic system) -- you can neglect either of those things and your correct predictions would lead you to the conclusion that your model is actually simpler than the radar case, when, in fact it is far more complicated.
Our mistakes are rarely arithmetic errors when applying formulas. They are almost always in the hidden (or not) assumptions we make about the model, and in how we interpret the results[2]. In the case of 99.9% of social statistics, the results mean, "this is the likely outcome provided nothing changes, including not using this result to take any action". Interpreting the results any differently would be making assumptions completely unjustified by math.
----
[1]: Trying to correct biases in sensor measurement also has a feedback effect on future measurements, but it is a predictable and simple feedback that we can usually fix (with gradient techniques as we know the derivatives, though drift may still occur) but that is still not at all the kind of feedback we have in social systems.
[2]: Of course, it is often the same thing: how we interpret the result of any mathematical statement depends on the assumptions we've made to arrive at it. In order to apply a proven theorem you must make sure that its assumptions are held in your case. If you've ever used any mechanical provers like proof assistants, you know how unforgiving they are in that regard; you must spend as much care and effort on the assumptions as on the proof.
E.g., for an unbiased measurement (m = x+g, g ~ N(0,\sigma^2)), you use the likelihood function G(x-m,\sigma^2). For a biased measurement g ~ N(b, \sigma^2), you use the likelihood function G(x-m+b, \sigma^2). Here G(x,\sigma^2) is the pdf of the distribution the noise g is drawn from.
But this is mainly just something that can be determined by studying the process. Mandating specific outcomes is just a way of ensuring that the predictor can't discover certain facts.