Early reactions
ASPLOS-00 reviewers
- “the work is fundamentally flawed by its lack of consideration of the basic rules of the statistical studies involving humans...meaningful studies contain hundreds if not thousands of subjects”
- “I didn't feel like there was anything particularly deep or surprising in it”
- “The real problem is that, at least in the research community, manageability isn't valued, not that it isn't quantifiable”
We have an uphill battle
- to convince people that this topic is important
- to transplant understanding of human studies research to the systems community