I am a big proponent of reproducible data analysis. In particular, I like when researchers share documents in formats like Sweave and knitr which weave statistical output (e.g., text, tables, and graphs) into a statistical report.
I previously asked for examples of reproducible research of any kind on Stats.SE and for advocating articles in psychology. However, at present I'm particularly interested in complete examples of reproducible meta-analysis.
Meta-analyses involve a number of steps. Summary statistics and study information is extracted from source studies. Various transformations and steps are applied to the data (e.g., corrections for reliability, conversion from one statistic to another, etc.). Various models are tested; tables and graphs are produced. Some journals are requiring that researchers supply tables of data used (e.g., references used, summary statistics). However, I can see meta-analysis as an area which could benefit from a more comprehensive reproducible approach: (1) it would permit greater inspection of specific methods used; (2) researchers could more easily build on the analyses used.
Thus, my questions:
- Are there any complete examples of reproducible meta-analysis preferably in psychology or a related discipline?
- Is there any published advocacy for reproducible meta-analysis?