How will we judge the quality of the replications?

Our submission process does not include peer review. But it does include several other measures to allow users to judge quality. We ask all authors submitting replications to note whether their replication has been replicated or checked by someone else, whether by a professor (if the researcher in question is a student) or another researcher. We also require that replicators provide the materials necessary for others to replicate their work. Finally, we require that replicators notify original authors about the replication, and we give the original author time to respond before making the replication public.