Comment by KoolKat23

6 hours ago

Sorry I mean in very public releases such as this trove, where many have lean certificates attached and publicly scrutiny.

Three of them have already been withdrawn. So I would say we have proof, that they cannot be implicitly trusted.

  • So it turns out there is a, perhaps informal, working system in place and we can deal with it.

    Peer reviewed and published insights are proven invalid all the time. This is the nature of research and how we learn.

    • So instead of us "knowing it is valid", we don't. We need to put in extra effort, because someone felt like doing only half the work and dumping it on the community to fix.

      We don't know the current system can work well enough at this scale, because that's un-knowable. We know it can find some of the problems. We don't know it can find all of them.

      We do know it takes more effort - that's knowable. Increased data takes increased processing.

      Whether the community has the required effort available, seems unlikely, considering the expertise required to be able to assess these things hasn't changed. Only the ability to generate them has increased.

      1 reply →