• tetris11@lemmy.ml
    link
    fedilink
    English
    arrow-up
    47
    arrow-down
    7
    ·
    edit-2
    4 months ago

    It’s a numbers game.

    • X submits paper to Journal 1, and peers A,B,C reject it.
    • X submits paper with minor changes to Journal 2, and only peers D and E reject it.
    • X submits paper with minor changes to Journal 3, and only peer G rejects it
    • X submits paper with minor changes to Journal 4, and no one rejects it.

    Journal 4 increments prestige, Scientist X increments prestige, but nothing true or good is actually gained.

    Science.

    • MotoAsh@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      4 months ago

      NOT science. At all. That’s publication and clout. Two things science distinctly is NOT, but needs because information must still disseminate in some way.

    • Jtotheb@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      They thought the review process was more arduous than looking at some newly discovered scientific fact that no one had ever known before and saying “yeah that seems self-evident.”

      If you feel like that’s reductive, now you know why I felt like responding

  • xJREB@lemmy.world
    link
    fedilink
    English
    arrow-up
    17
    ·
    4 months ago

    I recently read an interesting article proposing to get rid of the current peer review system: https://www.experimental-history.com/p/the-rise-and-fall-of-peer-review

    The argument was roughly this: for the unfathomable (unpaid) hours spent on peer review, it’s not very effective. Too much bad research still gets published and too much good research gets rejected. Science would also not be a weak-link problem but a strong-link problem, i.e., scientific progress would not depend on the quality of our worst research but of that of our best research (which would push through anyway in time). Pretty interesting read, even though I find it difficult to imagine how we would transition to such a system.

  • Grandwolf319@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    15
    ·
    4 months ago

    Never,

    It’s peer review not peer verified.

    English is my second language so I don’t get this post, it always meant someone else read it.

    • TonyTonyChopper@mander.xyz
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      1
      ·
      4 months ago

      Best part is the reviewers don’t get paid for their work, the publishers pocket all of the money they get from selling journals

  • Psychodelic@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    1
    ·
    4 months ago

    I’m just happy they learned what peer review means. I doubt even a third of Americans know what it means or its impact on their lives

  • arbitrary_sarcasm@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    ·
    4 months ago

    In my field of research, there seems to be a recent push for artifact evaluation. It’s a separate process which is also optional but you get to brag about the fact that you get badges if your experiment results were replicated.

    There’s also some push back against this since it’s additional work, but I think it’s a step in the right direction.

    • Contramuffin@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      2
      ·
      4 months ago

      Scientists can get really petty in peer review. They won’t be able to catch if the data was manipulated or faked, but they’ll be able to catch everything else. Things such as inconclusive or unconvincing data, wrongful assumptions, missing data that would complement and further prove the conclusion, or even trivial things such as a sentence being unclear.

      It generally works as long as you can trust that the author isn’t dishonest

      • MotoAsh@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        4 months ago

        A LOT of things work without safety nets if people engage honestly.

        The problem, with FAR more than science, is many, many people are distinctly NOT honest.

  • schloppah@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    4 months ago

    Damn I guess I was today years old. I remember in high school chemistry class we were taught about peer review and had to do it for each other, except the way we did was actually testing and replicating results, so that cemented the misconception.

  • Skalix@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    4 months ago

    Was lucky to contribute to a paper for the first time recently and was certainly suprised to see what peer reviews looked like lmao

  • hemko@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    4
    ·
    4 months ago

    Science is essentially just throwing shit at the wall and seeing what sticks.

    The more shit you throw, the higher chance there is that something sticks. You just need to make sure the shit is properly documented, and that’s what the peer review is for?

  • Queen HawlSera@lemm.ee
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    4 months ago

    This is why I always shake my head and dudebros saying “Naw bro it is/is not peer reviewed, so it’s bullshit!”

    Even though there are many times when the peer was wrong or outright lying to protect their pre-conceived notion or pet theory… but if you just call that the “Galileo Gambit” you don’t have to take that seriously…

  • Comment105@lemm.ee
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    4 months ago

    I’m only a layman casual, but I have never in my life seen an actual peer review.

    I’ve read/skimmed actual papers from primary sources whenever I actually care to try to understand the proof for something. No idea what a peer review looks like, no idea if the paper I read were ever peer reviewed.

    I’m guessing maybe the publisher itself also/sometimes does the “we read it, looks fine”-process? Either way, I’ve never seen one. They’re like some mythical creature I’ve only ever heard descriptions of.

    • undergroundoverground@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 months ago

      Same but some of my friends i went to uni with is a moron who went on to do a PhD…

      Its like having your work marked and, if they don’t Iike it, they’ll just say like “not clear enough” or “needs more research” and deny its publication.

      I mean, what they meant was “you haven’t addressed Dr Y et. al.'s critique of that particular essay’s attempt at modelling the disease you’re researching” but they’re not just going to come out and tell you that. That would be too easy.

      Every now and then I feel like I can hear them muttering some kind of highly expletive death threat at reviewer number 3.