Lemmy.ca
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
cyu@sh.itjust.works to Technology@lemmy.mlEnglish · 1 year ago

Humans cannot recognize AI-written reviews - human reviews were often mistaken for AI-generated reviews, and even more frequently, AI-generated reviews were mistaken for human reviews

link.springer.com

external-link
message-square
25
link
fedilink
  • cross-posted to:
  • [email protected]
  • [email protected]
  • [email protected]
176
external-link

Humans cannot recognize AI-written reviews - human reviews were often mistaken for AI-generated reviews, and even more frequently, AI-generated reviews were mistaken for human reviews

link.springer.com

cyu@sh.itjust.works to Technology@lemmy.mlEnglish · 1 year ago
message-square
25
link
fedilink
  • cross-posted to:
  • [email protected]
  • [email protected]
  • [email protected]
The Turing test of online reviews: Can we tell the difference between human-written and GPT-4-written online reviews? - Marketing Letters
link.springer.com
external-link
Online reviews serve as a guide for consumer choice. With advancements in large language models (LLMs) and generative AI, the fast and inexpensive creation of human-like text may threaten the feedback function of online reviews if neither readers nor platforms can differentiate between human-written and AI-generated content. In two experiments, we found that humans cannot recognize AI-written reviews. Even with monetary incentives for accuracy, both Type I and Type II errors were common: human reviews were often mistaken for AI-generated reviews, and even more frequently, AI-generated reviews were mistaken for human reviews. This held true across various ratings, emotional tones, review lengths, and participants’ genders, education levels, and AI expertise. Younger participants were somewhat better at distinguishing between human and AI reviews. An additional study revealed that current AI detectors were also fooled by AI-generated reviews. We discuss the implications of our findings on trust erosion, manipulation, regulation, consumer behavior, AI detection, market structure, innovation, and review platforms.
  • Diplomjodler@lemmy.world
    link
    fedilink
    arrow-up
    8
    arrow-down
    1
    ·
    1 year ago

    I would never trust any recommendations of any people I know.

    • zout@fedia.io
      link
      fedilink
      arrow-up
      14
      arrow-down
      1
      ·
      1 year ago

      Are you sure? Because that might say as much about you as about the people you know.

      • Diplomjodler@lemmy.world
        link
        fedilink
        arrow-up
        10
        ·
        1 year ago

        It definitely does.

      • Gabu@lemmy.ml
        link
        fedilink
        arrow-up
        3
        ·
        1 year ago

        The average person is notoriously shit at doing objective analysis, so yeah, you shouldn’t trust people you know.

Technology@lemmy.ml

technology@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 181 users / day
  • 1.21K users / week
  • 2.31K users / month
  • 7.6K users / 6 months
  • 817 local subscribers
  • 37.8K subscribers
  • 5.44K Posts
  • 54.3K Comments
  • Modlog
  • mods:
  • MinutePhrase@lemmy.ml
  • BE: 0.19.11
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org