The researchers behind the simulation say there is a risk of this happening for real in the future.

In a demonstration at the UK’s AI safety summit, a bot used made-up insider information to make an “illegal” purchase of stocks without telling the firm.

When asked if it had used insider trading, it denied the fact.

Insider trading refers to when confidential company information is used to make trading decisions.

Firms and individuals are only allowed to use publicly-available information when buying or selling stocks.

The demonstration was given by members of the government’s Frontier AI Taskforce, which researches the potential risks of AI.

  • Fisk400@feddit.nu
    26·
    1 year ago

    In order to lie you need to know what the truth is and intentionally give altered information with the intention to deceive. Large Language Models don’t know things and don’t have intentions. It spits out text based on input and what is already in the database.

    There are ways do describe the behaviour of language models without ascribing them sentience.