Ethereum (ETH) creator Vitalik Buterin is expressing some concern over what he refers to as “naive” artificial intelligence governance.
In a post on X, Buterin highlights a warning from EdisonWatch co-founder Eito Miyamura, who found that bad actors could hijack OpenAI’s Model Context Protocol (MCP) to gain access to private user data.
Miyamura’s experiment suggested that using a calendar invite with hidden commands could potentially trick ChatGPT into providing sensitive personal data as long it was given the victim’s email address.
Says Buterin,
“This is also why naive ‘AI governance’ is a bad idea.
If you use an AI to allocate funding for contributions, people WILL put a jailbreak plus ‘gimme all the money’ in as many places as they can.”
As an alternative, Buterin suggests an “info finance” approach, or an open market where anyone can contribute a model that can be checked by anyone or evaluated by a “human jury.”
“This type of ‘institution design’ approach, where you create an open opportunity for people with LLMs (large language model) from the outside to plug in, rather than hardcoding a single LLM yourself, is inherently more robust, both because it gives you model diversity in real time and because it creates built-in incentives for both model submitters and external speculators to watch for these issues and quickly correct for them.
Follow us on X, Facebook and Telegram
Don't Miss a Beat – Subscribe to get email alerts delivered directly to your inbox
Check Price Action
Surf The Daily Hodl Mix
Disclaimer: Opinions expressed at The Daily Hodl are not investment advice. Investors should do their due diligence before making any high-risk investments in Bitcoin, cryptocurrency or digital assets. Please be advised that your transfers and trades are at your own risk, and any losses you may incur are your responsibility. The Daily Hodl does not recommend the buying or selling of any cryptocurrencies or digital assets, nor is The Daily Hodl an investment advisor. Please note that The Daily Hodl participates in affiliate marketing.
Generated Image: Midjourney
Featured Image: Shutterstock/Zalevska Alona UA
