Generative AI Maps Fail

This is a New York City news story, published by MIT News, that relates primarily to AI news.

New York City news

For more New York City news, you can click here:

more New York City news

News about Ai research

For more Ai research news, you can click here:

more Ai research news

MIT News news

For more news from MIT News, you can click here:

more news from MIT News

About the Otherweb

Otherweb, Inc is a public benefit corporation, dedicated to improving the quality of news people consume. We are non-partisan, junk-free, and ad-free. We use artificial intelligence (AI) to remove junk from your news feed, and allow you to select the best tech news, business news, entertainment news, and much more. If you like this article about Ai research, you might also like this article about

generative AI models

. We are dedicated to bringing you the highest-quality news, junk-free and ad-free, about your favorite topics. Please come every day to read the latest Large language models news, Incoherent world models news, news about Ai research, and other high-quality news about any topic that interests you. We are working hard to create the best news aggregator on the web, and to put you in control of your news feed - whether you choose to read the latest news through our website, our news app, or our daily newsletter - all free!

generative AI model

MIT News

•

Despite its impressive output, generative AI doesn’t have a coherent understanding of the world

Summary

Nutrition label

83% Informative

MIT researchers found that a popular type of generative AI model can provide turn-by-turn driving directions in New York City without having formed an accurate internal map of the city.

When the researchers closed some streets and added detours, the model's performance plummeted.

This could have serious implications for AI models deployed in the real world.

The research will be presented at the Conference on Neural Information Processing Systems .

If scientists want to build LLMs that can capture accurate world models, they need to take a different approach.

The researchers want to tackle a more diverse set of problems, such as those where some rules are only partially known.

They also want to apply their evaluation metrics to real-world, scientific problems.

VR Score

Informative language

Neutral language

Article tone

semi-formal

Language