Professor Barba Flags Benchmarking Shortfalls in AI for Science


August 6, 2025

Lorena Barba speaking at a podium

Lorena Barba speaking at the inaugural conference of GW's Open Source Program Office on open source strategy, software and initiatives. (William Atkins/GW Today)

In the article “Is your AI benchmark lying to you?,” Nature explores concerns around artificial intelligence (AI) in science with comments from experts like GW Engineering’s Lorena Barba. Barba was featured for her support of standardization and reliable AI benchmarks and cited for a co-authored study examining how to make scientific machine learning more trustworthy.

Here is an excerpt from the article: “Lorena Barba, a mechanical and aerospace engineer at George Washington University in Washington DC, has a similar perspective. Science is suffering because of ‘poor transparency, glossing over limitations, closet failures, overgeneralization, data negligence, gatekeeping and puffery’ in attempts to put AI to work in real-world settings, as she put it in a 2023 talk at the Platform for Advanced Scientific Computing Conference in Davos, Switzerland.”

Read the full article on Nature.