Covered recently in the journal Nature Medicine, BiomedGPT is a new a new type of artificial intelligence (AI) designed to support a wide range of medical and scientific tasks. This new study, conducted in collaboration with multiple institutions, is described in the article as “the first open-source and lightweight vision-language foundation model, designed as a generalist capable of performing various biomedical tasks.”

“This work combines two types of AI into a decision support tool for medical providers,” explains Lichao Sun, an assistant professor of computer science and engineering at Lehigh University and a lead author of the study. “One side of the system is trained to understand biomedical images, and one is trained to understand and assess biomedical text. The combination of these allows the model to tackle a wide range of biomedical challenges, using insight gleaned from databases of biomedical imagery and from the analysis and synthesis of scientific and medical research reports.”

’16 state-of-the-art results’ for medical practitioners and patients

The key innovation described in the August 7 Nature Medicine article, “A generalist vision-language foundation model for diverse biomedical tasks,” is that this AI model doesn’t need to be specialized for each task. Typically, AI systems are trained for specific jobs, like recognizing tumors in X-rays or summarizing medical papers. However, this new model can handle many different tasks using the same underlying technology. This versatility makes it a “generalist” model?and a powerful new tool in the hands of medical providers.

“BiomedGPT is based on foundation models, a recent development in AI,” says Sun. “Foundation models are large, pre-trained AI systems that can be adapted to various tasks with minimal additional training. The generalist model described in the article has been trained on vast amounts of biomedical data, including images and text, enabling it to perform well across different applications.”

“By evaluating 25 datasets across 9 biomedical tasks and different modalities,” says Kai Zhang, a Lehigh PhD student advised by Sun who serves as first author of the Nature article, “BiomedGPT achieved 16 state-of-the-art results. A human evaluation of BiomedGPT on three radiology tasks showcased the model’s robust predictive abilities.”

Zhang says that he is proud that the open-source codebase is available for other researchers to use as a springboard to drive further development and adoption.

The team reports that the technology behind BiomedGPT may one day help doctors by interpreting complex medical images, assist researchers by analyzing scientific literature, or even aid in drug discovery by predicting how molecules behave.

“The potential impact of such technology is significant,” Zhang says, “as it could streamline many aspects of healthcare and research, making them faster and more accurate. Our method demonstrates that effective training with diverse data can lead to more practical biomedical AI for improving diagnosis and workflow efficiency.”

A team effort for clinical validation, and more

A crucial step in the process was validation of the model’s effectiveness and applicability in real-world healthcare settings.

“Clinical testing involves applying the AI model to real patient data to assess its accuracy, reliability, and safety,” Sun says. “This testing ensures that the model performs well across different scenarios. The outcomes of these tests helped refine the model, demonstrating its potential to improve clinical decision-making and patient care.”

Massachusetts General Hospital (MGH), a founding member of the Mass General Brigham healthcare system and teaching affiliate of Harvard Medical School, played a crucial role in the development and validation of the BiomedGPT model. The institution’s involvement primarily focused on providing clinical expertise and facilitating the evaluation of the model’s effectiveness in real-world healthcare settings. For instance, the model was tested with radiologists at MGH, where it demonstrated superior performance in tasks like visual question answering and radiology report generation. This collaboration helped ensure that the model was both accurate and practical for clinical use.

Other contributors to BiomedGPT include researchers from University of Georgia, Samsung Research America, University of Pennsylvania, Stanford University, University of Central Florida, UC-Santa Cruz, University of Texas-Health, Children’s Hospital of Philadelphia, and the Mayo Clinic.

“This research is highly interdisciplinary and collaborative,” says Sun. “The research involves expertise from multiple fields, including computer science, medicine, radiology, and biomedical engineering. Each author contributes specialized knowledge necessary to develop, test, and validate the model across various biomedical tasks. Large-scale projects like this often require access to diverse datasets and computational resources, along with access to skills in algorithm development, model training, evaluation, and application to real-world scenarios, as well as clinical testing and validation.

“This was a true team effort,” he says. “Creating something that can truly help the medical community improve patient outcomes across a wide range of issues is a very complex challenge. With such complexity, collaboration is key to creating impact through the application of science and engineering.”

The specific component of fine particle air pollution, or PM2.5, ammonium nitrate, is also implicated in Alzheimer’s and dementia risk in adults, suggesting that PM2.5 may cause neurocognitive harm across the lifespan. Ammonium nitrate forms when ammonia gas and nitric acid, produced by agricultural activities and fossil fuel combustion, respectively, react in the atmosphere.

The findings appear in Environmental Health Perspectives.

“Our study highlights the need for more detailed research on particulate matter sources and chemical components,” said senior author Megan Herting, an associate professor of population and public health sciences at the Keck School of Medicine of USC. “It suggests that understanding these nuances is crucial for informing air quality regulations and understanding long-term neurocognitive effects.”

For the last several years, Herting has been working with data from the largest brain study across America, known as the Adolescent Brain Cognitive Development Study, or ABCD, to understand how PM2.5 may affect the brain.

PM2.5, a key indicator of air quality, is a mixture of dust, soot, organic compounds and metals that come in a range of particle sizes less than 2.5 micrometers in diameter. PM2.5 can travel deep into the lungs, where these particles can pass into the bloodstream, and bypass the blood-brain barrier, causing serious health problems.

Fossil fuel combustion is one of the largest sources of PM2.5, especially in urban areas, but sources like wildfires, agriculture, marine aerosols and chemical reactions are also important.

In 2020, Herting and her colleagues published a paper in which they looked at PM2.5 as a whole, and its potential impact on cognition in children, and did not find a relationship.

For this study, they used special statistical techniques to look at 15 chemical components in PM2.5 and their sources. That’s when ammonium nitrate — which is usually a result of agricultural and farming operations — in the air appeared as a prime suspect.

“No matter how we examined it, on its own or with other pollutants, the most robust finding was that ammonium nitrate particles were linked to poorer learning and memory,” Herting said. “That suggests that overall PM2.5 is one thing, but for cognition, it’s a mixture effect of what you’re exposed to.”

For their next project, the researchers hope to look at how these mixtures and sources may map on to individual differences in brain phenotypes during child and adolescent development.

In addition to Herting, other study authors include Rima Habre, Kirthana Sukumaran, Katherine Bottenhorn, Jim Gauderman, Carlos Cardenas-Iniguez, Rob McConnell and Hedyeh Ahmadi, all of the Keck School of Medicine; Daniel A. Hackman of the USC Suzanne Dworak-Peck School of Social Work; Kiros Berhane of the Columbia University Mailman School of Public Health; Shermaine Abad of University of California, San Diego; and Joel Schwartz of the Harvard T.H. Chan School of Public Health.

The research was supported by grants from the National Institutes of Health [NIEHS R01ES032295, R01ES031074, P30ES007048] and the Environmental Protection Agency [RD 83587201, RD 83544101].

“We initially expected to confirm that bat evolution is similar to that of birds, and that their wings and legs evolve independently of one another. The fact we found the opposite was greatly surprising,” said Andrew Orkney, postdoctoral researcher in the laboratory of Brandon Hedrick, assistant professor biomedical sciences.

Both researchers are co-corresponding authors of research published on Nov. 1 in Nature Ecology and Evolution.

Because legs and wings perform different functions, researchers had previously thought that the origin of flight in vertebrates required forelimbs and hindlimbs to evolve independently, allowing them to adapt to their distinct tasks more easily. Comparing bats and birds allows for the testing of this idea because they do not share a common flying ancestor and, therefore, constitute independent replicates to study the evolution of flight.

The researchers observed in both bats and birds that the shapes of the bones within a species’ wing (handwing, radius, humerus), or within a species’ leg (femur and tibia) are correlated — meaning that within a limb, bones evolve together. However, when looking at the correlation across legs and wings, results are different: Bird species show little to no correlation, whereas bats show strong correlation.

This means that, contrary to birds, bats’ forelimbs and hindlimbs did not evolve independently: When the wing shape changes — either increases or shrinks, for example — the leg shape changes in the same direction.

“We suggest that the coupled evolution of wing and leg limits bats’ capability to adapt to new ecologies,” Hedrick said.

Following their discovery, the team began re-examining the evolution of bird skeletons in greater depth.

“While we showed that the evolution of birds’ wings and legs is independent, and it appears this is an important explanation for their evolutionary success,” Orkney said, “we still don’t know why birds are able to do this or when it began to occur in their evolutionary history.”

Citizen science platforms enable thousands of people to contribute to research with their observations — whether a single blackbird at a bird feeder or a long list of species seen during a day trip to the seashore. The study used the platform ornitho.de (https://www.ornitho.de/), which contains more than 90 million records. The advantage of such platforms is that they provide almost complete coverage of the country. However, the poorly standardised and unsystematic data collection process means that there are multiple sources of error. For this reason, the researchers limited their analysis just to particularly valuable, complete lists that provide information on all birds registered during an observation. To find out how the protected areas fared, the researchers compared them with areas that were not protected but had similar natural features.

The analyses showed that 62 per cent of the species studied were more likely to be found in a Special Protection Area than outside it. Dr Femke Pflüger, first author of the study, based at the DDA and Göttingen University’s Department of Conservation Biology, highlights these positive findings: “Conservationists obviously did a good job in selecting the right areas in the 2000s.” However, a comparison over time showed more mixed results and she adds: “For the period 2012 to 2022, we were only able to identify positive developments in protected areas for 17 per cent of the species. These concerned mainly meadow birds such as black-tailed godwits and curlews, which have benefited from targeted habitat management.” For 83 per cent of the species, there was either no measurable effect or the development was less favourable inside the protected areas than outside. The study also defined situations as ‘effective protection’ if the probability of finding a species decreased over time, both inside and outside the protected areas, but to a lesser extent within them.

Professor Johannes Kamp, Head of the Department of Conservation Biology at the University of Göttingen who led the analyses, says: “This shows that designating a Special Protection Area is not enough to stop a downward trend. The areas need better staffing and funding to restore habitats and to target measures specifically to support endangered species.” Dr Jakob Katzenberger, who coordinates the DDA’s research, is delighted that thousands of citizens contributed: “We were able to show that collecting biodiversity data from online platforms has huge potential. It was possible to track large-scale changes in birdlife really effectively.”

This research was made possible thanks to funding by the German Federal Agency for Nature Conservation (BfN) as part of the project ‘Implementation of measures for nationwide harmonised bird monitoring in EU special protection areas’.

Patients with Huntington’s disease have a genetic mutation that triggers proteins to misfold and clump together in the brain. These clumps interfere with cell function and eventually lead to cell death. As the disease progresses, patients lose the ability to talk, walk, swallow and concentrate. Most patients die within 10 to 20 years after symptoms first appear.

The new treatment leverages peptide-brush polymers, which act as a shield to prevent proteins from binding to one another. In studies in mice, the treatment successfully rescued neurons to reverse symptoms. The treated mice also experienced no significant side effects, confirming the therapy is nontoxic and well tolerated.

Although the treatment needs further testing, the researchers imagine it potentially someday could be administered as a once-weekly injection to delay disease onset or reduce symptoms in patients with the genetic mutation.

The study will be published on Friday (Nov. 1), in the journal Science Advances.

“Huntington’s is a horrific, insidious disease,” said Northwestern’s Nathan Gianneschi, who led the polymer therapeutic development. “If you have this genetic mutation, you will get Huntington’s disease. It’s unavoidable; there’s no way out. There is no real treatment for stopping or reversing the disease, and there is no cure. These patients really need help. So, we started thinking about a new way to address this disease. The misfolded proteins interact and aggregate. We’ve developed a polymer that can fight those interactions.”

Gianneschi is the Jacob and Rosaline Cohn Professor of Chemistry at Northwestern’s Weinberg College of Arts and Sciences and professor of materials science and engineering and biomedical engineering at Northwestern’s McCormick School of Engineering as well as in Pharmacology at Feinberg School of Medicine. He also is a member of the International Institute of Nanotechnology. Gianneschi co-led the study with Xin Qi, the Jeanette M. and Joseph S. Silber Professor of Brain Sciences and co-director of the Center for Mitochondrial Research and Therapeutics, at Case Western Reserve University.

Promising peptide

The new study builds on previous work from Qi’s laboratory at Case Western Reserve. In 2016, Qi and her team identified a protein (valosin-containing protein or VCP) that abnormally binds to the mutant Huntington protein, causing protein aggregates. These aggregates accumulate within a cell’s mitochondria, an organelle that generates the energy needed to power a cell’s biochemical reactions. Without functioning mitochondria, the cells become dysfunctional and then self-destruct.

As part of that study, Qi also uncovered a naturally occurring peptide that disrupts the interaction between the VCP and the mutant Huntington protein. In cells exposed to the peptide, both the VCP and mutant Huntington protein bound to the peptide — instead of each other.

“Qi’s team identified a peptide that comes from the mutant protein itself and basically controls the protein-protein interface,” Gianneschi said. “That peptide inhibited mitochondrial death, so it showed promise.”

Pulling apart proteins like Velcro

But the peptide, by itself, faced several limitations. Because they are easily broken down by enzymes, peptides have a short lifespan in the body and often have difficulty effectively entering cells. For the peptide to inhibit Huntington’s disease, it needs to cross the blood-brain barrier in large enough quantities to prevent large-scale protein aggregation.

“The peptide has a very small footprint with respect to the protein interfaces,” Gianneschi said. “The proteins stick to each other like Velcro. In this analogy, one protein has hooks and the other has loops. The peptide, on its own, is like trying to undo a patch of Velcro by pulling apart one hook and loop at a time. By the time you get to the bottom of the patch, the top has already come back together and resealed. We needed something big enough to disrupt the entire interface.”

To overcome these obstacles, Gianneschi and his team developed a biocompatible polymer that displays multiple copies of the active peptide. The new structure has a polymer backbone with peptides attached like branches. Not only does the structure protect the peptides from destructive enzymes, it also helps them cross the blood-brain barrier and enter cells.

Experimental results

In laboratory experiments, Gianneschi and his team injected the protein-like polymer into a mouse model of Huntington’s disease. The polymers stayed in the body 2,000 times longer than traditional peptides. In biochemical and neuropathological examinations, the researchers found the treatment prevented mitochondrial fragmentation to preserve the health of brain cells. According to Gianneschi, the mice with Huntington’s disease also lived longer and behaved more like normal mice.

“In one study, the mice are examined in an open field test,” Gianneschi said. “In the animals with Huntington’s, as the disease progresses, they stay along the edges of the box. Whereas normal animals cross back and forth to explore the space. The treated animals with Huntington’s disease started to do the same thing. It’s quite compelling when you see animals behave more normally than they would otherwise.”

Next, Gianneschi will continue to optimize the polymer, with plans to explore its use in other neurodegenerative diseases.

“My childhood friend was diagnosed with Huntington’s at age 18 through a genetic test,” Gianneschi said. “He’s now in an assisted living facility because he needs 24-hour, full-time care. I remain highly motivated — both personally and scientifically — to continue traveling down the path.”

New University of Mississippi research could help solve the problem.

Vyacheslav Aranchuk, principal scientist in the National Center for Physical Acoustics, presented his research on laser multibeam vibration sensor technology at the Optica Laser Congress and Exhibition, held last week in Osaka, Japan. Aranchuk’s laser vibration sensing technology can detect landmines in the ground much faster than previous techniques.

“There are tens of millions of landmines buried around the world, and more every day as conflicts continue,” Aranchuk said. “There are military applications for this technology in ongoing conflicts and humanitarian applications after the conflicts are over.”

There are more than 110 million active landmines worldwide and landmines or other s left behind from previous wars injured or killed 4,710 people in 2022. More than 85% of landmine casualties were civilians, and half of the civilian casualties were children. Seventy countries worldwide still live with the risk of active landmines each day, including current and former war zones.

Landmines are easy to make and can cost as little as $3 apiece, but identification and disposal can cost up to $1,000 per mine to remove.

Current landmine detection mostly relies on handheld metal detectors, a technique that is dangerous and time-consuming, Aranchuk said. Metal detectors and ground-penetrating radar are not effective in finding plastic landmines.

Aranchuk’s research team developed a laser vibration sensor in 2019 that could find buried objects at a safe distance from a moving vehicle with 30 laser beams formed in a line.

The researchers’ latest technology can form a vibration map of the ground in less than a second. It uses a 34 x 23 matrix array of beams — which roughly forms the shape of a rectangle.

“Most of the modern mines are made of plastic, so they are harder targets for traditional methods of detection that look for metal,” he said. “That’s why the NCPA developed this method of detection.”

Like the 2019 technology, Aranchuk’s laser multi-beam differential interferometric sensor, or LAMBDIS, can be used from a moving vehicle, further increasing the speed at which buried landmines can be detected.

Boyang Zhang, a former postdoctoral researcher at the NCPA from Nantong, China, co-authored the report.

“Metal detectors often generate false positives by detecting any metallic object, and (ground-penetrating radar) can be hindered by certain soil conditions or materials,” Zhang said. “In contrast, laser-acoustic detection uses a combination of laser and acoustic sensing, which allows it to detect landmines from a distance with greater accuracy.

“It reduces false positives and enhances safety by keeping operators farther from the detection zone.”

To find buried objects — explosive or otherwise — the researchers create ground vibration and then cast a two-dimensional array of laser beams at the ground. Ground vibration induces small variations to the frequency of reflected laser light which are used to create a vibration image of the area. A buried landmine vibrates differently than the surrounding soil and appears as a red blob in the vibration image.

“The working principle is based on inference of light,” Aranchuk said. “We send beams to the ground and the interference of light scattered back from different points on the ground produces signals which processing reveals vibration magnitude at each point of the ground surface.”

While the technology is intended to detect landmines, its applications could be numerous, the researchers said.

“Beyond landmine detection, LAMBDIS technology can be adapted for other purposes, such as assessment of bridges and other engineering structures, vibration testing and non-destructive inspection of materials in automotive and aerospace industry, and in biomedical applications,” he said.

The next phase of Aranchuk’s research aims to investigate LAMBDIS’s performance for different buried objects and in different soil conditions.

This material is based on work supported by the U.S. Department of the Navy’s Office of Naval Research under award No. N00014-18-2489.

Researchers Kwun Yip Fung, Zong-Liang Yang, and Dev Niyogi at the UT Jackson School of Geosciences, along with colleagues from Spain and Canada, have created a new physics-based computer modeling framework that integrates indices of human comfort and social vulnerability with heat island mitigation strategies and a state-of-the-art urban climate modeling system.

The work was published in PNAS Nexus.

When the researchers applied the index to Houston, they discovered that trees, rather than roof treatments, provided the best relief from the heat in the most vulnerable areas. Vulnerability is assessed based on sensitivity factors such as socioeconomic status, household composition, and minority status as well as adaptive capacity factors such as housing type and access to transportation.

Heat islands occur in cities where structures such as buildings and roads absorb the sun’s heat more than natural landscapes such as trees and grass. This higher heat leads to increased energy consumption from air conditioning, increased emissions from using more electricity, and compromises human health and comfort. This heat island effect can vary in different parts of the city, leading to differences in impact.

Most people are familiar with wind chill indexes used in the winter to describe how cold temperatures and wind interact to make people feel colder. Similarly, the heat index relies on both temperature and humidity to describe how conditions can make people feel hotter. Before this study, little research had been done to quantitively assess how the sun beating down on people makes them feel in an urban setting.

“If construction workers work under direct sunlight versus under the shade of tree cover, the comfort level will be very different,” said Yang.

The universal thermal comfort index combines human comfort based on temperature, humidity, wind speed, and radiation. The researchers said it could be used in any community.

In their study, the researchers considered three different heat island mitigation strategies: painting roofs white to increase solar reflectance; planting vegetation on roofs to increase evaporation through the plants; and planting more trees, which increases evaporation and provides shade. In a generic city block, painting roofs white led to the biggest decrease in the index, especially during the day.

However, looking at different neighborhoods in Houston, the results became more nuanced.

The U.S. Centers for Disease Control and Prevention has developed a social vulnerability index as a measure of how sensitive neighborhoods are to socioeconomic factors and their capacity for adaptation. Classifying the neighborhoods in Houston according to this vulnerability index and then applying the human comfort index revealed that while painting roofs white was the best cooling option in places with low vulnerabilities, in places with higher vulnerabilities, planting trees was a better strategy.

“Now that we have developed the index of cooling and we have the vulnerability data, if we combine both of them, we can see which methods provide more cooling for those vulnerable neighborhoods,” said lead author Fung, who conducted the research as part of his doctoral studies at the Jackson School.

The research revealed that places with high vulnerabilities also had more available space where trees could be planted, so the potential for adding trees was greater. They also had less roof area available for painting white or planting with vegetation.

“Now that we know the vulnerable neighborhoods have more space for planting trees, we should prioritize trees at those regions,” said Fung. “And in those less vulnerable neighborhoods, we should prioritize other strategies like cool roofs and green roofs.”

Applying the methodology to other cities may require other considerations. For example, in arid places like Arizona, trees would need to be selected for heat and drought tolerance. In northern cities, a lack of air conditioning plays a role in communities that are vulnerable to heat.

The new methodology could also be used to develop hybrid strategies, combining both rooftop treatments and tree planting, as well as other strategies such as reflective pavements.

“We see this as a baseline, but we are still exploring,” said Fung. “Now that the index and the methodology have been developed, they can be applied to many other scenarios.”