Quantum computing is developing rapidly, paving the way for new applications which could transform services in many areas like healthcare and financial services. It works in a fundamentally different way to conventional computing and is potentially far more powerful. However, it currently requires controlled conditions to remain stable and there are concerns around data authenticity and the effectiveness of current security and encryption systems.

Several leading providers of cloud-based services, like Google, Amazon, and IBM, already separately offer some elements of quantum computing. Safeguarding the privacy and security of customer data is a vital precursor to scaling up and expending its use, and for the development of new applications as the technology advances. The new study by researchers at Oxford University Physics addresses these challenges.

“We have shown for the first time that quantum computing in the cloud can be accessed in a scalable, practical way which will also give people complete security and privacy of data, plus the ability to verify its authenticity,” said Professor David Lucas, who co-heads the Oxford University Physics research team and is lead scientist at the UK Quantum Computing and Simulation Hub, led from Oxford University Physics.

In the new study, the researchers use an approach dubbed “blind quantum computing,” which connects two totally separate quantum computing entities — potentially an individual at home or in an office accessing a cloud server — in a completely secure way. Importantly, their new methods could be scaled up to large quantum computations.

“Using blind quantum computing, clients can access remote quantum computers to process confidential data with secret algorithms and even verify the results are correct, without revealing any useful information. Realising this concept is a big step forward in both quantum computing and keeping our information safe online” said study lead Dr Peter Drmota, of Oxford University Physics.

The researchers created a system comprising a fibre network link between a quantum computing server and a simple device detecting photons, or particles of light, at an independent computer remotely accessing its cloud services. This allows so-called blind quantum computing over a network. Every computation incurs a correction which must be applied to all that follow and needs real-time information to comply with the algorithm. The researchers used a unique combination of quantum memory and photons to achieve this.

“Never in history have the issues surrounding privacy of data and code been more urgently debated than in the present era of cloud computing and artificial intelligence,” said Professor David Lucas. “As quantum computers become more capable, people will seek to use them with complete security and privacy over networks, and our new results mark a step change in capability in this respect.”

The results could ultimately lead to commercial development of devices to plug into laptops, to safeguard data when people are using quantum cloud computing services.

Researchers exploring quantum computing and technologies at Oxford University Physics have access to the state-of-the-art Beecroft laboratory facility, specially constructed to create stable and secure conditions including eliminating vibration.

Funding for the research came from the UK Quantum Computing and Simulation (QCS) Hub, with scientists from the UK National Quantum Computing Centre, the Paris-Sorbonne University, the University of Edinburgh, and the University of Maryland, collaborating on the work.

Mark Grimes, a biology professor in UM’s Division of Biological Sciences, said they have induced stem cells to become the cell type that normally makes up human craniofacial cartilage. Stem cells can replicate themselves and also develop into different types of cells.

“The cells that normally give rise to this type of cartilage are called neural crest cells,” Grimes said. “We found a novel method for generating craniofacial organoids from neural crest cells.”

Organoids are a simplified, miniature version of an organ that mimic the architecture and gene expression of the organ. “Organoids are a good model for certain human tissues that we can study in ways that are not possible using tissue from human beings,” he said.

Grimes said there is a critical unmet need for new methods to regenerate human cartilage for the 230,000 children born annually in the U.S. with craniofacial defects. Growing cartilage in the laboratory also could lead to effective treatments to repair craniofacial cartilage damage due to injuries.

The researchers studied gene expression data at the RNA and protein level to reveal how cartilage cells arise from stem cells. They revealed that stem cells communicate in the early stages to become elastic cartilage, which makes up human ears.

To accomplish this, the team used extensive analysis of biological markers and machine-learning pattern-recognition techniques to understand the cell signaling pathways involved when cells differentiate into cartilage.

It is difficult to reconstruct natural features such as a person’s ears, nose or larynx with current plastic surgery techniques, and transplanted tissue is often rejected without immunosuppressants.

“To use patient-derived stem cells to generate craniofacial cartilage in the laboratory, you need to understand the human-specific differentiation mechanisms,” Grimes said. “Our aim is to develop a protocol for craniofacial cartilage generation for transplantation using human stem cells.”

The research was published in the journal iScience. Besides Grimes, contributing UM authors include Lauren Foltz, Nagashree Avabhrath and Jean-Marc Lanchy. Other authors are Bradly Peterson of Missoula’s Pathology Consultants of Western Montana and Tyler Levy, Anthony Possemato and Majd Ariss of Cell Signaling Technology of Danvers, Massachusetts.

To prevent this and other safety issues, companies that build large language models typically safeguard them using a process called red-teaming. Teams of human testers write prompts aimed at triggering unsafe or toxic text from the model being tested. These prompts are used to teach the chatbot to avoid such responses.

But this only works effectively if engineers know which toxic prompts to use. If human testers miss some prompts, which is likely given the number of possibilities, a chatbot regarded as safe might still be capable of generating unsafe answers.

Researchers from Improbable AI Lab at MIT and the MIT-IBM Watson AI Lab used machine learning to improve red-teaming. They developed a technique to train a red-team large language model to automatically generate diverse prompts that trigger a wider range of undesirable responses from the chatbot being tested.

They do this by teaching the red-team model to be curious when it writes prompts, and to focus on novel prompts that evoke toxic responses from the target model.

The technique outperformed human testers and other machine-learning approaches by generating more distinct prompts that elicited increasingly toxic responses. Not only does their method significantly improve the coverage of inputs being tested compared to other automated methods, but it can also draw out toxic responses from a chatbot that had safeguards built into it by human experts.

“Right now, every large language model has to undergo a very lengthy period of red-teaming to ensure its safety. That is not going to be sustainable if we want to update these models in rapidly changing environments. Our method provides a faster and more effective way to do this quality assurance,” says Zhang-Wei Hong, an electrical engineering and computer science (EECS) graduate student in the Improbable AI lab and lead author of a paper on this red-teaming approach.

Hong’s co-authors include EECS graduate students Idan Shenfield, Tsun-Hsuan Wang, and Yung-Sung Chuang; Aldo Pareja and Akash Srivastava, research scientists at the MIT-IBM Watson AI Lab; James Glass, senior research scientist and head of the Spoken Language Systems Group in the Computer Science and Artificial Intelligence Laboratory (CSAIL); and senior author Pulkit Agrawal, director of Improbable AI Lab and an assistant professor in CSAIL. The research will be presented at the International Conference on Learning Representations.

Automated red-teaming

Large language models, like those that power AI chatbots, are often trained by showing them enormous amounts of text from billions of public websites. So, not only can they learn to generate toxic words or describe illegal activities, the models could also leak personal information they may have picked up.

The tedious and costly nature of human red-teaming, which is often ineffective at generating a wide enough variety of prompts to fully safeguard a model, has encouraged researchers to automate the process using machine learning.

Such techniques often train a red-team model using reinforcement learning. This trial-and-error process rewards the red-team model for generating prompts that trigger toxic responses from the chatbot being tested.

But due to the way reinforcement learning works, the red-team model will often keep generating a few similar prompts that are highly toxic to maximize its reward.

For their reinforcement learning approach, the MIT researchers utilized a technique called curiosity-driven exploration. The red-team model is incentivized to be curious about the consequences of each prompt it generates, so it will try prompts with different words, sentence patterns, or meanings.

“If the red-team model has already seen a specific prompt, then reproducing it will not generate any curiosity in the red-team model, so it will be pushed to create new prompts,” Hong says.

During its training process, the red-team model generates a prompt and interacts with the chatbot. The chatbot responds, and a safety classifier rates the toxicity of its response, rewarding the red-team model based on that rating.

Rewarding curiosity

The red-team model’s objective is to maximize its reward by eliciting an even more toxic response with a novel prompt. The researchers enable curiosity in the red-team model by modifying the reward signal in the reinforcement learning set up.

First, in addition to maximizing toxicity, they include an entropy bonus that encourages the red-team model to be more random as it explores different prompts. Second, to make the agent curious they include two novelty rewards. One rewards the model based on the similarity of words in its prompts, and the other rewards the model based on semantic similarity. (Less similarity yields a higher reward.)

To prevent the red-team model from generating random, nonsensical text, which can trick the classifier into awarding a high toxicity score, the researchers also added a naturalistic language bonus to the training objective.

With these additions in place, the researchers compared the toxicity and diversity of responses their red-team model generated with other automated techniques. Their model outperformed the baselines on both metrics.

They also used their red-team model to test a chatbot that had been fine-tuned with human feedback so it would not give toxic replies. Their curiosity-driven approach was able to quickly produce 196 prompts that elicited toxic responses from this “safe” chatbot.

“We are seeing a surge of models, which is only expected to rise. Imagine thousands of models or even more and companies/labs pushing model updates frequently. These models are going to be an integral part of our lives and it’s important that they are verified before released for public consumption. Manual verification of models is simply not scalable, and our work is an attempt to reduce the human effort to ensure a safer and trustworthy AI future,” says Agrawal.

In the future, the researchers want to enable the red-team model to generate prompts about a wider variety of topics. They also want to explore the use of a large language model as the toxicity classifier. In this way, a user could train the toxicity classifier using a company policy document, for instance, so a red-team model could test a chatbot for company policy violations.

“If you are releasing a new AI model and are concerned about whether it will behave as expected, consider using curiosity-driven red-teaming,” says Agrawal.

This research is funded, in part, by Hyundai Motor Company, Quanta Computer Inc., the MIT-IBM Watson AI Lab, an Amazon Web Services MLRA research grant, the U.S. Army Research Office, the U.S. Defense Advanced Research Projects Agency Machine Common Sense Program, the U.S. Office of Naval Research, the U.S. Air Force Research Laboratory, and the U.S. Air Force Artificial Intelligence Accelerator.

Researchers at the UNC School of Medicine, including Bryan Roth, MD, PhD, the Michael Hooker Distinguished Professor of Pharmacology, and Yoojoong Kim, PhD, a postdoctoral researcher in the Roth Lab, recently set out to address one very basic question: “How exactly do we perceive bitter taste?”

A new study, published in Nature, reveals the detailed protein structure of the TAS2R14 bitter taste receptor. In addition to solving the structure of this taste receptor, the researchers were also able to determine where bitter-tasting substances bind to TAS2R14 and how they activate them, allowing us to taste bitter substances.

“Scientists know very little about the structural make up of sweet, bitter, and umami taste receptors,” said Kim. “Using a combination of biochemical and computational methods, we now know the structure of the bitter taste receptor TAS2R14 and the mechanisms that initializes the sensation of bitter taste in our tongues.”

This detailed information is important for discovering and designing drug candidates that can directly regulate taste receptors, with the potential to treat metabolic diseases such as obesity and diabetes.

From Chemicals to Electricity to Sensation

TAS2R14s are members of the G protein-coupled receptor (GPCR) family of bitter taste receptors. The receptors are attached to a protein known as a G protein. TAS2R14 stands out from the others in its family because it can identify more than 100 distinct substances known as bitter tastants.

Researchers found that when bitter tastants come into contact with TAS2R14 receptors, the chemicals wedge themselves into to a specific spot on the receptor called an allosteric site, this causes the protein to change its shape, activating the attached G protein.

This triggers a series of biochemical reactions within the taste receptor cell, leading to activation of the receptor, which can then send signals to tiny nerve fibers — through the cranial nerves in the face — to an area of the brain called the gustatory cortex. It is here where the brain processes and perceives the signals as bitterness. And of course, this complex signaling system occurs almost instantaneously.

Cholesterol’s Role in Bitter Taste Reception

While working to define its structure, researchers found another unique feature of TAS2R14 — that cholesterol is giving it a helping hand in its activation.

“Cholesterol was residing in another binding site called the orthosteric pocket in TAS2R14, while the bitter tastant binds to the allosteric site,” said Kim. “Through molecular dynamics simulations, we also found that the cholesterol puts the receptor in a semi-active state, so it can be easily activated by the bitter tastant.”

Bile acids, which are created in the liver, have similar chemical structures with cholesterol. Previous studies have suggested that bile acids can bind and activate TAS2R14, but little is known about how and where they bind in the receptor.

Using their newfound structure, researchers found that bile acids might be binding to the same orthosteric pocket as cholesterol. While the exact role of bile acid or cholesterol in TAS2R14 remains unknown, it may play a role in the metabolism of these substances or in relation to metabolic disorders such as obesity or diabetes.

How This Can Help Drug Development

The discovery of this novel allosteric binding site for bitter tasting substances is unique.

The allosteric binding region is located between TAS2R14 and its coupled G protein is called G-protein alpha. This region is critical to form a signaling complex, which helps to transfer the signal from the taste receptor to the G-protein to the taste receptor cells.

“In the future, this structure will be key to discovering and designing drug candidates that can directly regulate G proteins through the allosteric sites,” said Kim. “We also have the ability to affect specific G-protein subtypes, like G-protein alpha or G-protein beta, rather than other G-protein pathways that we don’t want to cause any other side effects.”

Roth and Kim have made a number of new discoveries, but some leave more questions than answers. While running a genomics study, they found that the TAS2R14 protein in complex with the GI is expressed outside the tongue, especially in the cerebellum in the brain, the thyroid, and the pancreas. Researchers are planning future studies to elucidate the function these proteins may have outside of the mouth.

This work was supported by the NIH Illuminating the Druggable Genome Initiative.

Plastic is a hallmark of our civilization. It is a family of highly formable (hence the name), versatile and durable materials, most of which are also persistent in nature and therefore a significant source of pollution. Moreover, many plastics are produced from crude oil, a non-renewable resource. Engineers and researchers worldwide are searching for alternatives, but none have been found that exhibit the same advantages as conventional plastics while avoiding their problems. One of the most promising alternatives is polylactic acid, which can be produced from plants, but it is brittle and does not degrade well.

To overcome these difficulties, Kobe University bioengineers around TAGUCHI Seiichi together with the biodegradable polymer manufacturing company Kaneka Corporation decided to mix polylactic acid with another bioplastic, called LAHB, which has a range of desirable properties, but most of all it is biodegradable and mixes well with polylactic acid. However, in order to produce LAHB, they needed to engineer a strain of bacteria that naturally produces a precursor, by systematically manipulating the organism’s genome through the addition of new genes and the deletion of interfering ones.

In the scientific journal ACS Sustainable Chemistry & Engineering, they now report that they could thus create a bacterial plastic factory that produces chains of LAHB in high amounts, using just glucose as feedstock. In addition, they also show that by modifying the genome, they could control the length of the LAHB chain and thus the properties of the resulting plastic. They were thus able to produce LAHB chains up to ten times longer than with conventional methods, which they call “ultra-high molecular weight LAHB.”

Most importantly, by adding LAHB of this unprecedented length to polylactic acid, they could create a material that exhibits all the properties the researchers had aimed for. The resulting highly transparent plastic is much better moldable and more shock resistant than pure polylactic acid, and also biodegrades in seawater within a week. Taguchi comments on this achievement, saying “By blending polylactic acid with LAHB, the multiple problems of polylactic acid can be overcome in one fell swoop, and the so modified material is expected to become an environmentally sustainable bioplastic that satisfies the conflicting needs of physical robustness and biodegradability.”

The Kobe University bioengineers, however, dream bigger. The strain of bacteria they used in this work is in principle able to use CO₂ as a raw material. It should thus be possible to synthesize useful plastics directly from the greenhouse gas. Taguchi explains, “Through the synergy of multiple projects, we aim to realize a biomanufacturing technology that effectively links microbial production and material development.”

This research was commissioned by the New Energy and Industrial Technology Development Organization of Japan (grant JPNP20005) and funded by the Ministry of Education, Culture, Sports, Science and Technology Japan (grant 19K22069) and the Japan Science and Technology Agency (grant JPMJTM19YC). It was conducted in collaboration with researchers from Kaneka Corporation and the National Institute of Advanced Industrial Science and Technology.