麻豆传媒

Yellow harlequin tree frog in rainforest
Features & Articles

To find rare frogs and birds, Pitt researchers are using machine learning algorithms and hundreds of microphones

Tags
  • Technology & Science
  • Kenneth P. Dietrich 麻豆传媒 of Arts and Sciences

It used to be that if you wanted to track down a rare frog, you鈥檇 have to go to a likely place and wait until you heard its call. The rarer the frog, the less likely it was you鈥檇 hear one. 听

Now, there are better tools for that.听听

鈥淭he technologies that we work with are designed mostly to give you a better chance of detecting things that are hard to detect,鈥 said , an assistant professor of biological sciences in the Kenneth P. Dietrich 麻豆传媒 of Arts and Sciences.听听

Kitzes makes use of tools for bioacoustics 鈥 the study of sounds made by animals 鈥 which, along with satellite imaging and DNA methods, is part of a new generation of conservation technologies that allow researchers to search more broadly and efficiently than ever before.听听

At the beginning of a project, researchers in his lab place up to hundreds of sensors that listen in on an area of interest. Then researchers bring those recordings into the lab, where they sort the signal from the noise. And there鈥檚 plenty of noise.听听

Each recorder can track about 150 hours of sound, and when the team deploys 50 sensors, as they did recently when searching for frogs in Panama, those hours add up. 听

鈥7,500 is pretty small for us, because 50 recorders is actually a small deployment,鈥 Kitzes said. 鈥淚n our bird work, it鈥檚 more like 75,000 hours.鈥澨

There鈥檚 no use in collecting eight continuous years of audio if you don鈥檛 have time to listen to it, though. The lab鈥檚 research owes thanks to two technologies made available in 2017: an inexpensive audio recorder that allows the team to deploy hundreds of sensors and an open-source platform that gave scientists the ability to develop machine learning tools to sort through the data. 听

鈥淭hat was really what kicked everything off,鈥 said Kitzes. 鈥淏ecause that gave us an explosion of field data along with the ability to train deep learning models to analyze it.鈥澨

Tracking birds using this technology is one main focus for the team.听听

Another is its amphibian research, a collaboration with the lab of Biological Sciences Professor as part of the RIBBITR program. That work, including biological sciences graduate student Sam Lapp and staff researcher Alexandra Syunkova, has the team focusing on sites in Pennsylvania, California, Panama and Brazil.听The team鈥檚 Pennsylvania field work is based out of Pitt鈥檚 in Crawford County.

In one recent instance, audio recordings helped the researchers track down an elusive variable harlequin toad (pictured above) in an unlikely site in Panama that was only just beginning to recover from an outbreak of the deadly chytrid fungus. And just this year, the team published a study led by Lapp where they of the endangered Sierra Nevada yellow-legged frog.听听

Studies like the latter rely on training what's called convolutional neural network models 鈥 related to the ones used by tech companies use to recognize features in photos 鈥 to categorize different types of sounds when presented with a visual representation of the audio recordings. 听

鈥淲e鈥檙e using the same kinds of models as Google and Amazon, where in your vacation photo albums they might be able to recognize a palm tree by a beach,鈥 Kitzes said.听听

But as high-tech as the work is, there鈥檚 no replacement for the eye of a trained human. Members of the lab always check some of the algorithm鈥檚 work to ensure that it鈥檚 looking for the right calls. It鈥檚 similar, Kitzes explains, to how he sees other uses of machine learning and artificial intelligence: Not as a replacement for the work of humans, but as a way to augment it.听听

"The reason our lab exists is that we鈥檙e trying to make conservation biologists and ecologists more effective at their job,鈥 said Kitzes. 鈥淪o they can get out there, find more species, learn better about what鈥檚 impacting those species and, ultimately, take the actions that are necessary to conserve those species and protect biodiversity.鈥澨

Photography by Corinne Richards-Zawacki