Skoltech scientists have created a new monitoring system for agricultural applications that performs real-time image segmentation aboard drones to identify hogweed. The research was published in a high-profile journal, IEEE Transactions on Computers.
Sosnovsky’s hogweed is equally hazardous for farming, local ecosystems, and human health. Direct contact with human skin, especially if aggravated by exposure to the sun, causes severe burns that require continuous medical care and take weeks to heal. The rampant spread of Sosnovsky’s hogweed has become a real environmental disaster that extends across the whole of Russia, from its central part to Siberia and from Karelia to the Caucasus. Every year, the government allocates huge budgets (last year, 350 million rubles for Moscow alone) for hogweed elimination. Eradicating the poisonous plant has become one of the biggest challenges for Russian farming, the environment, and healthcare.
In the mid-20th century, there were plans to use hogweed as a fodder crop, given its quick growth, low maintenance requirements, and fast proliferation. However, it soon transpired that hogweed was no good as a livestock feed and its exceptional natural properties were a major problem rather than an advantage. One plant can produce up to 100,000 seeds per year, which are easily dispersed by the wind. This means that a single plant accidentally left behind makes the clearing operation utterly pointless.
Accurate real-time localization of hogweed was the first issue that researchers from the Skoltech Center for Computational and Data-Intensive Science and Engineering (CDISE) encountered when they started developing their monitoring platform two years ago. “Conventional monitoring methods are not effective enough, since ground observations are highly dependent on the human factor, while space remote sensing can spot large thickets only. Satellite images do not have sufficient resolution to discern individual plants. Besides, traditional monitoring strongly depends on weather and satellite revisit periods and, therefore, cannot provide up-to-date information,” lead author and Skoltech Ph.D. graduate Alexander Menshchikov explains.
The researchers decided to use drones that are able to capture up-to-date high-resolution hogweed images even in cloudy weather, and opted for in-flight data acquisition and processing on board the drones instead of the classical “data capture—orthophotomap—data analysis” scheme. “Even though the traditional approach provides exhaustive information about the area, it is nearly as effective as processing data on board with segmentation for one type of object, i.e. Sosnovsky’s hogweed. Besides, in the traditional method, after-flight image stitching and analysis takes several hours, whereas in-flight processing produces real-time data which are immediately downloaded to the base station, so that the clearing of the targeted area could start before the drone lands,” Alexander adds.
READ more: Artificial intelligence and drones will help pin down Sosnovsky’s hogweed