UTS researchers develop AI system for monitoring hen health

We're at an early stage in the journey, we're trying to identify the factors that are happening before pile-ups and smothering, but once we identify those risk factors, we can then program it into the software so that the farmer gets an alert and knows what to do.

Or even better, the program itself can actually start the initiation to prevent them. For example, start the feeders or turn the misters on.

The aim of the project was specifically to look at what are the factors that contribute to bird pile-ups and smothering, and that's why we use this shed who had a couple of experiences in the past.

So we can do that. Better detection, better tracking in the shed and also the bird segmentation image base. So the aim is to do lots of bird behavior analysis.

The ability of the vision system to identify an individual bird and then to track its direction and rate of movement and then leading into density estimates, and finally  into an algorithm that can say I think this bird is eating, is drinking, this bird is nesting, etc. We now have all the tools to look for what are the factors that are contributing to pile-ups and smothering.

The benefit of these technologies will help the farm to quickly identify where the pile-up, where the high density, will create a negative impact to bird production.

It's important because what we're looking for are the factors that are leading up to these events, because if we have the factors that are leading up to the events, we can take actions to stop them from happening. And to do that requires 24/7 monitoring and identifying the risk factors and therefore a video based system that is automated with an SMS based system to the farmer is the ideal way to do that.

Okay, from a technology point of view, we first needed bird detection in the image of the video. So this boundry box reflects each bird that has been detected. When we do this detection. Then we move to the next panel. That is you can see is all the birds that will be tracked. Each individual bird will be tracked one by one and you can see the number that is marked for each bird. We roughly understand how many birds and whether they are moving in this scene. So the segmentation means we can do the each individual analysis about the birds behavior, for example, if they are feeding or drinking or even other things. This is very important for the welfare analysis or the production. So this panel actually is more used as an AI model to the density counting. We want to understand in this very small area, whether the birds pile-up. If they pile-up then this is the biggest signal whether they will eventually become smothered.

So what we are trying to do is give farmers a management tool that they can monitor their flock. You saw back at the laboratory that the technology is developed to the point where it can recognize individual birds. You can also track the direction of movement and the velocity. Combined, we can look at the density of those birds. And finally on that last screen, we saw that it was able to recognize individual bird behaviors. With a camera based system you can monitor all birds in this flock that are in the frame of vision for all those aspects. And they will relate to the welfare status of the bird. And over time we'll start to learn the patterns of factors - management environment, etc. that contribute to the birds welfare state and their production.

What we want to know now the next stage is what are the patterns of these coordinated behaviors in the flock? What percentage of the birds are nesting? What percentage of the birds are grooming? What percentage of the birds are hanging around the watering points? And therefore, those patterns may tell us something that we can use to help management - optimal times for feeding for example, what are the factors that are likely to positively influence welfare? And even what are the best ways to manage the internal environment there may be energy savings etc To do that, we don't know these flock coordinator behaviors yet and that's the next stage but using the base technology from this study, to go to that level, which is to say what is the flock doing in the shed that's the next point in the journey.

So what we're looking for, for the farmers, is not for them to have to sit and watch the video 24/7. We are envisaging a system whereby the computer will work out what are the risk factors say for density levels getting to the point that we may have a pile-up, and that will then send an SMS warning to the farmer who's doing other things to say there could be something happening in shed two, come and have a look down the back. But the objective of all of this work is to solve a real problem of farmers take the technology and apply it to solve the problem. And that's what we hope to be doing here.