Open Net Zero logo
Fish Detection AI, Optic and Sonar-trained Object Detection Models
L o a d i n g
Organization
National Renewable Energy Laboratory (NREL) - view all
Update frequencyunknown
Last updated6 days ago
Overview

The Fish Detection AI project aims to improve the efficiency of fish monitoring around marine energy facilities to comply with regulatory requirements. Despite advancements in computer vision, there is limited focus on sonar images, identifying small fish with unlabeled data, and methods for underwater fish monitoring for marine energy. A YOLO (You Only Look Once) computer vision model was developed using the Eyesea dataset (optical) and sonar images from Alaska Fish and Games to identify fish in underwater environments. Supervised methods were used within YOLO to detect fish based on training using labeled data of fish. These trained models were then applied to different unseen datasets, aiming to reduce the need for labeling datasets and training new models for various locations. Additionally, hyper-image analysis and various image preprocessing methods were explored to enhance fish detection. In this research we achieved: 1. Enhanced YOLO Performance, as compared to a published article (Xu, Matzner 2018) using earlier yolo versions for fish object identification. Specifically, we achieved a best mean Average Precision (mAP) of 0.68 on the Eyesea optical dataset using YOLO v8 (medium-sized model), surpassing previous YOLO v3 benchmarks from that previous article publication. We further demonstrated up to 0.65 mAP on unseen sonar domains by leveraging a hyper-image approach (stacking consecutive frames), showing promising cross-domain adaptability. This submission of data includes: - The actual best-performing trained YOLO model neural network weights, which can be applied to do object detection (PyTorch files, .pt). These are found in the Yolo_models_downloaded zip file - Documentation file to explain the upload and the goals of each of the experiments 1-5, as detailed in the word document (named "Yolo_Object_Detection_How_To_Document.docx") - Coding files, namely 5 sub-folders of python, shell, and yaml files that were used to run the experiments 1-5, as well as a separate folder for yolo models. Each of these is found in their own zip file, named after each experiment - Sample data structures (sample1 and sample2, each with their own zip file) to show how the raw data should be structured after running our provided code on the raw downloaded data - link to the article that we were replicating (Xu, Matzner 2018) - link to the Yolo documentation site from the original creators of that model (ultralytics) - link to the downloadable EyeSea data set from PNNL (instructions on how to download and format the data in the right way to be able to replicate these experiments is found in the How To word document)

AIEyeSea datasetEyeseaEyesea optical datasetFish Detection AIHydrokineticMHKMarinePyTorchPyTorch codePythonShell codeSonar-trained Object Detection ModelsYOLO modelYOLO performanceYOLO version 8YOLOv8Yaml codecodecross-domain adaptabilityenergyhyper-image approachneural networksobject detectionpowersmall fish detectionyou only look once model
Additional Information
KeyValue
Dcat Issued2014-06-25T06:00:00Z
Dcat Modified2025-05-21T15:42:18Z
Dcat Publisher NameWater Power Technology Office
Guidhttps://data.openei.org/submissions/8419
Harvest Object Idb84fe251-3f85-4a69-b92c-72a598624c52
Harvest Source Id4eb7107f-a2b1-40e3-b36a-8161aa98a56e
Harvest Source TitleOpenEI Data Portal
Share this Dataset
Trust Signals
Trust Framework(s)None
Assuranceunknown
Data Sensitivity Classunknown
Licenceunknown
Files
  • Pacific Northwest National Laboratory EyeSea Fish Optic Images and Labels

  • Underwater Fish Detection Article by Xu and Matzner 2018

  • Ultralytics Public Documentation Website on YOLO Model Version 8

  • Experiment5_Resources.zip

  • Experiment3_and_Experiment4_Resources.zip

  • Sample2_data_structure.zip

  • Sample1_data_structure.zip

  • Yolo_models_downloaded.zip

  • Caltech Fish Counting Domain Adaptive Object Detection CFC-DAOD Dataset

  • Experiment1_Resources.zip

  • Experiment2_Resources.zip

  • Yolo_Object_Detection_How_To_Document.docx