Xin Wang

Xin Wang

he/his

Trying to build something cool

Measuring Visual Acuity in Bees from High-Resolution Images

4 minute read

Published:

Visual acuity, the ability to perceive detail, is ecologically important, as it dictates what aspects of a visual scene an animal can resolve. The study of visual acuity in bee species helps biologists understand their evolutionary history and gain insight into their foraging strategies and navigation abilities. Sponsored by the Caves Lab, this project aims to design a pipeline that uses high-resolution 2D photos taken by the NSF-funded Big Bee Project to estimate visual acuity across different bee species. In the pipeline, we develop algorithmic approaches to measure the diameter of the ommatidia and estimate the interommatidial angles on the eyeʼs surface. By achieving a significant level of automation and accuracy, our pipeline will facilitate more efficient data collection for biologists. You can access the code and poster, if you are interested.

Introduction

Previous studies have relied on painstaking manual counts and estimates to describe compound eye structure. So, we focus on utilizing 2D bee photos to expedite the data collection process. In our pipeline, we want to detect and measure following key quantities:

  • ommatidia: individual hexagon-like units that make up the compound eyes of insects and its diameter \(D\) refers to the width of hexagon and represents the sensitivity to light
  • Interommatidial angle \(\boldsymbol{\phi}\) : angular separation between adjacent ommatidia in the compound eyes, representing the field of view that each ommatidium covers
  • Cycle per Degree (CPD): the number of distinct line pairs, or cycles, that can be perceived within one degree of the visual field. A higher CPD value indicates finer visual acuity and the ability to discern smaller details or patterns.
\[\boldsymbol{C P D}=1 /(2 * \boldsymbol{\phi} * 180 / \boldsymbol{\pi})\]
eye structure

We collected data from the Big Bee Library, an online repository housing bee image, trait, and specimen data. We bulk downloaded Head Frontal and Habitus Lateral images for each bee and organized them into a folder named by the bee’s catalog number. Currently, our data focused exclusively on 145 bee specimens collected at UCSB Cheadle Center. Each image was obtained by synthesizing multiple identical 6000*4000 pixel bee photos with varying focal points, allowing for the creation of high-resolution representations of different sections of the bee. A scale bar for length measurements is available in each image. For the contour analysis, we perform eye segmentation on the head frontal images, extracting both eye bitmaps and converting them into binary images.

two sides of one bee

Method

Our pipeline developed for measuring visual acuity parameters from 2D images of bees involves several steps. Firstly, the ommatidia diameter is measured using a 2D Ommatidia Diameter Algorithm (ODA)[1]. Next, a pre-trained segmentation model segment-anything is deployed to accurately segment the shape of the bee’s eye. To approximate the shape of the bee’s eye, a continuous curve is fitted to the eye contour. Finally, by simulating discrete points along the fitted curve, with each point representing an ommatidium and utilizing the previously measured ommatidia diameter, the interommatidial angles can be calculated. We then analyze the ommatidia diameter and interommatidial angle among bees in the Apidae family.

pipeline

Results

By examining the initial results in the Apidae family, our pipeline and algorithms can produce consistent results with ecological and biological meanings. Close results are obtained from multiple measurements on the same bee specimen, and measurements on distinct bee specimens with identical biological traits also yield similar outcomes.

results

The findings from the study reveal that male bees exhibit larger ommatidia diameter \(\boldsymbol{D}\), while female bees exhibit superior \(\boldsymbol{C P D}\) capabilities for discerning small details. Male bees predominantly remain within the hive and engage in mating activities with the queen. The presence of larger \(\boldsymbol{D}\) in male bees enhances their sensitivity to low light conditions, enabling them to effectively function in such environments. Conversely, female bees typically venture outside the hive to gather pollen and nectar. The possession of better \(\boldsymbol{C P D}\) in female bees facilitates their navigation through complex environments and enables them to interact adeptly with various objects encountered during foraging activities.

You May Also Enjoy

BioML Challenge 2024: Bits to Binders

8 minute read

Published:

CAR-T cell therapy is a type of cancer treatment where a patient’s own T cells， are genetically modified to fight cancer. The process involves extracting T cells from the patient, engineering them to express a Chimeric Antigen Receptor (CAR) that specifically targets cancer cells, and then reintroducing these modified cells into the patient’s body. Once inside the patient body, the CAR-T cells recognize and attack the cancer cells, helping to eliminate the tumor. An open question in the field of CAR-T cell therapy is how to design effective antigen-binding domains that can specifically target cancer antigens and trigger a robust immune response.

Molecules as Cellular Complexes

less than 1 minute read

Published:

The molecule is a complex system characterized by intricate relationships between its components, such as atoms, bonds, and rings. Topological Deep Learning (TDL) utilizes domains beyond graphs and constructs a comprehensive framework to process and extract knowledge from data associated with this kind of system. In this study, I introduce a novel representation of molecules as cellular complexes, specifically designed to accommodate ring structures. I rebuilt a topological neural network (TNN), the Cell Attention Network (CAN), and conducted a comparative analysis with standard Graph Neural Networks (GNNs) as baselines. This comparison highlighted both the strengths and limitations of our approach, offering insights into the potential and challenges of using cellular complexes for molecular modeling.

Universal Approximation Theorem

less than 1 minute read

Published:

The most important application of neural networks is in machine learning, where neural networks are “trained” to approximate a function. Thus, a fundamental question for neural networks is whether they can approximate reasonable functions to an arbitrary degree of accuracy. This depends on the activation function \(\sigma\) and is the subject of many papers, including the paper studied for this project. This project was mentored by Zach Wagner and supported by UCSB’s Directed Reading Program. We won the People’s Choice Award luckily. You can access our presented poster via this link if you are interested.