flir with target.jpg

APOLLOCORE | PTZ CAMERA PROCESSING SOFTWARe

Machine Learning Intelligence for Marine EO/IR PTZ Cameras

Apollocore

Machine Learning Intelligence for Marine EO/IR PTZ Cameras

turbocharge marine PTZ cameras

  • Automatic Stabilization and ranging

  • Real time detection and tracking

  • 15 Marine Object classes

  • radar fusion with Proteuscore

The Apollocore Advantage

Solving The Challenges of Standard PTZ Cameras

  • OEM gyrostabilizers hold the camera steady, but tend to drift over time. Most affordable PTZs only offer 2-axis stabilization.

    ApolloCore’s IMU-driven stabilization preemptively counteracts vessel motion for stable imagery, even at high zoom levels.

  • Commercial off the shelf cameras are accessible and affordable, but were designed for direct human control.

    ApolloCore is a developer toolset for USV builders and autonomy developers. It is a bridge between the COTS PTZ camera and your autonomy stack that enables true perception.

  • Cameras struggle to accurately estimate range to detected objects.

    ApolloCore’s multi-stage ML monocular ranging delivers accurate distance estimates at mounting heights as low as 3 meters.

  • Without detection and classification, tracking objects around you is impossible.

    ApolloCore’s integrated Fusion & Tracking manages hundreds of targets simultaneously, predicting motion and maintaining track continuity.

  • Combining camera and Radar detections is very difficult without precise ranging and classification from each sensor.

    ApolloCore’s native ProteusCore™ Radar fusion combines Radar ranging precision with camera classification for a complete, fused tactical picture.

PTZ camera running ApolloCore camera processing software classifying a powerboat and two buoys, with distance measurements labeled in meters.

Standard marine PTZ cameras were built to show you the water. ApolloCore helps you understand it

Close-up of a SIMRAD marine radar and a FLIR PTZ camera mounted on a Tocaro Blue's test boat, Sea++ with a blue sky and clouds in the background.
multi-Sensor Fusion
Black and white infrared image of a ApolloCore IMU stabilization.
stabilization
ApolloCore machine learning view, showing the horizon line and multiple tracked and classified objects on the water.
classification
ProteusCore configuration app displaying classified vessels, markers, and path history.
search-and-scan
Night vision view of ApolloCore PTZ camera processing in fix and follow mode, where the camera stays dynamically fixed on an object in the water.
fix-and-follow

Multi-Sensor Fusion

Close-up of a SIMRAD marine radar and a FLIR PTZ camera mounted on a Tocaro Blue's test boat, Sea++ with a blue sky and clouds in the background.

multi-Sensor fusion power

radar excels at 360 degree detection and ranging

cameras excel at classification and precise bearing

combines eo camera, ir camera, and marine radar detections

one-click connection to proteuscore radar processing

  • fuses detections from eo/ir cameras and marine radar

  • Captures and catalogs images of each object

  • enables fusion for precise tracking and CPA from Radar

  • centralized fusion of measurements - not track-to-track correlation

apollocore + proteuscore fuses camera and radar, solving a fundamental maritime perception challenge

PTZ camera Stabilization

ApolloCore stabilizing controller

  • reads your vessel Attitude directly

  • mechanically and electronically stabilizes ptz platform

  • keeps camera aligned with horizon to ensure contacts are in view even at high zoom levels

  • uses native camera drivers to minimize latency

sea state Predictive Controller

validated with hardware-in-the-loop simulations

Classification

Differentiate detections with 15 object classes

  • 8 COLREGS (Rule 18) vessels, floating and fixed markers, 5 specialized classes

  • Detects shoreline or horizon to isolate waterborne objects

  • Provides ML-based monocular range estimate, even at low mounting heights

ApolloCore machine learning view, showing the horizon line and multiple tracked and classified objects on the water.

ApolloCore detects waterborne objects frame by frame…

View from a boat showing several anchored boats and a shoreline with trees and houses. The image is captured with a Thermal FLIR camera, with various objects detected and labeled with their distances in meters.

…and tracks them over time to inform your autonomous navigation system.

object classes hand-selected for navigation and isr

Ships

Ships

Offshore Structures

Offshore Structures

Personal Watercraft

Personal Watercraft

Floating Buoys

Floating Buoys

Birds

Birds

Daymarks

Daymarks

Towboats

Towboats

Sailboats

Sailboats

Ferries

Ferries

Fishing Boats

Fishing Boats

Debris

Debris

Power Boats

Power Boats

Human Faces

Human Faces

Automobiles

Automobiles

Barges

Barges

Search and Scan

ApolloCore configuration app with a legend showing options: fog of war, recently checked, land area, current view, with various symbols, colors, and shapes indicating different terrain and features.

EO/IR Object Seeking Mode‍ for wide area surveillance

  • searches for new objects while continuously updating existing ones

  • Auto adjusts camera aim and zoom to maximize area coverage

  • Converts the PTZ's narrow field of view into a long-range detection advantage

  • Best for wide-area patrol and surveillance where full situational awareness is the priority

ApolloCore reports a map of detection probabilities over area within the camera field of view

Fix and Follow

dynamic object tracking

  • Maintains a stable, sustained lock on a single target vessel for as long as it remains visible

  • Automatically re-acquires targets that are temporarily lost

  • Ideal for any mission requiring dedicated single-target focus

  • maintains broad area trackers, dynamic ranging, and object searching while in fix-and-follow mode

Automatic stable imaging of waterborne objects from close range, to the edge of EO/IR visibility

Explore other products

Laptop running ProteusCore configuration application. Displaying a map with target tracking for various vessels and navigational markers on a blue water background.
ProteusCore Software

Lightweight Radar communication and processing software for your tech stack