Projects/Event-Based Star Tracking for Spacecraft Attitude Estimation

Event-Based Star Tracking for Spacecraft Attitude Estimation

A Speed-Aware EBS-EKF research prototype for event-camera star tracking that improves low-light spacecraft attitude estimation by making centroid correction depend on both brightness and image-plane speed.

Space Autonomy2026Research Assistant / Star-Tracking Research Lead
Event-Based VisionSpace AutonomyState EstimationStar TrackingEBS-EKFAstrometryLow-SWaPAttitude Estimation

Highlights

  • Extended EBS-EKF from brightness-only centroid correction to a speed-aware measurement model that shifts positive-event centroids along the image-plane motion direction.
  • Integrated adaptive measurement covariance so fast-moving stars and weak centroid clusters contribute less aggressively to the weighted attitude update.
  • Built on an event-tracking prototype with event batching, centroid extraction, blind astrometry initialization, and batchwise weighted Wahba attitude estimation.
  • Validated the end-to-end module on a 3.0 s representative track with 372 event batches, about 8.7M events, and 38.3 average centroids per batch without adding measurable runtime cost.

Key metrics

Event volume
8.7M
Events processed in a 3.0 s representative track
Evaluation batches
372
Paired baseline vs speed-aware run
Centroid density
38.3
Average centroids per batch
Mean latency
8.17 ms
Speed-aware prototype vs 8.47 ms baseline
Max latency
118.39 ms
Speed-aware prototype vs 124.49 ms baseline
Budget overruns
49
One fewer than the magnitude-only baseline on the same track

Media

Project cover summarizing the event-camera star-tracking pipeline, speed-aware centroid correction, adaptive covariance, and preliminary runtime metrics.
Approach overview: the baseline performs event batching, centroid extraction, blind astrometry, and weighted Wahba attitude updates; the extension estimates image-plane speed, applies speed-aware correction, and moves toward asynchronous 3D EBS-EKF.
Measurement-model motivation: EBS-EKF corrects centroid bias with brightness, while this project adds image-plane speed and adaptive uncertainty for fast-moving or weak centroid observations.
Method details: corrected centroids are shifted along normalized image-plane velocity, covariance increases with speed and weak centroid support, and weighted Wahba fuses measurements batch-by-batch.
Baseline run on the representative track: 3.0 s sequence, 372 batches, about 8.7M events, 38.3 average centroids per batch, 8.47 ms mean latency, 124.49 ms max latency, and 50 budget overruns.
Speed-aware run on the same track: RA, Dec, and roll estimates visibly change while mean latency drops to 8.17 ms, max latency drops to 118.39 ms, and budget overruns drop to 49.

Tech stack

PythonEvent-Based CamerasExtended Kalman FilteringWeighted Wahba SolverBlind AstrometrySynthetic Data GenerationLow-Light Sensor ModelingPerformance Evaluation

Problem and research gap

Star trackers estimate spacecraft attitude from observed star positions, which is critical for communication, Earth observation, and scientific pointing. Conventional APS star trackers are limited by exposure time and frame processing cadence, making rapid motion and high-frequency pointing harder to support.

Event-based cameras are attractive because they output sparse asynchronous brightness-change events at microsecond-scale temporal resolution. For sparse star fields, most pixels remain inactive, so the sensor can offer lower latency, lower data volume, reduced motion blur, and potentially lower power consumption.

The main challenge is measurement quality under low light. Existing EBS-EKF work uses a low-light event model, a magnitude-dependent centroid correction, and a 3D EKF. The remaining gap is that the centroid offset is treated as a fixed function of brightness, even though the offset should theoretically vary with image-plane star speed.

System overview

I kept the measurement-driven philosophy of EBS-EKF instead of replacing the tracker. The implemented prototype starts from a practical event-tracking baseline: accumulate event batches, extract star centroids, initialize the field with blind astrometry, and estimate attitude batch-by-batch through a weighted Wahba solve.

The speed-aware extension is inserted between centroid extraction and attitude update. For each tracked star, the prototype estimates image-plane velocity from consecutive batches, uses centroid event count as a brightness proxy, applies a speed-aware centroid correction, and computes adaptive measurement covariance before the attitude update.

Speed-aware measurement model

The measured centroid is treated as a biased observation rather than as a perfect star location. The correction shifts the centroid along normalized image-plane velocity using an offset function conditioned on brightness proxy and speed. In the prototype, centroid support count stands in for catalog magnitude while the full target method would use apparent magnitude and calibrated event-camera parameters.

The uncertainty model is adaptive: covariance increases when motion is fast or centroid support is weak. The intuition is that fast-moving stars and dimmer or weaker clusters should influence the attitude estimate less strongly than stable, well-supported measurements.

  • Corrected centroid: measured centroid plus a motion-direction offset driven by brightness proxy and image-plane speed.
  • Adaptive covariance: fast motion and weak centroid support increase measurement uncertainty.
  • Weighted fusion: inverse-variance weights feed the weighted Wahba attitude update in the current prototype.

Evaluation setup

The project uses a staged evaluation plan. Synthetic trade-space scenarios generate controlled star-motion data for speed and brightness sweeps, helping calibrate the correction and debug failure modes before large real-data runs.

The real-data stage is designed around released EBS-EKF real-night-sky data, Earth-rotation-based validation, and public variable-speed slew observations. The current results are an initial ablation, not a final accuracy benchmark.

  • Comparisons: current baseline, magnitude-only correction, and speed-aware prototype.
  • Current metrics: RA/Dec/roll attitude behavior, mean and max latency, budget overruns, and centroids per batch.
  • Target metrics: across/about attitude error when trusted reference solutions are available.

Preliminary results

On one representative 3.0 s track, both the baseline and speed-aware prototype processed 372 batches and approximately 8.7M events with the same average centroid count of 38.3 centroids per batch. This keeps the comparison focused on the measurement-model change rather than a different detection count.

The speed-aware prototype changed the estimated RA, Dec, and roll trajectories, showing that the new measurement layer is active end-to-end. Runtime stayed essentially the same: mean latency decreased from 8.47 ms to 8.17 ms, max latency decreased from 124.49 ms to 118.39 ms, and budget overruns decreased from 50 to 49.

These results support the engineering viability of the module, but they are intentionally framed as preliminary. A single track demonstrates integration and runtime feasibility; it does not yet prove consistent accuracy gains across regimes.

Engineering contribution

  • Implemented a measurement-model upgrade that can be tested inside the existing event_explorer-style pipeline without first rebuilding a full asynchronous 3D EKF.
  • Preserved astrometry and visualization tooling, making the prototype easier to debug and compare against the magnitude-only baseline.
  • Designed the synthetic scenario workflow around speed, brightness, field density, sky location, focal length, detector thresholds, and motion-axis sweeps.
  • Kept the algorithmic focus on low-SWaP constraints where measurement-model improvements are valuable because hardware, aperture, and compute budgets are limited.

Limitations and next steps

  • Run the full synthetic trade-space sweep to calibrate the speed-aware correction across speed and brightness regimes.
  • Evaluate paired baseline vs speed-aware runs across multiple real night-sky tracks instead of one representative sequence.
  • Use Earth-rotation and public variable-speed observations for stronger validation and less reliance on a single reference tracker.
  • Integrate the corrected measurements and adaptive covariance into a fuller asynchronous 3D EBS-EKF pipeline for continuous rotation and angular-velocity updates.

Related projects

OwnerPilot AI operating copilot project cover

OwnerPilot - AI Operating Copilot for SMB Owners

AI Product Engineering · 2026

Featured

Open-source decision intelligence platform that helps smaller business owners import records, track obligations, investigate cash and margin shifts, forecast scenarios, and execute evidence-backed operating actions.

Full-Stack AIDecision IntelligenceRAGForecasting
Automated goalie robot project cover

Automated Goalie: Ping Pong Ball Trajectory Prediction System

Robotics · 2025

Featured

A closed-loop robot-learning prototype that detects a ping pong ball, estimates its 3D motion, predicts the landing point, and rotates a servo-driven blocker in real time on a Raspberry Pi-based hardware setup.

Computer VisionTrajectory PredictionEmbedded SystemsReal-Time Robotics
S&P 500 deep learning forecasting system cover

S&P 500 Deep Learning Forecasting System

Financial ML · 2025

Featured

A research-grade forecasting system that evaluates Temporal Fusion Transformers against LSTM and ARIMAX baselines for S&P 500 return prediction using mixed-frequency market and macroeconomic data, then extends TFT with regime-aware attention and interpretability diagnostics.

Financial MLTime-Series ForecastingTemporal Fusion TransformerRegime-Aware Attention
Vision-guided differentiable physics project cover

Vision-Guided Differentiable Physics for Robotic Manipulation

Robotics · 2025

Featured

A presentation-style robotics case study that connects RGB observations, robot state, temporal Transformer prediction, differentiable rollout losses, and Isaac Sim Franka data to learn multi-step manipulation behavior from visual context.

RoboticsRobot LearningDifferentiable PhysicsVision-Guided Control
← Back to all projects