Khalasi: Energy-Efficient Navigation for Surface Vehicles in Vortical Flow Fields

MuRAL Lab, Plaksha University
Under Review
Banner Image

Overview of khalasi pipeline. (A) Training and evaluation environment: The agent (red) navigates toward the goal (orange) by leveraging local flow features. The green box and orange box denotes the agent and goals spawn region respectively. (B) Training pipeline: historical local velocity observations are processed through a Gaussian Process Regression (GPR) module for flow reconstruction, followed by spatial gradient extraction via a CNN encoder. The resulting latent representation, combined with positional and goal data, is input to a Soft Actor–Critic (SAC) policy. (C) Trained using parallelized environments with diverse flow variations enable better generalization across different flows.

Abstract

For centuries, khalasi (Gujarati for sailor) have skillfully harnessed ocean currents to navigate vast waters with minimal effort. Emulating this intuition in autonomous systems remains a significant challenge, particularly for Autonomous Surface Vehicles (ASVs) tasked with long-duration missions under strict energy budgets. In this work, we present a learning- based approach for energy-efficient surface vehicle navigation in vortical flow fields, where partial observability often un- dermines traditional path-planning methods. We present an end-to-end reinforcement learning framework based on Soft Actor–Critic (SAC) that learns flow-aware navigation policies using only local velocity measurements. Through extensive evaluation across diverse and dynamically rich scenarios, our method demonstrates substantial energy savings and robust generalization to previously unseen flow conditions, offering a promising path toward long-term autonomy in ocean envi- ronments. The navigation paths generated by our proposed approach show an improvement in energy conservation 30−50% compared to the existing state-of-the-art techniques.

Energy Results

Environment Oscillating Single Cylinder Static Single Cylinder Static Double Cylinder
Khalasi (Ours) 111.38 ± 28.48 80.97 ± 18.93 98.40 ± 21.93
Grid Based 164.79 ± 8.54 161.30 ± 9.23 166.47 ± 8.65
RL Based 183.68 ± 25.42 174.26 ± 17.31 179.72 ± 24.23
Mean Efficiency 35.89% 51.67% 43.07%

Navigation Results

Environment Vertical Spawn L-shaped Spawn Grid Spawn (10×10)
Oscillating Single Cylinder 95% 80% 94.33%
Static Single Cylinder 100% 90% 92.98%
Static Double Cylinder 70% 95% 95.3%

Flow Generalization Results

Video Presentation

BibTeX

@article{YourPaperKey2024,
  title={Your Paper Title Here},
  author={First Author and Second Author and Third Author},
  journal={Conference/Journal Name},
  year={2024},
  url={https://your-domain.com/your-project-page}
}