Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networks

About

Learning representations of geographical space is vital for any machine learning model that integrates geolocated data, spanning application domains such as remote sensing, ecology, or epidemiology. Recent work embeds coordinates using sine and cosine projections based on Double Fourier Sphere (DFS) features. These embeddings assume a rectangular data domain even on global data, which can lead to artifacts, especially at the poles. At the same time, little attention has been paid to the exact design of the neural network architectures with which these functional embeddings are combined. This work proposes a novel location encoder for globally distributed geographic data that combines spherical harmonic basis functions, natively defined on spherical surfaces, with sinusoidal representation networks (SirenNets) that can be interpreted as learned Double Fourier Sphere embedding. We systematically evaluate positional embeddings and neural network architectures across various benchmarks and synthetic evaluation datasets. In contrast to previous approaches that require the combination of both positional encoding and neural networks to learn meaningful representations, we show that both spherical harmonics and sinusoidal representation networks are competitive on their own but set state-of-the-art performances across tasks when combined. The model code and experiments are available at https://github.com/marccoru/locationencoder.

Marc Ru{\ss}wurm, Konstantin Klemmer, Esther Rolf, Robin Zbinden, Devis Tuia• 2023

Related benchmarks

TaskDatasetResultRank
RegressionElevation
0.025
59
ClassificationCountry
Accuracy66.9
46
ClassificationBiome
Accuracy29.1
37
RegressionTemperature
0.381
15
ClassificationEcoRegions
Accuracy0.6
15
RegressionPopulation
R-squared0.053
15
RegressionCali-Housing
0.238
15
Showing 7 of 7 rows

Other info

Follow for update