Hi everyone,
Following up on my earlier posts regarding template-free cross-correlation statistics and residual conditioning, I wanted to share a brief diagnostic observation on using Spectral Entropy (H_{\text{spec}}) as a fast quality gate for residual strain data.
Context & Motivation
When probing residual strain r(t) = d(t) - h_{\text{template}}(t) for unmodeled excess power or phase modifications, uncleaned low-frequency drift or imperfect PSD estimation can artificially inflate inter-detector cross-correlation, producing false-positive coherence between independent sites.
Diagnostic Metric & Minimal Implementation
We evaluate normalized spectral entropy H_{\text{spec}} over the conditioned frequency domain spectrum P(f):
- H_{\text{spec}} \approx 1.0: Residual matches stationary, ideal whitened Gaussian noise.
- H_{\text{spec}} \ll 1.0: Residual retains narrow-band lines, unwhitened low-frequency tilt, or non-stationary noise features.
A minimal helper function in Python:
import numpy as np
from scipy.stats import entropy
def compute_spectral_entropy(residual_fd):
"""Computes normalized spectral entropy H_spec over frequency-domain residual."""
psd = np.abs(residual_fd) ** 2
psd_norm = psd / np.sum(psd)
return entropy(psd_norm) / np.log(len(psd_norm))
Empirical Example (GW150914 Residual Test)
In a recent test evaluating residual cross-coherence between H1 and L1 around GW150914:
Unwhitened / Poorly Conditioned Residual: Residual retains significant low-frequency power (H
spec
≈0.17). This produced a false-positive inter-detector cross-correlation peak of C
H1,L1
=0.2774.
Properly Whitened Residual: Spectral entropy recovers to H
spec
≈0.68. The cross-correlation collapses to C
H1,L1
=0.0531—completely consistent with uncorrelated baseline noise.
Stage H
spec
Inter-Detector C
H1,L1
Coherence Interpretation
Unwhitened Residual ~0.17 0.2774 False Positive (Low-frequency leakage)
Whitened Residual ~0.68 0.0531 Null / Pure Noise
Takeaway
Using H
spec
as a pre-check before calculating cross-site correlation statistics provides a light, deterministic guardrail against spectral leakage artifacts.
Curious to hear if others in DetChar or unmodeled search pipelines use similar information-theoretic bounds for low-latency data verification.
Best regards,
Dimitar