TensorFlow

Wed, 15 Jan 2025 00:00:00 +0000

Imagine you work at an online clothing store. Every day, thousands of product photos arrive and someone needs to tag each one: is it a t-shirt? A sneaker? A bag? Doing this by hand is painfully slow, so you decide to teach a computer to do it for you. That’s exactly the kind of problem Fashion MNIST was designed to solve — and it’s a perfect first project to understand how neural networks learn to see.

Master’s Article Summaries

Wed, 04 Sep 2024 00:00:00 +0000

TL;DR

Replay attacks remain the easiest ASV spoofing vector; DL-RAD, autoencoders + Siamese networks, and CQCC features significantly improve detection.
ASVspoof 2021 pushes detection into real-world, noisy settings requiring domain generalisation.
Remote sensing (NEON/NIST) mirrors the need for multi-source data fusion—hyperspectral, LiDAR, RGB—for ecological insights.

SPIED articles

Ren et al. — Replay attack detection via loudspeaker distortion (DL-RAD).
ASVspoof 2021 — Spoofed/deepfake speech detection in the wild.
NIST DSE — Plant identification with airborne remote sensing.
Adiban et al. — Autoencoder + Siamese countermeasures on ASVspoof 2019.

Context

Consolidated notes from 4 September 2024 research sprint.
Focus: voice authentication security (spoofing/deepfake) and ecological remote sensing.
Supporting docs: ZIP archive with slides/text; online share for extended summaries.

1. Replay Attack Detection Based on Distortion by Loudspeaker

Source: Ren et al., Multimedia Tools and Applications, 2019. DOI: 10.1007/s11042-018-6834-3.
TL;DR: DL-RAD detects replay attacks by analysing loudspeaker-induced distortions (low-frequency attenuation, harmonic energy).
Highlights: Harmonic Energy Ratio, Low Spectral Variance. Achieves >98% detection accuracy.
Application: voice authentication systems (mobile, banking). Focus on dependable feature extraction.
Reflection: Consider how speaker hardware signatures can serve as anti-spoof signals.

2. ASVspoof 2021: Deepfake Speech Detection in the Wild

Source: ASVspoof 2021 challenge; TASLP 2023 paper (DOI: 10.1109/TASLP.2023.3285283).
TL;DR: Evaluates spoofed/deepfake detection in noisy, uncontrolled environments; introduces large-scale dataset.
Highlights: Variance across capture devices, environmental noise; combination of spectrogram analysis and deep models.
Application: deploy robust detectors for real-world ASV systems, banking, call centers.
Reflection: emphasises the need for adaptive models and domain generalization.

3. NIST DSE Plant Identification with Remote Sensing

Source: NIST publication on airborne remote sensing data challenge.
TL;DR: Integrates hyperspectral, LiDAR, RGB data to segment tree crowns, align field data, classify species.
Highlights: data fusion, scaling ecological monitoring, addressing heterogeneous resolutions.
Application: environmental monitoring, conservation, precision agriculture.
Reflection: parallels with multi-modal data integration in other domains (e.g., security sensors).

4. Replay Spoofing Countermeasure Using Autoencoder & Siamese Networks (ASVspoof 2019)

Source: Adiban et al., Computer Speech & Language, 2020. DOI: 10.1016/j.csl.2020.101105.
TL;DR: Combines autoencoders (denoising) with Siamese networks (similarity) to detect replay attacks.
Highlights: CQCC features, improved EER by 10.73%, t-DCF drop of 0.2344.
Application: mobile authentication, payment systems, secure access.
Reflection: underscores the power of hybrid feature + metric-learning approaches.

Supporting Docs

Comparative notes across TXT/PPTX/Google Docs for detailed methodology.
Extended definitions (CQCC, EER, t-DCF) stored in local dictionary.
Presentations (March 25) outline challenge evolutions and future work.

Next steps

Investigate combined defenses against multi-modal spoofing (synthetic + replay).
Explore edge deployment viability for real-time detection.
Compare ecological data pipelines with security workflows for cross-domain insights.

Ai on Osmar Petry