Early history of U.S. Salish Sea hydrophone networks

Where have all the meta/data gone?

Extracted from Chronology of hydrophones in the Salish Sea (U.S. and Canada, including Johnstone Strait) 60's-'70s: Single hydrophones: -- Rich Osborne (The Whale Museum) at Lime Kiln lighthouse; -- Ken Balcomb at the Center for Whale Research 80s-90s: -- Localization array at Lime Kiln (Rich, David Bain, and Joe Olson); -- Vashon Hydrophone Project (ACS); -- 1978-1983 John Ford 2000s: ~2001-2004: Val and Colorado College students establish Orcasound Lab 5km north of Lime Kiln; -- Andy Foote thesis (2004); Monika Wieland thesis (2007); ~2005-2012: Beam Reach students use hydrophones at Lime Kiln & Orcasound Lab (funding from WDFW, Beam Reach, and Cornell University) [Metadata example]

Neptune's fist!

Orcasound financial history

Who pays to archive meta/data & annotations?

Orcasound is a cooperative effort...

...of non-profit educational organizations, tech specialists, and researchers

15 organizational members (as of fall 2019):

        Beam Reach, SPC
        Colorado College, Physics & Environmental Science
        Orca Network
        Port Townsend Marine Science Center
        Orca Behavior Institute
        Cetacean Research Technology
        Whale Scout
        Deep Green Wilderness
	LAB-core System 
        Friends of Lime Kiln Society (FOLKS)
        The Whale Trail
        The Center for Whale Research
        Oceans Initiative
	Pacific Mammal Research
        Memorial University (St. Johns node?!)
      

You can join Orcasound, too! Just read and e-sign the MOA.

Orcasound 2.0: new locations, node hardware/software, and app in 2019

New locations

Hydrophone nodes Current: Orcasound Lab; Bush Point; Port Townsend Planned in 2020: Eagle Point (funded); Clallum Bay; Seattle Aquarium & Neah Bay? Outreach/education nodes Seattle Aquarium listening kiosk Port Townsend Marine Science Center listening station built with Killer Whale Tales and NOAA support 2018: Langley Whale Center Ocean Listening Exhibit 2019: Lime Kiln Visitor Center audio/video kiosk 2020: Integration of new live streaming tech and citizen science into extant educational nodes

Orcasound hardware evolution

A listening node for less than $1000 (U.S.)!

Basic ingredients (and costs): ($ 50) DIY stand ($300 x2) Hydrophones -- dual for redundancy, stereo listening, & bearing ($125) Pisound board -- 48/96/192 kHz/channel, stereo 24-bit ADC ($ 35) Raspberry Pi 3b+/4 -- single board computer ($ 35) Audio cables & waterproof box installed near the shoreline ($ 75) Power over Ethernet -- from box to 24-hour UPS & Internet router 60% of cost is hydrophones! (>75-95% for research nodes) DIY Guide: How to build your own hydrophone node!

Orcasound node software

What are meta/data formats?

• ffmpeg encodes audio data (compressed stream and/or lossless archive)
• HTTP-based protocols:
  • HLS (HTTP Live Streaming, aimed at iOS/Safari) and
  • MPEG-DASH (Dynamic Adaptive Streaming over HTTP, for everything else)
• Current solution is HLS segments streamed via a video.js player and FLAC format for the archive (but long-term dream is FLAC within DASH)
• DEMO: Remote access via Dataplicity reveals node name, sample rate, # channels specified in .env file.

Lossy & lossless data are archived in the cloud

• Amazon’s Simple Storage Services (S3) -- cost-effective data storage, public access, and automated archiving
• DEMO: Orcasound's S3 bucket architecture and metadata in names of object and filenames

Orcasound annotation efforts

Real-time detection (and notification)

Beta-testing more interactive UI in fall 2019: beta.orcasound.net
(DEMO: player & admin UI)

Open training & testing data for SRKW models

• Orcasound's orcadata repository Github wiki
• Orcasound acoustic sandbox on S3
• Annotation tools:
1. Audacity
2. Pod.Cast

Audacity labels

Audacity: select time bounds (& frequencey)

Pod.Cast

Product of 2019 Microsoft hackathons

Developed by Akash Mahajan, Prakruti Gogia, & Nithya Govindarajan

DEMO

Questions?