Iceland OTA Data Extraction —
7 Platforms, 270-Day Forward
Dive.is · Reykjavik Excursions · Arctic Adventures

Systematic weekly extraction of Iceland's leading tour & activity OTAs — 270 days forward, every week

This case study covers Iceland's adventure tourism market and how TravelScrape solved OTA data extraction — served by a cluster of specialised OTA platforms — each offering unique tours, activities and experiences ranging from glacier hikes and Northern Lights expeditions to whale watching and diving in Silfra. A business intelligence client required consistent, structured, weekly data from 7 of these leading platforms to support pricing strategy, competitive benchmarking and demand forecasting.

The project requirement: weekly tour data extraction covering all tour listings, schedules, availability calendars and pricing data across a rolling 270-day forward window from 7 publicly accessible Icelandic OTA websites — on a weekly cadence — structured as JSON and delivered to the client's FTP endpoint on a fixed Monday schedule.

Full scope — all in-scope requirements defined

7 Iceland OTA platforms — each with unique structure & data challenges

Each of the 7 target platforms has a distinct site architecture, booking system and data schema. TravelScrape built a dedicated extraction module per platform and normalised all 7 into a single unified JSON output schema.

All mandatory attributes — captured per tour, per date, per platform

Every extracted tour record contains the full set of mandatory fields, populated and validated before delivery. Missing mandatory fields trigger extraction retry — no partial records are ever delivered.

Tour Identification

Tour ID (platform-native)

Tour Name / Title

Tour Category / Type

Sub-Category / Activity

Platform / Source OTA

Tour URL (canonical)

Extraction Timestamp

Schedule & Availability

Available Date

Departure Time(s)

Duration (hours / days)

Availability Status

Remaining Slots / Capacity

Booking Cut-off Time

Cancellation Policy

Pricing & Rates

Adult Price (base)

Child Price (if applicable)

Group Rate / Discount

Early Bird Price

Currency (ISK / EUR / USD)

Add-on / Optional Extras

Price Tier / Category

Location & Logistics

Departure Point

Meeting Point / Address

Pick-up Availability (Y/N)

Pick-up Locations (list)

Drop-off Point

Geographic Region

GPS Coordinates

Tour Details

Short Description

Full Description

Inclusions

Exclusions

Requirements / Age Limits

Difficulty Level

Language(s) Available

Ratings & Media

Review Score (platform)

Number of Reviews

Review Summary / Tags

Primary Image URL

Gallery Image URLs

Badge / Award Tags

Featured / Promoted Status

Sample JSON output — single tour record

{
  "platform": "Arctic Adventures",
  "platform_url": "adventures.is",
  "extracted_at": "2025-01-13T06:00:00Z",
  "tour": {
    "id": "AA-JEEP-HIGHLAND-001",
    "name": "Super Jeep Highland Adventure — Landmannalaugar",
    "category": "Adventure / Super Jeep",
    "sub_category": "Highland Day Tour",
    "url": "https://adventures.is/iceland/day-tours/super-jeep-highland",
    "duration_hours": 12,
    "difficulty": "Moderate",
    "languages": ["English", "German"],
    "review_score": 4.9,
    "review_count": 284,
    "badge": "Top Seller",
    "featured": true
  },
  "location": {
    "departure": "Reykjavik — BSI Bus Terminal",
    "region": "Highland Iceland",
    "pickup_available": true,
    "pickup_locations": ["Reykjavik Hotels", "Keflavik Airport"],
    "gps": {"lat": 63.9919, "lng": -22.7028}
  },
  "availability": {
    "date": "2025-06-21",
    "departure_time": "07:30",
    "status": "Available",
    "slots_remaining": 6,
    "total_capacity": 12,
    "booking_cutoff": "2025-06-20T23:59:00Z",
    "cancellation_policy": "Free cancellation up to 48 hours before"
  },
  "pricing": {
    "currency": "ISK",
    "adult_price": 34900,
    "child_price": 17450,
    "group_discount": "10% for 8+ persons",
    "early_bird_price": 31900,
    "early_bird_condition": "Booked 30+ days in advance",
    "add_ons": [
      {"name": "Lunch Pack", "price": 2500},
      {"name": "Private Guide Upgrade", "price": 15000}
    ]
  },
  "inclusions": ["Super Jeep transport", "Professional guide", "All entrance fees"],
  "exclusions": ["Meals", "Personal travel insurance"],
  "images": {
    "primary": "https://adventures.is/media/tours/super-jeep-highland-hero.jpg",
    "gallery": ["...image-2.jpg", "...image-3.jpg"]
  },
  "meta": {
    "forward_window_days": 270,
    "extraction_run": "2025-W03"
  }
}

What made this project complex — and how we solved it

Key technical challenges across 7 platforms

270-day forward calendar extraction: Each platform renders availability calendars differently — some via JavaScript, others via AJAX API calls. Capturing 270 days of forward data required platform-specific calendar navigation logic for all 7 sites, including handling months that don't load until the user navigates to them.

Dynamic and layered pricing logic: Platforms like Reykjavik Excursions and Arctic Adventures apply multiple pricing layers simultaneously — base rate, early-bird discount, group rate, seasonal surcharge and add-on pricing. Capturing all pricing dimensions per tour per date required structured multi-field extraction, not just headline price.

Session-based booking flows: Dive.is and Mountain Guides use session-based booking flows that initialise slot-specific pricing and availability only after a date is selected — requiring headless browser automation to simulate user interaction before pricing data becomes visible in the DOM.

TravelScrape solutions applied

Dedicated extraction module per platform: Built a separate extraction engine per platform tuned to each site's exact DOM structure, JavaScript rendering behaviour, calendar navigation pattern and session requirements.

Headless browser for session-based platforms: Dive.is and Mountain Guides handled with headless Chromium — simulating date selection to capture dynamically rendered slot pricing and availability before extraction.

Multi-layer pricing extractor: For Reykjavik Excursions and Arctic Adventures, a structured pricing parser captures all pricing variants (base, early-bird, group, add-on) per tour per departure date in a single extraction pass.

End-to-end weekly extraction pipeline — source to FTP

7 OTA Sources

Public websites — no login

→

Extraction Engine

Per-platform parsers + headless browser

→

270-Day Crawler

Rolling calendar — all dates per tour

→

Normalisation

7 schemas → 1 unified JSON

→

Validation

All mandatory fields verified

→

JSON Output

Structured, typed, nested

→

FTP Delivery

Client FTP — Monday 6am UTC

Week 1 execution timeline — scoping to delivery

Weekly JSON delivery — format, structure and FTP specification

Output Format — JSON

One JSON file per platform per weekly run

Nested structure: platform → tour → date → pricing

All fields typed — string, integer, boolean, array

ISO 8601 timestamps throughout

UTF-8 encoding — supports Icelandic characters (þ, ð, æ, ö)

File naming: {platform}_{YYYYMMDD}.json

Delivery Mode — FTP

Delivered to client-specified FTP endpoint

Folder structure: /iceland-ota/{YYYY-WW}/

Delivery window: Monday 06:00–08:00 UTC

Confirmation email after each successful push

3 automated retry attempts on FTP push failure

12 weeks of prior deliveries archived

Frequency — Weekly Full Refresh

Full re-extraction of all 7 platforms every week

270-day forward window recalculated from each Monday

Full dataset every run — no incremental / delta only

Avg extraction duration: 4.5 hours (all 7 platforms)

Extraction window: Sunday 23:00 → Monday 05:00 UTC

Manual re-run available on request — same-day

Quality Assurance

Field-level validation — no partial records delivered

Record count check vs prior week — >10% drop triggers alert

Price range sanity check per platform — anomaly detection

Availability status cross-check across tour dates

Schema version control — field changes notified 2 weeks ahead

QA report available on request per delivery

What the client achieved with weekly Iceland OTA data

The structured weekly dataset enabled the client's business intelligence team to build pricing models, competitive dashboards and demand forecasting tools that were not possible before consistent, normalised data from all 7 platforms was available in one place.

48hr

From scoping to first FTP delivery — all 7 platforms, 270-day forward window

14,800+

Tour-date records extracted per weekly run across all 7 Iceland OTA platforms

100%

Mandatory field coverage — every delivered record fully populated, no partial records

270 days

Forward pricing and availability visibility — rolling, refreshed every Monday

52 weeks

Continuous delivery — zero missed weekly extractions across 12 months of operation

7 / 7

All target platforms delivering at 100% — no platform-level extraction failures