> For the complete documentation index, see [llms.txt](https://knowledgebase.fabricdata.com/insights/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://knowledgebase.fabricdata.com/insights/data-hub/getting-started.md).

# Getting started

The **S3 Data Hub** is the delivery of Origin Insights' modeled datasets over S3-compatible object storage — **Amazon S3** or **DigitalOcean Spaces** (S3 technology) — in **JSONL** (JSON Lines) format, ready for analytical consumption at scale (Athena, Spark, Redshift Spectrum, Snowflake, Databricks, etc.).

Unlike the app — built for interactive consultation — the S3 Data Hub is built for **data-level integration**: load the datasets into the client's data lake or warehouse and join them with their own sources.

## What it delivers

The data exposed is **clean, normalized, and modeled**: deduplicated, typed, with **UID** and partitioned by date/country. It's the recommended integration point for data teams that want processed data but the freedom to build their own aggregations and business views.

| Surface                 | Purpose                                                 | Consumption form |
| ----------------------- | ------------------------------------------------------- | ---------------- |
| **Origin Insights app** | Visual analysis, dashboards, and per-client views.      | Interactive      |
| **Data Hub**            | Bulk integration into the client's data lake/warehouse. | JSONL on S3      |

## Features

* **Format:** JSONL (JSON Lines), segmented by prefix.
* **Universal identifier:** every content record carries Fabric's **UID, Global ID and Country** for cross-dataset joins.
* **Coverage:** the universe described in [Data coverage](/insights/origin-insights-dashboards/general-reference/data-coverage.md).
* **Updates:** depending on the dataset (daily, weekly, monthly). See [Update frequency](/insights/origin-insights-dashboards/general-reference/frequency.md).
* **Access:** via **AWS Marketplace** (Amazon S3) or S3-compatible credentials (DigitalOcean Spaces). See [Data access](/insights/data-hub/data-access.md).

## Available datasets

The S3 Data Hub datasets correspond to the [data families](/insights/origin-insights-dashboards/data-families.md). The main ones:

| Dataset                 | Family                  | Description                                                   |
| ----------------------- | ----------------------- | ------------------------------------------------------------- |
| Content Presence        | Streaming Availability  | Content presence by platform×country, with validity and gaps. |
| Content Metadata        | Identifiers & Metadata  | Normalized metadata (cast, genres, synopsis, external IDs).   |
| Prices, Plans & Bundles | Prices, Plans & Bundles | Plans, offers, bundles, and historical prices.                |
| Demand / Hits           | Hits (DEMAND)           | Demand and popularity scores.                                 |
| Top Ten                 | Top Ten                 | Weekly rankings by platform.                                  |
| Awards                  | Awards                  | Awards and nominations by title.                              |

## How to get started

1. [Data access](/insights/data-hub/data-access.md) — Amazon S3 (AWS Marketplace) or DigitalOcean Spaces.
2. [Structure and files](/insights/data-hub/structure-and-files.md) — how the bucket is organized.
3. [Schemas by dataset](/insights/data-hub/schemas-by-dataset.md) — columns and types.
4. [Consumption best practices](/insights/data-hub/consumption-best-practices.md) — how to query efficiently.

***

<details>

<summary>Related Articles</summary>

* [Data access](/insights/data-hub/data-access.md)
* [Structure and files](/insights/data-hub/structure-and-files.md)
* [Schemas by dataset](/insights/data-hub/schemas-by-dataset.md)

</details>

> We hope you found this article helpful. If you have a question this article doesn't address, reach out on the [Service Desk](https://fabric.atlassian.net/servicedesk/customer/portal/336).