> For the complete documentation index, see [llms.txt](https://knowledgebase.fabricdata.com/insights/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://knowledgebase.fabricdata.com/insights/data-hub/getting-started.md).

# Getting started

The **S3 Data Hub** is the delivery of Origin Insights' modeled datasets over S3-compatible object storage — **Amazon S3** or **DigitalOcean Spaces** (S3 technology) — in **JSONL** (JSON Lines) format, ready for analytical consumption at scale (Athena, Spark, Redshift Spectrum, Snowflake, Databricks, etc.).

Unlike the app — built for interactive consultation — the S3 Data Hub is built for **data-level integration**: load the datasets into the client's data lake or warehouse and join them with their own sources.

## What it delivers

The data exposed is **clean, normalized, and modeled**: deduplicated, typed, with **UID** and partitioned by date/country. It's the recommended integration point for data teams that want processed data but the freedom to build their own aggregations and business views.

| Surface                 | Purpose                                                 | Consumption form |
| ----------------------- | ------------------------------------------------------- | ---------------- |
| **Origin Insights app** | Visual analysis, dashboards, and per-client views.      | Interactive      |
| **Data Hub**            | Bulk integration into the client's data lake/warehouse. | JSONL on S3      |

## Features

* **Format:** JSONL (JSON Lines), segmented by prefix.
* **Universal identifier:** every content record carries Fabric's **UID, Global ID and Country** for cross-dataset joins.
* **Coverage:** the universe described in [Data coverage](/insights/origin-insights-dashboards/general-reference/data-coverage.md).
* **Updates:** depending on the dataset (daily, weekly, monthly). See [Update frequency](/insights/origin-insights-dashboards/general-reference/frequency.md).
* **Access:** via **AWS Marketplace** (Amazon S3) or S3-compatible credentials (DigitalOcean Spaces). See [Data access](/insights/data-hub/data-access.md).

## Available datasets

The S3 Data Hub datasets correspond to the [data families](/insights/origin-insights-dashboards/data-families.md). The main ones:

| Dataset                 | Family                  | Description                                                   |
| ----------------------- | ----------------------- | ------------------------------------------------------------- |
| Content Presence        | Streaming Availability  | Content presence by platform×country, with validity and gaps. |
| Content Metadata        | Identifiers & Metadata  | Normalized metadata (cast, genres, synopsis, external IDs).   |
| Prices, Plans & Bundles | Prices, Plans & Bundles | Plans, offers, bundles, and historical prices.                |
| Demand / Hits           | Hits (DEMAND)           | Demand and popularity scores.                                 |
| Top Ten                 | Top Ten                 | Weekly rankings by platform.                                  |
| Awards                  | Awards                  | Awards and nominations by title.                              |

## How to get started

1. [Data access](/insights/data-hub/data-access.md) — Amazon S3 (AWS Marketplace) or DigitalOcean Spaces.
2. [Structure and files](/insights/data-hub/structure-and-files.md) — how the bucket is organized.
3. [Schemas by dataset](/insights/data-hub/schemas-by-dataset.md) — columns and types.
4. [Consumption best practices](/insights/data-hub/consumption-best-practices.md) — how to query efficiently.

***

<details>

<summary>Related Articles</summary>

* [Data access](/insights/data-hub/data-access.md)
* [Structure and files](/insights/data-hub/structure-and-files.md)
* [Schemas by dataset](/insights/data-hub/schemas-by-dataset.md)

</details>

> We hope you found this article helpful. If you have a question this article doesn't address, reach out on the [Service Desk](https://fabric.atlassian.net/servicedesk/customer/portal/336).


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://knowledgebase.fabricdata.com/insights/data-hub/getting-started.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.