Metadata-Version: 2.4
Name: acryl-datahub-dagster-plugin
Version: 1.6.0.10rc2
Summary: DataHub Dagster plugin — automatically capture asset lineage, run history, and job metadata from Dagster pipelines
Home-page: https://datahub.com/
License: Apache-2.0
Project-URL: Documentation, https://docs.datahub.com/
Project-URL: Source, https://github.com/datahub-project/datahub
Project-URL: Changelog, https://github.com/acryldata/datahub/releases
Project-URL: Releases, https://github.com/acryldata/datahub/releases
Classifier: Development Status :: 5 - Production/Stable
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Information Technology
Classifier: Intended Audience :: System Administrators
Classifier: Operating System :: Unix
Classifier: Operating System :: POSIX :: Linux
Classifier: Environment :: Console
Classifier: Environment :: MacOS X
Classifier: Topic :: Software Development
Requires-Python: >=3.10
Description-Content-Type: text/markdown
Requires-Dist: dagster>=1.10.0
Requires-Dist: dagit>=1.10.0
Requires-Dist: acryl-datahub[datahub-rest,sql-parser]==1.6.0.10rc2
Provides-Extra: ignore
Provides-Extra: dev
Requires-Dist: types-click==0.1.12; extra == "dev"
Requires-Dist: types-six; extra == "dev"
Requires-Dist: types-cachetools; extra == "dev"
Requires-Dist: types-pytz; extra == "dev"
Requires-Dist: sqlalchemy-stubs; extra == "dev"
Requires-Dist: tox; extra == "dev"
Requires-Dist: dagster-aws>=0.11.0; extra == "dev"
Requires-Dist: pytest>=6.2.2; extra == "dev"
Requires-Dist: pytest-cov>=2.8.1; extra == "dev"
Requires-Dist: dagster>=1.10.0; extra == "dev"
Requires-Dist: dagster-snowflake>=0.11.0; extra == "dev"
Requires-Dist: types-toml; extra == "dev"
Requires-Dist: mypy==1.17.1; extra == "dev"
Requires-Dist: types-setuptools; extra == "dev"
Requires-Dist: deepdiff!=8.0.0; extra == "dev"
Requires-Dist: types-dataclasses; extra == "dev"
Requires-Dist: types-tabulate; extra == "dev"
Requires-Dist: pytest-asyncio>=0.16.0; extra == "dev"
Requires-Dist: types-python-dateutil; extra == "dev"
Requires-Dist: types-freezegun; extra == "dev"
Requires-Dist: packaging; extra == "dev"
Requires-Dist: acryl-datahub[datahub-rest,sql-parser]==1.6.0.10rc2; extra == "dev"
Requires-Dist: types-requests; extra == "dev"
Requires-Dist: dagster-snowflake-pandas>=0.11.0; extra == "dev"
Requires-Dist: jsonpickle; extra == "dev"
Requires-Dist: build; extra == "dev"
Requires-Dist: types-PyYAML; extra == "dev"
Requires-Dist: freezegun; extra == "dev"
Requires-Dist: dagit>=1.10.0; extra == "dev"
Requires-Dist: requests-mock; extra == "dev"
Requires-Dist: coverage>=5.1; extra == "dev"
Requires-Dist: pydantic!=1.10.3,>=1.10.0; extra == "dev"
Requires-Dist: twine; extra == "dev"
Requires-Dist: ruff==0.11.7; extra == "dev"
Provides-Extra: integration-tests
Requires-Dist: types-click==0.1.12; extra == "integration-tests"
Requires-Dist: types-six; extra == "integration-tests"
Requires-Dist: types-cachetools; extra == "integration-tests"
Requires-Dist: types-pytz; extra == "integration-tests"
Requires-Dist: sqlalchemy-stubs; extra == "integration-tests"
Requires-Dist: tox; extra == "integration-tests"
Requires-Dist: dagster-aws>=0.11.0; extra == "integration-tests"
Requires-Dist: pytest>=6.2.2; extra == "integration-tests"
Requires-Dist: pytest-cov>=2.8.1; extra == "integration-tests"
Requires-Dist: dagster>=1.10.0; extra == "integration-tests"
Requires-Dist: dagster-snowflake>=0.11.0; extra == "integration-tests"
Requires-Dist: types-toml; extra == "integration-tests"
Requires-Dist: mypy==1.17.1; extra == "integration-tests"
Requires-Dist: types-setuptools; extra == "integration-tests"
Requires-Dist: deepdiff!=8.0.0; extra == "integration-tests"
Requires-Dist: types-dataclasses; extra == "integration-tests"
Requires-Dist: types-tabulate; extra == "integration-tests"
Requires-Dist: pytest-asyncio>=0.16.0; extra == "integration-tests"
Requires-Dist: types-python-dateutil; extra == "integration-tests"
Requires-Dist: types-freezegun; extra == "integration-tests"
Requires-Dist: packaging; extra == "integration-tests"
Requires-Dist: acryl-datahub[datahub-rest,sql-parser]==1.6.0.10rc2; extra == "integration-tests"
Requires-Dist: types-requests; extra == "integration-tests"
Requires-Dist: dagster-snowflake-pandas>=0.11.0; extra == "integration-tests"
Requires-Dist: jsonpickle; extra == "integration-tests"
Requires-Dist: build; extra == "integration-tests"
Requires-Dist: types-PyYAML; extra == "integration-tests"
Requires-Dist: freezegun; extra == "integration-tests"
Requires-Dist: dagit>=1.10.0; extra == "integration-tests"
Requires-Dist: requests-mock; extra == "integration-tests"
Requires-Dist: coverage>=5.1; extra == "integration-tests"
Requires-Dist: pydantic!=1.10.3,>=1.10.0; extra == "integration-tests"
Requires-Dist: twine; extra == "integration-tests"
Requires-Dist: ruff==0.11.7; extra == "integration-tests"
Dynamic: classifier
Dynamic: description
Dynamic: description-content-type
Dynamic: home-page
Dynamic: license
Dynamic: project-url
Dynamic: provides-extra
Dynamic: requires-dist
Dynamic: requires-python
Dynamic: summary

<!-- PyPI long description. Keep concise, feature-discovery-first. -->

# DataHub Dagster Plugin

**Automatic lineage and run metadata from Dagster into DataHub** — captures asset definitions, job runs, and dataset-level lineage with no manual instrumentation.

## What you can do

- **Capture asset lineage** — automatically extract upstream/downstream relationships between Dagster assets and external datasets
- **Track run history** — record job execution status and task-level outcomes in DataHub
- **Map Dagster assets to DataHub entities** — assets appear as datasets in your DataHub catalog
- **Works with any DataHub deployment** — self-hosted or DataHub Cloud

## Installation

```bash
pip install acryl-datahub-dagster-plugin
```

## Quickstart

Add the DataHub sensor to your Dagster project:

```python
from datahub.ingestion.graph.config import DatahubClientConfig
from datahub_dagster_plugin.sensors.datahub_sensors import (
    DatahubDagsterSourceConfig,
    make_datahub_sensor,
)

config = DatahubDagsterSourceConfig(
    datahub_client_config=DatahubClientConfig(server="http://localhost:8080"),
    dagster_url="http://localhost:3000",
)
datahub_sensor = make_datahub_sensor(config=config)
```

Register it alongside your jobs and assets in your `Definitions`:

```python
from dagster import Definitions

defs = Definitions(
    assets=[...],
    jobs=[...],
    sensors=[datahub_sensor],
)
```

Once the sensor is running, every job run will emit lineage and status metadata to DataHub automatically.

## Links

- [Full documentation](https://docs.datahub.com/docs/lineage/dagster)
- [Dagster](https://dagster.io/)
- [GitHub](https://github.com/datahub-project/datahub)
- [Slack community](https://datahub.com/slack)
