Skip to content

murdo-moj/datahub

This branch is 513 commits behind datahub-project/datahub:master.

Folders and files

NameName
Last commit message
Last commit date
Oct 23, 2024
Oct 4, 2024
Apr 13, 2023
Oct 28, 2024
Nov 1, 2024
Jul 9, 2021
Oct 31, 2024
Oct 30, 2024
Oct 28, 2024
Oct 31, 2024
Nov 1, 2024
Oct 30, 2024
Dec 28, 2023
Apr 16, 2024
Oct 24, 2024
Oct 7, 2024
Sep 12, 2024
Sep 4, 2024
Oct 24, 2024
Oct 31, 2024
Oct 31, 2024
Oct 30, 2024
Oct 30, 2024
Oct 16, 2024
Dec 15, 2023
Oct 24, 2024
Oct 22, 2024
Oct 31, 2024
Oct 22, 2024
Apr 15, 2024
Aug 25, 2023
Oct 30, 2024
Sep 17, 2024
Feb 26, 2024
Apr 5, 2022
Jun 11, 2024
Aug 3, 2023
Dec 1, 2020
Nov 19, 2015
Aug 26, 2020
Sep 5, 2024
Nov 13, 2023
Oct 28, 2024
Sep 23, 2024
Dec 28, 2023
Sep 2, 2023
Sep 12, 2024
Nov 28, 2023
Aug 29, 2024
Mar 26, 2024

Repository files navigation

DataHub

DataHub: The Data Discovery Platform for the Modern Data Stack

Built with ❤️ by Acryl Data and LinkedIn

Version PyPI version build & test Docker Pulls Slack PRs Welcome GitHub commit activity License YouTube Medium Follow

🏠 Hosted DataHub Docs (Courtesy of Acryl Data): datahubproject.io


Quickstart | Features | Roadmap | Adoption | Demo | Town Hall


📣 DataHub Town Hall is the 4th Thursday at 9am US PT of every month - add it to your calendar!

✨ DataHub Community Highlights:

Introduction

DataHub is an open-source data catalog for the modern data stack. Read about the architectures of different metadata systems and why DataHub excels here. Also read our LinkedIn Engineering blog post, check out our Strata presentation and watch our Crunch Conference Talk. You should also visit DataHub Architecture to get a better understanding of how DataHub is implemented.

Features & Roadmap

Check out DataHub's Features & Roadmap.

Demo and Screenshots

There's a hosted demo environment courtesy of Acryl Data where you can explore DataHub without installing it locally

Quickstart

Please follow the DataHub Quickstart Guide to get a copy of DataHub up & running locally using Docker. As the guide assumes some basic knowledge of Docker, we'd recommend you to go through the "Hello World" example of A Docker Tutorial for Beginners if Docker is completely foreign to you.

Development

If you're looking to build & modify datahub please take a look at our Development Guide.

Source Code and Repositories

  • datahub-project/datahub: This repository contains the complete source code for DataHub's metadata model, metadata services, integration connectors and the web application.
  • acryldata/datahub-actions: DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.
  • acryldata/datahub-helm: Repository of helm charts for deploying DataHub on a Kubernetes cluster
  • acryldata/meta-world: A repository to store recipes, custom sources, transformations and other things to make your DataHub experience magical
  • dbt-impact-action : This repository contains a github action for commenting on your PRs with a summary of the impact of changes within a dbt project
  • datahub-tools : Additional python tools to interact with the DataHub GraphQL endpoints, built by Notion
  • business-glossary-sync-action : This repository contains a github action that opens PRs to update your business glossary yaml file.

Releases

See Releases page for more details. We follow the SemVer Specification when versioning the releases and adopt the Keep a Changelog convention for the changelog format.

Contributing

We welcome contributions from the community. Please refer to our Contributing Guidelines for more details. We also have a contrib directory for incubating experimental features.

Community

Join our Slack workspace for discussions and important announcements. You can also find out more about our upcoming town hall meetings and view past recordings.

Security

See Security Stance for information on DataHub's Security.

Adoption

Here are the companies that have officially adopted DataHub. Please feel free to add yours to the list if we missed it.

Select Articles & Talks

See the full list here.

License

Apache License 2.0.

About

The Metadata Platform for your Data Stack

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 46.4%
  • Python 34.5%
  • TypeScript 15.6%
  • JavaScript 1.9%
  • SCSS 0.7%
  • Shell 0.3%
  • Other 0.6%