A Metadata Platform for the Modern Data Stack | DataHub

about 500~20000

427

Everything goes well. Rich and Noble Ji

3

185.199.108.153

AMetadataPlatformfortheModernDataStack|DataHubSkiptomA Metadata Platform for the Modern Data Stack | DataHubaincontentAcrylDataHub AcrylDatadeliversaneasytoconsumeDataHubplatformfortheenterpriseSignUpforAcrylDataHub →NextNext0.13.1Archivedversions0.13.00.12.10.11.00.10.5DocsIntegrationsCommunityJoinSlackCommunityForumEventsChampionsResourcesDemoBlogRoadmapGitHubYouTubeCaseStudiesDataHubBasicsSearchThe#1OpenSourceMetadataPlatformDataHubisanextensibledatacatalogthatenablesdatadiscovery,dataobservabilityandfederatedgovernancetohelptamethecomplexityofyourdataecosystem.Builtwith❤️byAcrylDataandLinkedIn.GetStarted→JoinourSlackJoinMayTownhall!✨DataMeshDataProducts,Delivered DataContractsDataContracts:End-to-endReliabilityinData ShiftLeftDataGovernanceandLineeImpactAnalysis GetStartedNowRunthefollowingcommandtogetstartedwithDataHub.python3-mpipinstall--upgradepipwheelsetuptoolspython3-mpipinstall--upgradeacryl-datahubdatahubdockerquickstartDataHubQuickstartGuideDeployingWithKubernetesLearnWhatisDataHub?HowisDataHubarchitected?SeeDataHubinactionMetadata360Combinetechnical,operationalandbusinessmetadatatoprovidea360degreeviewofyourdataentities.Shift-leftApply“shift-left”practicestopre-enrichimportantmetadatausingingestiontransformers,supportfordbtmeta-mappingandotherfeaturesA Metadata Platform for the Modern Data Stack | DataHub.ActiveMetadataActonchangesinmetadatainrealtimebynotifyingkeystakeholders,circuit-breakingbusiness-critcalpipelines,propogatingmetadataacrossentites,andmore.OpenSourceDataHubwasoriginallybuiltatLinkedInandsubsequentlyopen-sourcedundertheApache2.0License.Itnowhasathrivingcommunitywithoverahundredcontributors,andiswidelyusedatmanycompanies.ForwardLookingArchitectureDataHubfollowsapush-basedarchitecture,whichmeansitx27;sbuiltforcontinuouslychangingmetadata.Themodulardesignletsitscalewithdatagrowthatanyorganization,fromasingledatabaseunderyourdesktomultipledatacentersspanningtheglobe.MassiveEcosystemDataHubhaspre-builtintegrationswithyourforitesystems:Kafka,Airflow,MySQL,SQLServer,Postgres,LDAP,Snowflake,Hive,BigQuery,andmanyothers.Thecommunityiscontinuouslyaddingmoreintegrations,sothislistkeepsgettinglongerandlonger.TheOriginsofDataHubExploreDataHubx27;sjourneyfromsearchanddatadiscoverytoolatLinkedIntothe#1opensourcemetadatamanementplatform,throughthelensofitsfounderandsomeamazingcommunitymembers.AModernApproachtoMetadataManementAutomatedMetadataIngestionPush-basedingestioncanuseaprebuiltemitterorcanemitcustomeventsusingourframework.Pull-basedingestioncrawlsametadatasource.WeheprebuiltintegrationswithKafka,MySQL,MSSQL,Postgres,LDAP,Snowflake,Hive,BigQuery,andmore.IngestioncanbeautomatedusingourAirflowintegrationoranotherschedulerofchoice.LearnmoreaboutmetadataingestionwithDataHubinthedocs.recipe.ymlsource:type:"mysql"config:username:"datahub"password:"datahub"host_port:"localhost:3306"sink:type:"datahub-rest"config:server:x27;httplocalhost:8080x27;datahubingest-crecipe.ymlDiscoverTrustedDataBrowseandsearchoveracontinuouslyupdatedcatalogofdatasets,dashboards,charts,MLmodels,andmore.UnderstandDatainContextDataHubistheone-stopshopfordocumentation,schemas,ownership,datalinee,pipelines,dataquality,useinformation,andmore.TrustedAcrosstheIndustryB2B&B2CFinancial&FintechE-CommerceAndMore“[DataHub]hasmadeourlegalteamveryhappywithbeingabletokeeptrackofoursensitivedata[toanswerquestionslike]Where’sitgoing?How’sitbeingA Metadata Platform for the Modern Data Stack | DataHubprocessed?Where’sitendingup?WhichthirdpartytoolorAPI’sarewesendingittoandwhy?Whoisresponsibleforthisintegration?”“DataHubalignswithourneeds[for]datadocumentation,aunifiedsearchexperience,lineeinformation,andadditionalmetadata.Wearealsoveryimpressedwiththevibrantandsupportivecommunity.”“DataHuballowsustosolvethedatadiscoveryproblem,whichwasabigchallengeinourorganization,andnowwearesolvingit.”AskAIDocsIntroductionQuickstartCommunitySlackYouTubeBlogTownHallsAdoptionMoreDemoRoadmapContributingGitHubFeatureRequests©2015-2024DataHubProjectAuthors.