How We Scaled Catalog Ingestion to Hundreds of Thousands of Entities
CNCF [Cloud Native Computing Foundation] via YouTube
AI, Data Science & Cloud Certificates from Google, IBM & Meta
PowerBI Data Analyst - Create visualizations and dashboards from scratch
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore a technical presentation that delves into HP Inc.'s innovative approach to scaling catalog ingestion for hundreds of thousands of entities in Backstage. Learn about the challenges faced when ingesting over 100,000 entities from a data source and discover the solutions implemented through careful planning, properly scaled computing resources, and clever customization. Gain insights into extending basic Entity Provider and Catalog Processor functionality for large-scale enterprise use. Understand the scope of the technical challenge, including the various types of entities and data sources utilized by HP Inc. Dive deep into the intricacies of their entity ingestion process, exploring the extended features of the base Entity Provider mechanism that enable handling of extremely large datasets. Examine important considerations such as entity validation and relations in this comprehensive overview of scaling Backstage for enterprise-level catalog ingestion.
Syllabus
How We Scaled Catalog Ingestion to Hundreds of Thousands of Entities - Damon Kaswell, HP Inc.
Taught by
CNCF [Cloud Native Computing Foundation]