WILMINGTON, DE — The Apache Software Foundation (ASF) has announced that two promising projects, Apache Gravitino and Apache StormCrawler, have officially graduated from incubation and are now recognized as Top-Level Projects (TLP). This milestone underscores the maturity, stability, and vibrant community engagement surrounding these initiatives, further cementing ASF’s role as a hub for cutting-edge open source innovation.
Apache Gravitino: Transforming Metadata Management
Apache Gravitino has emerged as a game-changer in metadata management, offering a high-performance, open source metastore that unifies metadata across a range of systems, including data warehouses, data lakes, lakehouses, streaming platforms, and AI clusters. Designed with a centralized and flexible architecture, Gravitino eliminates the challenges of managing data silos, enabling organizations to streamline data discovery, governance, and infrastructure operations.
Its robust support for popular ecosystems like Apache Iceberg, Apache Hive, Apache Kafka, MySQL, and PostgreSQL enables widespread adoption and seamless integration into existing workflows. Gravitino’s unified metadata layer empowers enterprises to scale intelligent data governance and lakehouse federation for both current and emerging needs.
“Gravitino is uniquely designed to bridge data and AI workloads. We’re excited to deploy it across our multi-cloud AI clusters and contribute to many prioritized AI and agent-based use cases,” said Jack Song, Director of Uber Data Platform. “Gravitino’s graduation marks its maturity entering the next level, backed by a thriving and engaged community.”
Apache StormCrawler: Powering Next-Generation Web Crawlers
Apache StormCrawler, now a TLP, offers developers a scalable, low-latency software development kit (SDK) for building custom web crawlers. Written largely in Java and powered by Apache Storm®, StormCrawler is ideal for applications where URLs are continuously streamed or for large-scale, recursive web crawling, especially when rapid response times are required.
The project includes reusable components and resources that facilitate customization and efficient data processing. With its flexible design, StormCrawler is particularly suited for dynamic web environments that require real-time adaptability.
“Becoming an Apache Software Foundation Top-Level Project is a significant milestone for an open source community, and we are extremely proud of the accomplishment,” said Julien Nioche, member of the Apache StormCrawler Project Management Committee (PMC). “We are eager to see how the StormCrawler community continues to grow, collaborate, and innovate as a TLP.”
Broader Implications for the Open Source Ecosystem
The graduation of Gravitino and StormCrawler marks a deepening of the Apache Software Foundation’s commitment to fostering innovative, reliable, and impactful open source projects. The achievement also highlights the value of ASF’s incubation program, which provides early-stage projects with the organizational structure, mentorship, and community-building tools necessary for their growth.
For enterprises and developers, the elevation of these projects means greater confidence in their capabilities and longevity. Gravitino’s emphasis on metadata unification and AI readiness addresses a growing need for scalable data governance solutions, while StormCrawler’s real-time crawling capabilities enable faster deployment of cutting-edge web applications.
Both projects are poised to play significant roles in advancing their respective fields, demonstrating the enduring potential of open source collaboration. With thriving communities and expanding adoption, Apache Gravitino and Apache StormCrawler pave the way for new opportunities across industries.
Their elevation to TLP status signals not only their technical maturity but also their alignment with ASF’s mission to deliver world-class, community-driven software that empowers developers and organizations globally.
For the latest news on everything happening in Chester County and the surrounding area, be sure to follow MyChesCo on Google News and MSN.