Add Initial Hudi Codebase for Qbeast-Spark

[JosepSampe]

Introduce the foundational classes and code structure required to support the Hudi table format in the Qbeast-Spark project. This pull request will focus solely on adding the main Qbeast-Spark classes for the integration, laying the groundwork for further development.

Tasks:

• Implement Core Classes:
  • MetadataManager: Handles metadata operations specific to the Hudi integration. Log manager
  • QbeastSnapshot: Manages snapshots of indexed datasets.
  • DataWriter: Responsible for writing data into Qbeast-indexed Hudi tables.

Code Structure:

• Add the qbeastHudi module under the project structure.
  • Ensure the classes align with existing Qbeast-Core interfaces and abstractions.
• Add Basic Unit Tests:
  • Provide unit tests for each of the new classes to ensure they compile and execute expected operations in isolation.

Implementation Details:

• Dependencies: Include necessary Hudi dependencies in the build system.
• Design Patterns: Follow the design patterns and conventions already established in Qbeast-Spark.
• Placeholder Functions: If applicable, stub methods that will be implemented in subsequent PRs