Skip to content

Function would convert from avro/parquet/csv/json to avro/parquet/csv/json #6

@luminousmen

Description

@luminousmen

As part of the tool, we need to develop a versatile data conversion functionality. As a result, the tool should be capable of converting data between various formats, including Avro, Parquet, CSV, and JSON. The goal is to provide a seamless and efficient way to transform data from one format to another to support our diverse data sources and consumption needs.

AC:

Create a data conversion library that supports the following conversions:

  1. From Avro to Parquet
  2. From Avro to CSV
  3. From Avro to JSON
  4. From Parquet to Avro
  5. From Parquet to CSV
  6. From Parquet to JSON
  7. From CSV to Avro
  8. From CSV to Parquet
  9. From CSV to JSON
  10. From JSON to Avro
  11. From JSON to Parquet
  12. From JSON to CSV
  • It should support existing data sample files from the tests/data directory
  • Write unit and integration tests to validate the correctness of the function.
  • Integrate the function into the interface
  • Ensure the function is easy to use with a clear and well-documented API.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions