examples

Examples

This folder contains examples to use and extend FishStore for data ingestion and PSF queries (record retrieval). This is a quick start manual to run them on your own computer.

Datasets

There are several public dataset available online you can use to try out FishStore. In our examples, we the following data sets:

• Github Archive: A project to record the public GitHub timeline, archive it, and make it easily accessible for further analysis.
• Twitter: You can crawl twitter data using its developer API. Here is a open source crawler you can use.

You can download them by yourself and use them as test data of our examples.

Roadmap

We provided examples PSF libraries and FishStore usage on different applications.

• PSF Library Examples
• Github Archive Example
• Twitter Example
• Checkpointing and Recovery Example
• Online CLI Demo