Report Name

Blockchain Analytics and Data Pipelines - Report 2

Reporting Period

July 23 - August 20 (29 days)

Report Description

The first beta release of ICON-ETL is out, with the basic blockchain data exporters providing blocks, transactions, and transaction-related information. Integration with Airflow has begun with the exporter correctly batching export jobs. It should be noted, however, that a recent change to the ICON RPC Server (as part of the 1.5.0 release) has broken our ability to send batch requests to any ICON node and is impeding our ability to progress further on the non-infrastructure related aspects of this project. An issue has been filed on GitHub and we are awaiting a fix. Work on deployments for the analysis platforms has progressed with Airflow and supporting databases being almost ready for normal use.

Project Completion Percentage

60%

Remaining Time to Completion

3.5 weeks, after ICON RPC server bug is fixed

Expected Results for the Next Period

Providing the ICON RPC Server bug is fixed in short order, the analysis platform will be ready to run the analyses requested by the Foundation and the Community. Repositories for the infrastructure deployments required to run the analysis platform will be complete, and the required code to deploy the ETL DAGs will be ready.

Materials Proving Progress on the Project

• icon-etl
  • https://github.com/insight-icon/icon-etl
  • https://pypi.org/project/icon-etl/
• icon-etl-airflow
  • https://github.com/insight-icon/icon-etl-airflow
• Infrastructure
  • https://github.com/insight-infrastructure/terraform-aws-ec2-airflow
  • https://github.com/insight-infrastructure/terraform-aws-superset

Review of each KPI (Key Performance Indicator) or specific goal/milestone

Phase 1: Metrics High Grading (80%)

Milestones:

• Canvass community and foundation for a high grading of metrics to be collected (completed)