cosmos

Prop 155: Spacebox - Tool for chain Indexation and Storage in the Cosmos Hub

Forum discussion

Full proposal text in IPFS

Introduction

As the Cosmos ecosystem expands and evolves, the requirement for efficient and reliable data management solutions within the Cosmos Hub becomes increasingly essential. Bro_n_Bro have expertise in working with indexers in the ecosystem and comprehending their utilization in building advanced applications. Despite the popularity of existing indexers for monitoring purposes, they lack the necessary flexibility and user experience for developers and users. As more blockchains emerge, the need for more data storage becomes imperative. Although improving storage and data access at the SDK level would be ideal, for now, a separate indexer remains the best solution for quick access to data.

To address this requirement, we propose developing a comprehensive set of open-source tools for data indexation and storage, utilizing the cutting-edge technology of ClickHouse as the foundation for the storage facility. This approach will provide quick access to large data sets and ensure a stable architecture that guarantees data consistency and enables a lightweight setup. This will foster the creation of more sophisticated user experience and analytics applications within the Cosmos Hub and across the entire Cosmos ecosystem.

Scope of Work

  • Utilizing ClickHouse as the storage facility to provide quick access to large data sets
  • Developing a stable architecture that guarantees data consistency
  • An easily deployable setup that will enable the development of more user-experience and analytics applications in the Cosmos Hub and the entire Cosmos ecosystem
  • Providing dev documentation, contribution, and setup guides to assist in the understanding and execution of the project

Description

We formed the proposed architecture for the mean of scalability and data consistency.

To achieve named purposes process of crawling and writing to DB are separated into different microservices:

All services are packed into the docker to simplify deployment. The main repo contains a ready-to-use docker-compose file and deployment documentation.

All the services mentioned above are in the pre-Alpha version and should not be considered a final product.

Funding

Amount: 7500 ATOM

Recipient: cosmos106yp7zw35wftheyyv9f9pe69t8rteumjxjql7m

Development has been started already, but to finalize it, we are requesting the support of the Cosmos Hub community. 7500 ATOMs would be enough to cover the costs of development and implementation of the Indexer that supports current Cosmos-SDK and IBC modules

The proposed project will take:

soft date - 3 months

hard date - 6 months

Conclusion

Today most cosmos applications are built either on raw chain data directly from API or based on closed-source indexators. Having open-sourced robust solution with easy and fast data access may drive great new applications development and improve whole ecosystem growth.

Whoami

Bro_n_Bro has been presented in the Cosmos ecosystem for almost two years as an independent community-driven validator in 12 chains. The team behind it has been developing in Cosmos for nearly six years.

More info about Bro_n_Bro is available at:

Voting

  • YES - by voting ‘Yes’ on this proposal, you indicate support for funding the creation of Space-box services
  • NO - by voting ‘No’ on this proposal, you do not support this proposal in its current form - please kindly indicate why by leaving comments in the Cosmos Forum.
  • NO WITH VETO - A ‘NoWithVeto’ vote indicates a proposal either (1) is deemed to be spam, i.e., irrelevant to Cosmos Hub, (2) disproportionately infringes on minority interests, or (3) violates or encourages violation of the rules of engagement as currently set out by Cosmos Hub governance. If the number of ‘NoWithVeto’ votes is greater than a third of the total votes, the proposal is rejected, and the deposits are burned.
  • ABSTAIN - You wish to contribute to the quorum but formally decline to vote either for or against the proposal.