IoTeX Completes Integration with Google BigQuery
We are excited to announce a new integration with BigQuery to make data from the IoTeX blockchain available to Google Cloud users. IoTeX data will be hosted and updated in real-time by Google Cloud as a publicly available dataset, which is now listed on the GCP Marketplace.
While many projects, including IoTeX, explore how to bring data from the real world to the blockchain world, it is also important to consider: how can data from the blockchain world be used in the real world? Unlike other blockchains, IoTeX is focused on enabling verifiable data from verifiable devices for verifiable trust. In the future, one can imagine that IoTeX’s on-chain data will represent a vast number of interconnected human-machine identities that engage in a peer-to-peer fashion; a first-of-its-kind decentralized ecosystem where historical data regarding its formation and growth can be verified, trusted, and thus utilized by developers and researchers of all varieties. We look forward to these exciting possibilities as our ecosystem grows.
Thank you to Allen Day and the Google Cloud team, as well as Blockchain ETL & Helix Technologies, who received a Halo grant in July to support this project. In the rest of this blog, we share more details about BigQuery and the integration.
What is BigQuery?
BigQuery is fully-managed, serverless data warehouse that makes it simple to query data using standard SQL syntax. Along with other Google Cloud products, BigQuery provides powerful data analysis capabilities used by the world’s most innovative companies, such as UPS, Twitter, Toyota, PayPal, and Bloomberg.
IoTeX joins an elite class of blockchain projects, including Bitcoin, Litecoin, Ethereum, and Zcash, in making on-chain data available to Google Cloud developers. With BigQuery, anyone can run advanced analytics across multiple datasets/blockchains, as well as track inter-chain activity for interoperable tokens, such as ioBTC and ioETH in the IoTeX Network.
Integration Details
By increasing the transparency of blockchain systems, the contained data becomes more accessible and useful. This project’s objective was to make real-time IoTeX data, such as gas costs, smart contract activity, mimo liquidity, Ucam registrations, and decentralized identity (DID) records, from IoTeX available for exploration with BigQuery. Specifically, this integration:
- Performs real-time extraction of data from the IoTeX blockchain
- Stores the data to Google BigQuery and de-normalizes it to make exploration easier
- Derives insights from the extracted data via Google’s Data Studio
It’s easy to get started with just a few clicks — in addition to the IoTeX Explorer and Analytics Playground, BigQuery is one of the most convenient ways to analyze data related to the IoTeX blockchain. It’s also expressive enough to cater to the most advanced data scientists. Stay tuned for more exciting updates.
“Google Cloud has an incredible reach and depth of connections,” said IoTeX Co-founder and former Google Tech Lead, Raullen Chai. “We are thrilled to have the opportunity to make verifiable data from the IoTeX Network available to the broader technology industry .”
About IoTeX
Founded as an open source platform in 2017, IoTeX is building the Internet of Trusted Things, an open ecosystem where all “things” — humans, machines, businesses, and DApps — can interact with trust and privacy. Backed by a global team of 30+ top research scientists and engineers, IoTeX combines blockchain, secure hardware, and confidential computing to enable next-gen IoT devices, networks, and economies. IoTeX will empower the future decentralized economy by “connecting the physical world, block by block”.