Data is a crucial pillar of AI, and Data Universe serves as that pillar for Bittensor.
Data Universe is a subnet designed for collecting and storing vast amounts of data from a wide range of sources, intended for use by other subnets. It was built with a strong emphasis on decentralization and scalability. There is no centralized entity controlling the data; it is distributed across all miners on the network and can be queried via the validators. At launch, Data Universe supports up to 50 petabytes of data across 200 miners, while only requiring approximately 10GB of storage on each validator.
Data is a crucial pillar of AI, and Data Universe serves as that pillar for Bittensor.
Data Universe is a subnet designed for collecting and storing vast amounts of data from a wide range of sources, intended for use by other subnets. It was built with a strong emphasis on decentralization and scalability. There is no centralized entity controlling the data; it is distributed across all miners on the network and can be queried via the validators. At launch, Data Universe supports up to 50 petabytes of data across 200 miners, while only requiring approximately 10GB of storage on each validator.
Macrocosmos aims to elevate the creation of subnets, emphasizing a focus on crafting incentives and mechanisms for the Bittensor network. In the Data Universe, miners scrape data from defined sources, known as DataSources. Each piece of data (e.g., a webpage, BTC prices), termed a DataEntity, is stored in the miner’s database. Every DataEntity belongs to a specific DataEntityBucket, uniquely identified by its DataEntityBucketIdâa tuple consisting of the data’s source (DataSource), creation time (TimeBucket), and a classification (DataLabel, e.g., a stock ticker symbol). The complete set of DataEntityBuckets on a miner is called its MinerIndex.
Validators periodically query each miner to retrieve their latest MinerIndexes and store them in a local database. This process provides validators with a comprehensive overview of all data stored on the network and identifies which miners to query for specific types of data. Validators also regularly verify the accuracy of the data stored by miners and reward them based on the value of the data they have accumulated.
Incentive Mechanism
Each miner reports its MinerIndex to the validator, detailing the quantity and type of data it holds. Miners are scored based on two main dimensions:
Data Value
Not all data holds the same value. The factors determining data value include:
Miner Credibility
Validators periodically check a sample of data from each miner’s MinerIndex to verify its accuracy. This process helps track a miner’s credibility, which in turn scales the miner’s score. Misrepresenting data types and quantities always results in a worse score for the miner.
Data Universe Dashboard
Data Universe rewards diversity of data; storing multiple copies of the same data is not beneficial. To help miners understand the current data landscape, the Data Universe team hosts a dashboard showing the amount of each type of data (by DataEntityBucketId) on the subnet. Miners are encouraged to use this dashboard to optimise their Miner Configuration and maximise rewards.
Macrocosmos aims to elevate the creation of subnets, emphasizing a focus on crafting incentives and mechanisms for the Bittensor network. In the Data Universe, miners scrape data from defined sources, known as DataSources. Each piece of data (e.g., a webpage, BTC prices), termed a DataEntity, is stored in the miner’s database. Every DataEntity belongs to a specific DataEntityBucket, uniquely identified by its DataEntityBucketIdâa tuple consisting of the data’s source (DataSource), creation time (TimeBucket), and a classification (DataLabel, e.g., a stock ticker symbol). The complete set of DataEntityBuckets on a miner is called its MinerIndex.
Validators periodically query each miner to retrieve their latest MinerIndexes and store them in a local database. This process provides validators with a comprehensive overview of all data stored on the network and identifies which miners to query for specific types of data. Validators also regularly verify the accuracy of the data stored by miners and reward them based on the value of the data they have accumulated.
Incentive Mechanism
Each miner reports its MinerIndex to the validator, detailing the quantity and type of data it holds. Miners are scored based on two main dimensions:
Data Value
Not all data holds the same value. The factors determining data value include:
Miner Credibility
Validators periodically check a sample of data from each miner’s MinerIndex to verify its accuracy. This process helps track a miner’s credibility, which in turn scales the miner’s score. Misrepresenting data types and quantities always results in a worse score for the miner.
Data Universe Dashboard
Data Universe rewards diversity of data; storing multiple copies of the same data is not beneficial. To help miners understand the current data landscape, the Data Universe team hosts a dashboard showing the amount of each type of data (by DataEntityBucketId) on the subnet. Miners are encouraged to use this dashboard to optimise their Miner Configuration and maximise rewards.
Will Squires â CEO and Co-Founder
Will has dedicated his career to navigating complexity, spanning from designing and constructing significant infrastructure to spearheading the establishment of an AI accelerator. With a background in engineering, he made notable contributions to transport projects such as Crossrail and HS2. Willâs expertise led to an invitation to serve on the Mayor of Londonâs infrastructure advisory panel and to lecture at UCLâs Centre for Advanced Spatial Analysis (CASA). He was appointed by AtkinsRĂŠalis to develop an AI accelerator, which expanded to encompass over 60 staff members globally. At XYZ Reality, a company specializing in augmented reality headsets, Will played a pivotal role in product and software development, focusing on holographic technology. Since 2023, Will has provided advisory services for the Opentensor Foundation, contributing to the launch of Revolution.
Steffen Cruz â CTO and Co-Founder
Steffen earned his PhD in subatomic physics from the University of British Columbia, Canada, focusing on developing software to enhance the detection of extremely rare events (10^-7). His groundbreaking research contributed to the identification of novel exotic states of nuclear matter and has been published in prestigious scientific journals. As the founding engineer of SolidState AI, he pioneered innovative techniques for physics-informed machine learning (PIML). Steffen was subsequently appointed as the Chief Technology Officer of the Opentensor Foundation, where he played a pivotal role as a core developer of Subnet 1, the foundationâs flagship subnet. In this capacity, he enhanced the adoption and accessibility of Bittensor by authoring technical documentation, tutorials, and collaborating on the development of the subnet template.
Michael Bunting – CFO
Before joining Macrocosmos, Mike spent 12 years in investment banking, where he guided clients through major strategic and financial transitions across more than ÂŁ1 billion in international M&A and capital raising deals. Most recently serving as a Director at Piper Sandler, he brings deep experience in advising high-growth startups on strategy, business planning, funding pathways, and corporate governance. Mike has also worked closely with multinational corporations and prominent financial investors throughout his career.
Elena Nesterova – Head of Delivery
Volodymyr Truba – Senior Machine Learning Engineer
Alma Schalèn – Head of Product Design
Felix Quinque – Machine Learning Lead
Dmytro Bobrenko – Machine Learning/AI Lead
Alan Aboudib – Machine Learning Lead
Alex Williams – People & Talent Manager
Chris Zacharia – Communications Lead
Brian McCrindle â Senior Machine Learning Engineer
Lawrence Hunt – Frontend Engineer
Nicholas Miller – Senior Software Engineer
Kalei Brady â Data Scientist
Szymon Fonau – Machine Learning Engineer
Monika Stankiewicz – Executive Assistant
Amy Chai – Junior Machine Learning Engineer
Giannis Evagorou – Senior Software Engineer
Richard Wardle – Junior Software Engineer
Kai Morris – Content & Community specialist
Lewis Sword – Junior Software Engineer
Will Squires â CEO and Co-Founder
Will has dedicated his career to navigating complexity, spanning from designing and constructing significant infrastructure to spearheading the establishment of an AI accelerator. With a background in engineering, he made notable contributions to transport projects such as Crossrail and HS2. Willâs expertise led to an invitation to serve on the Mayor of Londonâs infrastructure advisory panel and to lecture at UCLâs Centre for Advanced Spatial Analysis (CASA). He was appointed by AtkinsRĂŠalis to develop an AI accelerator, which expanded to encompass over 60 staff members globally. At XYZ Reality, a company specializing in augmented reality headsets, Will played a pivotal role in product and software development, focusing on holographic technology. Since 2023, Will has provided advisory services for the Opentensor Foundation, contributing to the launch of Revolution.
Steffen Cruz â CTO and Co-Founder
Steffen earned his PhD in subatomic physics from the University of British Columbia, Canada, focusing on developing software to enhance the detection of extremely rare events (10^-7). His groundbreaking research contributed to the identification of novel exotic states of nuclear matter and has been published in prestigious scientific journals. As the founding engineer of SolidState AI, he pioneered innovative techniques for physics-informed machine learning (PIML). Steffen was subsequently appointed as the Chief Technology Officer of the Opentensor Foundation, where he played a pivotal role as a core developer of Subnet 1, the foundationâs flagship subnet. In this capacity, he enhanced the adoption and accessibility of Bittensor by authoring technical documentation, tutorials, and collaborating on the development of the subnet template.
Michael Bunting – CFO
Before joining Macrocosmos, Mike spent 12 years in investment banking, where he guided clients through major strategic and financial transitions across more than ÂŁ1 billion in international M&A and capital raising deals. Most recently serving as a Director at Piper Sandler, he brings deep experience in advising high-growth startups on strategy, business planning, funding pathways, and corporate governance. Mike has also worked closely with multinational corporations and prominent financial investors throughout his career.
Elena Nesterova – Head of Delivery
Volodymyr Truba – Senior Machine Learning Engineer
Alma Schalèn – Head of Product Design
Felix Quinque – Machine Learning Lead
Dmytro Bobrenko – Machine Learning/AI Lead
Alan Aboudib – Machine Learning Lead
Alex Williams – People & Talent Manager
Chris Zacharia – Communications Lead
Brian McCrindle â Senior Machine Learning Engineer
Lawrence Hunt – Frontend Engineer
Nicholas Miller – Senior Software Engineer
Kalei Brady â Data Scientist
Szymon Fonau – Machine Learning Engineer
Monika Stankiewicz – Executive Assistant
Amy Chai – Junior Machine Learning Engineer
Giannis Evagorou – Senior Software Engineer
Richard Wardle – Junior Software Engineer
Kai Morris – Content & Community specialist
Lewis Sword – Junior Software Engineer
Huge thanks to Keith Singery (aka Bittensor Guru) for all of his fantastic work in the Bittensor community. Make sure to check out his other video/audio interviews by clicking HERE.
Steffen Cruz, previously the CTO of the Opentensor Foundation, has joined forces with his longtime friend Will Squires to establish Macrocosmos. Leading subnets 1, 9, 13, 25 and 37, this team is actively shaping the future of Bittensor and stands as one of the most influential entities within the ecosystem.
In this second video, they spend much of the episode covering Subnet 13’s rebranding to “Gravity” and the team’s prediction of a Trump victory along with how this has managed to build a team of PHDs and machine learning professionals around Bittensor.
Keep ahead of the Bittensor exponential development curve…
Subnet Alpha is an informational platform for Bittensor Subnets.
This site is not affiliated with the Opentensor Foundation or TaoStats.
The content provided on this website is for informational purposes only. We make no guarantees regarding the accuracy or currency of the information at any given time.
Subnet Alpha is created and maintained by The Realistic Trader. If you have any suggestions or encounter any issues, please contact us at [email protected].
Copyright 2024