Artificial Superintelligence Alliance 백서

Artificial Superintelligence Alliance

원문

bitpro가 원문에서 글자만 모은 내용이에요. 표·그림·수식은 빠지거나 깨질 수 있어요. 전체 12쪽 중 2쪽

vibrant community, ASI: Create fosters a thriving ecosystem for innovation. Users benefit from high-performance, open-source AI with a secure, privacy-centric architecture, enabling them to engage with advanced AI capabilities safely and effectively. For investors, ASI: Create presents an opportunity to support pioneering AI projects through liquid staking and digital commodities, driving the growth of impactful, forward-looking initiatives. At the core of ASI: Create lies the ASI AI DePIN stack, designed around four innovation pillars: Enhanced Large Language Models, Neural-Symbolic Systems, World-World Models, and Agent Networks. This decentralised stack powers applications across industries, paving the path toward AGI and ASI while upholding community governance, data privacy, and adaptable, industry-specific solutions. ASI: Create reveals its potential with the release of the prototype video. This showcase highlights a new era of decentralised, community-driven AI that is set to redefine the future of artificial intelligence. Discover how ASI: Create empowers users to build, collaborate, and innovate—ushering in the next chapter of AI. # ASI \<LEARN/> <figure><img src="https://434267010-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FE0eZgP8lxRNljW57Uw4H%2Fuploads%2FH2ZoylOH38VUHXpG59RT%2FASI_LEARN%403x-100.jpg?alt=media&amp;token=0909be8f-a225-4eb6-8b54-224a08a7f114" alt=""><figcaption></figcaption></figure> ASI: Learn establishes transparent and traceable pathways for data-to-graph conversion. The platform implements graph transformations through semantic, perceptual inputs and experiential learning. The architecture delivers the following: indexing for graph search, knowledge asset tokenization, collaborative annotation frameworks, data privacy management, performance optimization, and cross-chain interoperability. The system monetizes data from source to transformation while maintaining contributor privacy. # ASI \<TRAIN/> <figure><img src="https://434267010-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FE0eZgP8lxRNljW57Uw4H%2Fuploads%2FLoISzSYj60FaD6TbJ0pL%2FASI_TRAIN%402x-80.jpg?alt=media&amp;token=19169ff1-13c8-4a99-9392-c0d6cbd098d2" alt=""><figcaption></figcaption></figure> ASI: Train creates an ecosystem of aggregated open-source foundation models trained and owned by the community. Inference is served by autonomous agents with a cognitive search layer enabling discovery through natural language prompts and data protocols. ASI: Train’s architecture delivers the following: data pipeline, model quantization, scalable compute, agent-based search and discovery of models. The system implements comprehensive tools for deployment, data provisioning, compute, and finetuning. Fetch.ai agents facilitate ecosystem onboarding for research entities, business data providers, and end users. ASI: Train integrates Cudos’ infrastructure, Ocean’s data tools, and SingularityNET’s capabilities for model selection and optimization. Fetch.ai delivers agent-based inference. The platform creates workflows, and automates training and inference processes. This allows new services to be composed from multi-agent networks. # An introduction to ASI\<Train/> ## Abstract Large Language Models (LLMs) have revolutionized natural language processing and artificial intelligence (AI) applications. Despite remarkable progress, scaling LLMs further is neither sustainable nor sufficient to meet the growing demands for quality, speed, and domain specificity. LLMs cater to solving for breadth of knowledge and general intelligence rather than depth of knowledge within a specific domain.&#x20; This paper argues that the future of LLM development lies in combining domain-specific foundational models with cognitive search capabilities. Using robotics, biotechnology, and physics as case studies, it demonstrates how specialization and enhanced retrieval mechanisms can overcome the inherent limitations of generalist LLMs to make progress and unlock new revenue streams. These advances can ensure efficiency, relevance, and depth in addressing complex challenges across disciplines. ## Introduction to ASI\<Train/> The advent of LLMs, such as OpenAI's GPT series, Meta's Llama, Anthropic's Claude, and Google's Gemini, has fundamentally changed how AI interacts with humans and has made AI assistants mainstream. By training on vast, diverse datasets, these models achieve general-purpose utility. However, this generality is also their limitation.&#x20; More sustainable solutions exist than scaling LLMs by increasing their training parameters and datasets. The path forward lies in developing domain-specific foundational models that prioritize specialized knowledge and cognitive search to enhance retrieval and synthesis capabilities. ASI\<Train/> is a Web3 platform that is one of the first to target the training of domain-specific foundational models to solve monumental challenges within such domains and democratize access and ownership of advanced AI capabilities from these models. ## Why is ASI\<Train/> needed? In our view, generalist LLMs will co-exist with domain-specific foundational models because of the limitations of the LLMs. ### LLM limitations #### Generalist limitations for domain-specific challenges&#x20; * Contextual Depth: They often fail to address domain-specific nuances, producing outputs that lack precision or are factually incorrect in specialized fields. * Relevance: Responses may be verbose or irrelevant due to overgeneralized training datasets. * Biases: Training on diverse datasets introduces biases, which can be detrimental in critical domains like biotechnology or physics.&#x20; * Multimodality: While LLMs are expanding into multimodality, they struggle to scale across all possible modalities due to the vast diversity of data and challenges in aligning outputs consistently across different types.&#x20; #### Scaling limitations with diminishing returns As model sizes grow, performance improvements on benchmarks like GLUE or SuperGLUE plateau. Studies, such as Kaplan et al.’s work on scaling laws (2020), show that larger models require exponentially extensive resources for marginal gains. This diminishing return is especially evident in tasks requiring domain expertise, where generalist LLMs produce surface-level responses. #### Unsustainable resource requirements Scaling LLMs is computationally expensive and environmentally unsustainable: * OpenAI’s GPT-3 reportedly consumed 1,287 MWh of energy during training, equivalent to the annual electricity consumption of 120 U.S. homes (Patterson et al., 2021). * Inference latency increases with model size, making real-time applications like robotics and biotech simulations impractical. ### Case for domain-specific foundational models Domain-specific foundational models are pre-trained and optimized for a particular discipline. Unlike generalist LLMs, these models use curated datasets, specialized architectures, and require domain expertise to address the unique challenges. Advantages of specialization can be attributed to three areas: #### 1. Enhanced accuracy&#x20; Domain-specific foundational models demonstrate remarkable potential within their respective domains because of unparalleled accuracy and precision in complex applications. For example, * In robotics, models trained on robotic process datasets can produce accurate kinematics or path optimization predictions. * In biotech, foundational models can analyze protein structures or genomic sequences with unmatched precision. #### 2. Efficiency gains Accrue from dealing with a significantly smaller subset of domain data rather than an entire corpus of internet data. Specifically, efficiency gains include: * Smaller, specialized models require fewer computational resources. * Real-time applications like robotics control systems benefit from reduced latency. #### 3. Tailored inputs and outputs Specialized models can integrate with the regulatory, ethical, and practical requirements of the domains. For example,&#x20; * Models related to robotics need to adhere to safety requirements in a human-robot hybrid environment.&#x20; * Models related to drug discovery must conform to ethical and regulatory requirements from local governing bodies. * Models related to quantum mechanics should reflect fundamental aspects of quantum reality, including entanglement, superposition, measurement effects, quantum decoherence, as well as practical considerations like material limitations and the impact of observation. ## What is ASI\<Train/>?&#x20; ### An agent-based training framework for specialist foundation models As industries increasingly adopt specialized AI models, traditional centralized inference serving systems face scalability, cost, and latency challenges. By leveraging Fetch.ai’s Autonomous Inference Model (AIM) Agents and FET tokenomics, ASI\<Train/> can overcome these limitations and provide a decentralized, incentivized, and efficient framework for inference serving across diverse domains such as robotics, material science, molecular design, and physics simulations. #### Framework components 1. AIM agents&#x20; * AIMs are lightweight, autonomous software agents that host and manage trained ASI\<Train/> models. * They are specialized for tasks in distinct domains, e.g., robotics, drug design, or physics simulations. 2. Inference nodes * Distributed network nodes where AIMs are deployed. * Inference nodes process user requests, ensuring low-latency inference serving. 3. Validation nodes * Validate inference outputs to ensure accuracy and quality. * Validators are rewarded in FET tokens for successful and fair validations. 4. FET token system * Facilitates transactions between users, AIMs, and validators. * Rewards are distributed based on computational resources, model quality, and inference accuracy. 5. Dynamic subnetworks * AIMs form dynamic subnetworks based on domain-specific requirements, optimizing resource allocation and communication. #### An AIMs-based inference serving layered architecture 1. Application layer * Hosts user-facing interfaces for submitting inference requests. * Manages subscription plans and integrates payment systems for FET transactions. 2. Agent layer (AIMs) * Each AIM agent specializes in hosting domain-specific ASI\<Train/> models (e.g., robotics, PINNs, molecular design). * AIMs handle model deployment, request processing, and result generation. 3. Resource management layer * Allocates computational resources across the network, optimizing workload distribution for inference nodes. * Implements demand-based scaling to match network capacity with request volume. 4. Validation layer * A decentralized layer of validators ensures inference accuracy and model performance. * Uses reputation systems to prioritize validators with a history of reliable assessments. 5. Blockchain layer * Secures all transactions, model updates, and validation records using Fetch.ai’s blockchain. * Ensures transparency and immutability of FET token flows and inference outcomes. #### Workflow for inference serving * Inference request submission\ Users submit requests through the Application Layer, specifying the desired model and parameters. * Request routing via AIM agent\ The Resource Management Layer routes the request to the most suitable AIM agent based on performance metrics and computational availability. * Model execution\ The AIM agent processes the request using the hosted ASI\<Train/> model and generates the inference output. * Validation\ Validation nodes assess the quality of the inference result, ensuring correctness and reliability. * Result delivery and reward distribution * Results are returned to the user. * FET tokens are distributed among AIMs, validators, and node operators based on contribution and performance. #### Additional features of the framework 1. **Interoperability across domains - Fetch.ai AIMs enable seamless integration of diverse domain-specific models, fostering collaboration across industries.** 2. **Real-time collaboration - Decentralized AIMs allow researchers and industries to collaborate and share models without relying on centralized infrastructures.** 3. **On-demand scalability - Dynamic subnetworks ensure the system scales efficiently based on real-time demand for domain-specific inference services.** 4. **Incentivization for specialization - FET rewards encourage the creation and maintenance of high-quality, specialized models, ensuring continuous innovation.** ### Enhanced tokenomics model #### Multi-tier reward system The tokenomics are structured to incentivize various stakeholders in the network, ensuring fairness and fostering collaboration. 1. Model providers (AIMs) * Revenue Model: Earn FET tokens based on the number and quality of inference requests served. * Performance Bonuses: Additional FET rewards for high accuracy, low latency, and model optimization. 2. Validators * Primary Rewards: Validators assess inference outputs for accuracy and reliability and are rewarded with FET for successful validations. * Staking Incentives: Validators stake FET tokens to ensure commitment and are penalized for invalid or biased validations. 3. Users * Pay-per-Inference: Users pay in FET tokens based on the complexity and resource intensity of their requests. * Subscription Model: Users can subscribe to domain-specific subnets for frequent access to inference services at a reduced cost. 4. Network operators * Infrastructure Incentives: Nodes providing computational resources to AIMs are compensated in FET for hosting and maintaining the network. #### Dynamic pricing mechanism * Demand-based pricing: FET token costs for inference services fluctuate based on demand and resource availability within the network. * Complexity-based pricing: Inference requests with higher computational requirements are priced higher, ensuring equitable distribution of resources. #### Governance and staking * Governance tokens: A portion of staked FET tokens can be converted to governance tokens, enabling participants to vote on subnet parameters, model priorities, and token distribution policies. * Revenue redistribution: A percentage of FET fees is reinvested into the network for research, development, and community growth. #### Sustainability funds * Green incentives: A sustainability fund ensures that a portion of FET tokens is allocated to optimizing energy efficiency and supporting environmentally friendly computation. ### First candidate model for ASI\<Train/> #### Cortex: a brain inspired robotics model For decades, humanity has envisioned robots working alongside people, enabling humans to focus on solving complex problems. However, robots come in many forms—not just humanoid figures. From robotic arms used for item picking in warehouses and robotized assembly lines to advanced medical robots, the field of robotics is vast and diverse. As of now, the global robotics market is expected to reach $165 billion by 2029, with the robotics software market projected to grow to $80 billion by 2032. The rise of artificial intelligence (AI) has unlocked unprecedented opportunities in robotics. Traditional robotics relied on heuristic methods and preprogrammed instructions, but AI introduces adaptive and learning-based algorithms, enabling robots to better understand and interact with their environments. Despite this progress, creating AI systems capable of processing multiple information sources and navigating the physical world remains a significant challenge. Recent advancements in Large Language Models (LLMs) have expanded the horizons of robotics. Multimodal LLMs, capable of processing both text and images, open up possibilities for robotics systems that combine environmental visual data with internal states. These advancements pave the way for robots that are not only reactive but also contextually aware and adaptive. Building on these developments, we plan to take inspiration from existing models as practical starting points. Google has been a leader in this area, releasing RT-1 and RT-2, with the closed-source RT-2-X representing a significant leap in capability. The open-source community has also made strides, such as developing the OpenVLA model in an effort to replicate RT-2-X. The ASI team intends to start with OpenVLA as a foundation and innovate further, creating the next generation of robotic control models inspired by how the human brain operates. Brain-inspired robotics hold immense potential to transform industries such as manufacturing, healthcare, and hospitality. Collectively, these industries stand to gain an annual financial impact of $1 billion to $3 billion from such advancements.&#x20; ### Future directions #### Science domains being explored **Novel material discovery** * Challenge: Accurately predicting material properties is a critical yet challenging task in the field of inorganic materials design. While quantum mechanical approaches like Density Functional Theory (DFT) provide a strong theoretical foundation for understanding material behavior at the atomic and subatomic levels, they are computationally intensive and highly dependent on specific functionals. This makes large-scale material screening impractical and creates a bottleneck in advancing high-growth industries such as batteries, semiconductors, and nanotechnology. * Solution: The ASI\<Train/> initiative will leverage artificial intelligence (AI) to predict material properties with high accuracy while drastically reducing computational demands. By training AI models on large datasets of DFT-calculated and experimentally verified material properties, ASI\<Train/> will accelerate high-throughput screening processes. This integration of AI and physics-based methods should complement traditional approaches, enabling efficient and scalable new material discovery. * Impact: By overcoming the computational limitations of traditional methods, initiatives like ASI\<Train/> will drive breakthroughs in materials design, particularly in energy storage, electronics, and nanotechnology. These advancements are pivotal in addressing global challenges such as clean energy and sustainability while contributing to the rapid growth of markets like batteries (projected to reach $680 billion by 2033) and advanced materials (expected to grow to $115 billion by 2030). **Molecule design for drug discovery** * Challenge: Accurately predicting effective drug molecules is a critical yet challenging task in pharmaceutical drug discovery. A key bottleneck is molecular docking—a computational method used to identify molecules that bind effectively to target proteins and influence disease progression. However, molecular docking is complicated by the intricate nature of biological interactions and the vast chemical space of potential drug candidates, which consists of billions of possible molecules. * Solution: Data-driven approaches, particularly AI-based models like DiffDock, offer a promising solution to these challenges. These machine learning models leverage advanced algorithms to more accurately predict protein-ligand interactions by accounting for the flexibility of the molecules. By improving the efficiency and accuracy of molecular docking, models like DiffDock can significantly accelerate the identification of viable small-molecule candidates. The ASI team is committed to scaling up these AI models to enhance their robustness and versatility in discovering high-potential drug candidates. This involves implementing strategies such as expanding training datasets to encompass a broader diversity of molecular structures and protein interactions, refining algorithms and model architectures, leveraging state-of-the-art computational resources, and improving scoring functions and conformational sampling techniques. This will
프로젝트로 돌아가기