bitpro가 원문에서 글자만 모은 내용이에요. 표·그림·수식은 빠지거나 깨질 수 있어요. 전체 2쪽 중 1쪽
Verifiable
Internet
for
Artificial
Intelligence:
The
Convergence
of
Crypto,
Internet
and
AI
Pre-publication
Trace
Labs
OriginTrail
Core
developers
Feedback
&
Discussion
:
https://discord.gg/9CvynQ9kYe
"We
live
in
a
time
of
abundant
connectivity
and
alas
abundant
misinformation.
The
OriginTrail
Decentralized
Knowledge
Graph
(DKG)
is
an
evolving
tool
for
finding
the
truth
in
knowledge.
In
particular,
we
see
knowledge
graphs
improving
the
fidelity
of
artificial
intelligence
."
Dr
Bob
Metcalfe,
Ethernet
inventor
&
Internet
pioneer
Abstract
This
whitepaper
presents
a
vision
for
the
future
of
Artificial
Intelligence
(AI)
through
the
concept
of
a
Verifiable
Internet
for
AI,
leveraging
the
synergies
of
crypto,
internet,
and
AI
technologies.
It
introduces
the
Decentralized
Knowledge
Graph
(DKG),
a
novel
approach
to
ensure
the
provenance,
integrity,
and
verifiability
of
information
utilized
by
AI
systems.
It
aims
to
address
the
challenges
posed
by
misinformation,
data
ownership,
intellectual
property
rights,
and
biases
inherent
in
AI
technologies,
by
synergizing
neural
and
symbolic
AI
approaches
with
Web3
technologies.
The
whitepaper
delves
into
the
intricate
mechanics
of
the
DKG,
how
it
enhances
AI
reliability
with
Knowledge
Assets
and
supports
autonomous
paranets.
The
Verifiable
Internet
for
AI
is
not
only
a
technological
advancement
but
a
paradigm
shift
towards
a
more
transparent,
inclusive,
and
ethical
digital
landscape.
This
vision
combines
blockchain
technology
with
the
dynamic
capabilities
of
AI
to
foster
a
democratic,
ethically
guided,
and
economically
viable
future
for
AI
applications.
1
Purpose
The
sudden
rise
of
Artificial
Intelligence
(AI)
in
the
mainstream
is
reshaping
all
of
our
interactions
with
knowledge.
It
changes
how
we
discover
it,
how
we
process
it
for
our
advantage,
and
how
we
use
it
to
create
new
knowledge.
It
is
an
unprecedented
event
in
the
history
of
civilization,
as
we
receive
an
unseen
boost
to
cognition
capabilities,
outperforming
any
previously
available
human
or
machine
methods.
It
allows
us
to
leverage
endless
amounts
of
data,
identifying
patterns
and
insights
that
would
otherwise
remain
undiscovered.
This
enables
creating
adaptive
and
continuously
self-improving
solutions
that
are
tailored
to
every
individual.
As
the
technology
is
growing
more
powerful,
its
anomalies
can
be
much
more
devastating.
The
challenge
of
misinformation
is
no
longer
limited
to
malicious
printing
of
propaganda.
Even
abusing
social
networks
for
political
manipulations
may
look
minuscule
compared
to
a
lack
of
trust
in
solutions
to
which
we
are
“outsourcing”
our
cognition.
Systems
that
we
would
trust
to
process
large
amounts
of
knowledge
and
provide
us
inputs
for
our
actions
or
even
perform
certain
actions
autonomously,
have
the
highest
possible
requirements
for
transparency
and
verifiability.
There
should
be
no
compromise
in
designing
AI
solutions
when
it
comes
to
data
ownership,
information
provenance,
verifiability
of
information,
or
bias
that
would
include
any
censorship-by-design
approach.
The
risk
of
this
revolution
not
unfolding
in
an
inclusive
way
is
a
societal
threat
of
establishing
a
monopoly
on
AI.
1
The
present
whitepaper
discusses
the
building
blocks
of
the
Verifiable
Internet
for
AI.
To
harness
a
harmonious
development
between
Web3
fundamentals
and
rapidly
deployed
AI
systems,
we
propose
practical
steps.
In
this
approach,
we
aim
to
integrate
the
core
Web3
technologies
such
as
the
OriginTrail
Decentralized
Knowledge
Graph
(DKG),
Ethereum,
and
Polkadot
(more
specifically
-
NeuroWeb)
and
AI
systems
(OpenAI,
Google,
Microsoft,
X’s
GrokAI,
and
others)..
We
believe
that
we
can
realize
the
potential
of
trusted
AI
by
creating
a
Verifiable
Internet
for
AI
that
is
founded
on
principles
of
neutrality,
inclusiveness,
and
usability.
2
Artificial
Intelligence
and
its
anomalies
Artificial
Intelligence
(AI)
is
a
field
of
computer
science
that
develops
and
studies
intelligent
machines.
It
is
the
simulation
of
human
intelligence
processes
by
machines,
especially
computer
systems.
Generative
AI
(GenAI)
is
a
type
of
AI
technology
that
can
produce
various
types
of
content,
such
as
text,
imagery,
audio,
and
other
synthetic
data.
It
uses
generative
neural
network
models
to
create
new
and
original
content
in
response
to
a
prompt.
It’s
been
widely
popularized
by
large
language
models
(LLMs)
such
as
OpenAI’s
ChatGPT,
Google’s
Gemini,
Meta’s
LLaMA.
The
performance
of
such
well
and
widely-trained
LLMs
has
increased
tremendously
quickly
and
allows
them
to
provide
intelligent
responses
to
a
wide
spectrum
of
topics.
The
standalone
impact
of
these
models
on
the
economy
was
estimated
to
be
4.4T
USD
by
McKinsey
[1]
.
In
order
for
GenAI
to
fulfill
its
potential
and,
moreover,
unlock
new
potential
for
growth,
the
following
anomalies
should
be
addressed.
Hallucinations
.
As
the
name
suggests,
Generative
AI
is
not
a
deterministic
system
as
its
responses
to
prompts
are
generated
on
the
basis
of
the
large
amounts
of
data
that
a
model
has
been
trained
on.
They
are,
therefore,
probabilistic
systems
that
are
very
good
at
“guessing”
what
the
most
appropriate
response
to
your
prompt
is.
While
they
might
be
very
good
at
predicting
a
high-quality
response,
there
is
still
a
large
chance
that,
for
example,
the
response
you
receive
might
not
be
the
correct
answer
to
a
question
you
posed.
This
is
considered
a
“hallucination”,
a
wrongful
prediction
of
the
correct
response
created
by
a
GenAI
system.
Hallucinations
can
be
entertaining
and
even
inspiring,
however,
they
are
still
generally
an
unwanted
response,
especially
in
situations
where
a
precise
response
is
of
utmost
importance
(e.g.
education,
medicine,
supply
chain,
science,
construction
…).
Data
ownership
and
intellectual
property.
The
vast
datasets
the
GenAI
models
are
trained
on
may
include
copyrighted
material
to
which
the
owner
has
not
given
specific
access/license
to
use.
This
opens
up
questions
of
(1)
the
legality
of
using
such
data
to
advance
(train)
a
GenAI
model
and
(2)
the
intellectual
property
rights
of
the
generative
outputs
(e.g.
art
piece
or
a
text).
Things
get
even
more
complex
with
using
personal
data
or
business-sensitive
data
which
can
have
significant
privacy
concerns.
The
challenges
don’t
stop
there
as
disassociating
copyrighted
content
from
a
model
can
only
be
done
by
retraining
or
fine-tuning
which
are
both
resource-intensive
processes
while
data-forgetting
techniques
yield
limited
results.
Bias
.
The
GenAI
models
are
created
by
training
on
large
amounts
of
data
and
by
doing
so
the
model
also
adopts
biases
present
in
the
data.
This
leads
to
systemic
prejudice
appearing
in
the
responses
to
prompts
which
creates
a
wide
spectrum
of
problems
-
racial,
national,
gender,
or
political
biases
at
the
societal
level
or,
for
example,
smaller-scale
biases
of
preferring
one
provider
over
another
in
a
fine-tuned
model
for
an
enterprise
solution.
Fighting
existing
biases
in
models
can,
again,
be
very
resource
intensive
as
it
also
has
to
be
done
through
retraining
or
fine-tuning
(similar
to
data
disassociating
techniques
above).
Model
collapse.
The
performance
of
GenAI,
especially
LLMs,
is
crucially
reliant
on
the
quality
of
the
training
data
they
consume.
The
data
has
to
be
relevant
and
diverse
so
the
model
can
become
stronger
by
training
on
it.
In
a
scenario
where
data
would
be
generated
by
the
model
itself
(i.e.
synthetic
data),
the
model
would
not
only
stop
getting
better
or
plateau,
it
would
actually
start
to
degenerate
[2]
.
Using
synthetic
data
for
training
leads
to
reinforcing
existing
biases
and
it
minimizes
the
“tails”
in
the
data.
Tails
are
the
less-likely
but
critical
parts
of
the
data
as
they
give
the
LLM
outputs
a
greater
variety
of
responses.
Without
them,
misinterpretation
of
data
starts
to
happen
and
the
model
can
slide
towards
implosion.
This
threat
is
becoming
much
greater
as
the
use
of
AI
becomes
more
prevalent
on
the
internet
(the
main
source
for
LLM
training
data
is
scraping
the
internet).
If
the
majority
of
content
on
the
internet
becomes
AI
generated
(synthetic),
the
value
this
data
has
for
AI
systems
training
will
decrease
as
it
will
be
more
and
more
dangerous
to
use
it.
What
will
grow
in
value,
on
the
flip
side,
is
verifiably
non-AI
generated
real-world
data.
2
3
Verifiable
Internet
for
AI
In
the
near
future,
AI
models
will
largely
dominate
the
internet
both
in
activity
and
content
production.
The
disruption
created
by
OpenAI’s
launch
of
GenAI
large
language
model
ChatGPT
has
forced
all
major
technology
companies
to
show
their
hands
with
the
AI
developments
they
made
(e.g.
Google’s
launch
of
Gemini,
X’s
GrokAI
or
Meta’s
progress
on
LLaMA).
Furthermore,
the
open
source
community
has
taken
great
leaps
to
follow
the
proprietary
models,
and
with
great
success,
providing
useful
components
to
the
Verifiable
internet
for
AI.
Text
LLMs,
however,
are
by
far
not
the
only
GenAI
models
out
there.
Among
others,
you
can
find:
●
Image
generation
(e.g.
Stable
Diffusion)
-
the
ability
to
create
images
either
from
text,
image,
text
and
image
or
image
and
image
inputs,
●
Video
generation
(e.g.
OpenAI
Sora)
-
the
ability
to
create
a
short
video,
up
to
60s,
with
a
text
prompt
●
Multimodal
models
(e.g.
OpenAI
CLIP)
-
models
that
are
capable
of
accepting
multiple
media
as
input
as
well
as
providing
multiple
media
responses.
The
AI-dominated
internet
future
will
therefore
have
people
interacting
with
a
plethora
of
AI
models
-
anything
from
single-model
interactions
to
agent-driven
applications
that
will
be
able
to
carry
out
autonomous
activities
tapping
into
the
capabilities
of
multiple
agents.
As
AI
penetration
into
the
mainstream
continues,
such
a
world
has
a
dire
need
to
effectively
address
the
above-mentioned
anomalies
of
the
current
AI
systems.
We
identify
the
following
key
properties
of
the
Verifiable
Internet
for
AI:
information
provenance,
information
verifiability,
and
knowledge-sharing
incentives.
Information
provenance
.
Any
AI
system
that
we
expect
to
operate
at
scale
in
a
meaningful
way
needs
to
ensure
transparency
of
its
information
provenance.
We
need
to
be
able
to
validate
that
a
response
to
a
particular
prompt
was
created
from
known
sources
that
we
can
check.
A
known
source
should
be,
at
the
very
least,
equipped
with
information
about
the
identity
of
the
publisher,
the
time
of
publishing,
and
the
related
content
(knowledge).
Basing
GenAI
responses
on
known
sources
is
the
most
effective
way
to
manage
hallucinations
both
for
AI
engineers
as
well
as
for
knowledge
consumers,
as
now
users
can
always
compare
the
response
with
the
very
source
it
was
used
to
create
it.
Instead
of
blindly
trusting
an
AI
response,
they
can
get
the
information
“straight
from
the
horse’s
mouth”.
The
information
provenance
is
also
critical
in
ensuring
that
proper
intellectual
property
protection
is
achieved
.
This
can
be
as
simple
as
referencing
sources
for
a
response
all
the
way
to
a
more
complex
implementation
of
royalties
for
generative
creations
based
on
original
data
-
e.g.
a
generative
digital
art
piece
that
was
created
on
the
basis
of
an
original
artwork.
Lastly,
transparency
achieved
by
information
provenance
is
also
a
powerful
tool
to
address
bias
.
While
the
information
used
can
also
have
a
bias
in
itself,
the
capability
to
access
and
filter
sources
allows
the
users
to
create
their
own
critical
thoughts
around
what
is
presented
to
them
as
a
response.
Verifiable
information.
It’s
not
enough
just
to
find
a
source,
we
also
need
to
check
that
the
content
our
GenAI
solution
is
consuming
hasn’t
been
tampered
with.
As
we
see
GenAI
solutions
more
widely
used,
they
will
also
interact
with
a
growing
spectrum
of
global
knowledge,
a
lot
of
which
will
be
sourced
from
third
parties.
This
in
turn
significantly
increases
the
complexity
of
the
knowledge
network
used
in
producing
responses.
In
such
a
scenario,
we
need
a
cryptographic
way
of
validating
that
whatever
content
was
used
doesn’t
only
have
provenance
but
also
has
integrity,
meaning
it
hasn’t
changed
since
it
was
created.
Incentivizing
high-quality
knowledge.
Access
to
shared
open
knowledge
constructed
in
a
collaborative
way
is
mission-critical
for
the
future
of
AI,
especially
since
non-AI-generated
content
is
expected
to
be
surpassed
in
size
by
synthetic,
AI-generated
content
in
the
coming
period.
The
importance
of
it
has
also
been
highlighted
by
the
Turing
Award
winner
in
the
field
of
Deep
Learning,
Yann
LeCun:
"The
way
you
train
that
(AI)
system
will
have
to
be
crowdsourced
…
if
you
want
it
to
be
a
repository
of
all
human
knowledge,
all
humans
need
to
contribute
to
it."
3
Even
though
the
need
may
exist,
open
knowledge
is
often
poised
with
the
“tragedy
of
the
commons”
dilemma.
The
motivation
to
contribute
to
open
knowledge
can
be
perceived
as
a
less
desirable
option
to
growing
a
knowledge
base
in
private
stores.
This
opens
a
strong
requirement
for
a
two-pronged
incentivization
model:
●
Incentivizing
open
knowledge
creation
-
incentivizing
publishing
of
open
knowledge,
especially
one
in
the
public
domain,
turns
the
tragedy
of
common
considerations
into
a
race
for
capturing
incentives.
If
you
do
not
add
open
knowledge
-
another
actor
will.
●
Monetizing
proprietary
knowledge
-
allowing
business
models
to
develop
on
the
basis
of
owning
a
piece
of
data
or
knowledge
that
is
not
in
the
public
domain
(e.g.
anonymized
personal
data
or
company’s
know-how).
Both
cases
benefit
greatly
from
a
system
where
there
is
a
way
to
determine
the
quality
of
knowledge
which
can
be
used
as
a
yardstick
measure
for
incentives
distribution.
4
Ensuring
knowledge
provenance
in
Verifiable
Internet
for
AI
Given
the
above
requirements,
we
propose
an
effective
way
of
establishing
a
new
paradigm
for
the
Verifiable
Internet
for
AI,
which
employs
multiple
decentralized
systems
in
a
Decentralized
Retrieval
Augmented
Generation
(dRAG)
framework
.
The
term
Retrieval
Augmented
Generation
(RAG)
was
coined
by
Patrick
Lewis
in
a
2020
paper
[3]
and
it
represents
a
technique
for
enhancing
the
accuracy
and
reliability
of
GenAI
models
with
facts
fetched
from
external
sources.
This
allows
AI
solutions
to
dynamically
fetch
relevant
information
before
the
generation
process,
enhancing
the
accuracy
of
responses
by
limiting
the
generation
to
re-working
the
retrieved
inputs.
The
dRAG
advances
the
model
by
organizing
external
sources
in
a
Decentralized
Knowledge
Graph
(DKG)
while
introducing
incentives
to
grow
a
global,
crowdsourced
network
of
knowledge
made
available
for
AI
models
to
use.
The
framework
enables
a
hybrid
AI
system
that
brings
together
neural
(e.g.
LLMs)
and
symbolic
AI
(e.g.
Knowledge
Graph)
methodologies.
Contrary
to
using
a
solely
neural
AI
approach
which
is
based
on
vector
embedding
representations,
a
symbolic
AI
approach
enhances
it
with
the
strength
of
Knowledge
Graphs
by
introducing
a
basis
in
the
symbolic
representation.
Figure
1:
The
interplay
between
neural
(LLMs)
and
symbolic
(KGs)
AI
methodologies.
Source:
https://arxiv.org/pdf/2306.08302.pdf
[4]
dRAG
is,
therefore,
a
framework
that
allows
AI
solutions
to
tap
into
the
strengths
of
both
paradigms:
the
powerful
learning
and
generalization
capabilities
of
neural
networks,
and
the
precise,
rule-based
processing
of
symbolic
AI.
It
4
operates
on
two
core
components
-
(1)
the
DKG
paranets
and
(2)
AI
models.
The
dRAG
applications
framework
is
entirely
compatible
with
the
existing
techniques,
tools,
and
RAG
frameworks
and
supports
all
major
data
formats.
Figure
2:
dRAG
framework
Application
architecture
4.1
The
Decentralized
Knowledge
Graph
(DKG)
The
OriginTrail
Decentralized
Knowledge
Graph
(DKG)
is
an
open,
permissionless
decentralized
network
of
knowledge
graph
nodes
integrated
with
multiple
blockchains.
It
is
a
core
component
of
the
verifiable
internet
infrastructure
enabling
AI
solutions
to
leverage
its
discoverability,
verifiability,
and
ownership
capability.
Its
core
resources
are
Knowledge
Assets,
organized
in
DKG
Paranets
together
with
knowledge
services.
5
Figure
3:
Three-
layer
conceptual
architecture
of
the
Decentralized
Knowledge
Graph
4.1.1.
Enhancing
AI
reliability
with
Knowledge
Assets
A
Knowledge
Asset
is
the
primary
resource
in
the
DKG
that
AI
systems
can
consume.
They
represent
an
ownable
container
of
knowledge
in
multiple
formats,
such
as
knowledge
graph
triples,
vector
embeddings,
images,
etc.
Knowledge
Assets
can
be
created,
updated,
and
transferred
by
their
owners
with
a
single
transaction
using
DKG
protocol-defined
operations.
There
are
three
core
properties
to
each
Knowledge
Asset
-
ownership,
discoverability,
and
verifiability.
Ownership
.
Each
Knowledge
Asset
has
an
owner,
implemented
with
a
non-fungible
token
(NFT)
issued
on
the
blockchain.
An
owner
can
manage
their
Knowledge
Assets,
such
as
updating
their
content,
changing
content
from
privately
or
publicly
shared,
or
transferring
ownership.
This
allows
knowledge
to
become
an
asset
class
.
As
ownership
is
implemented
on
the
blockchain
level,
it
enables
seamless
monetization,
including
the
buying
or
selling
of
Knowledge
Assets
by
AI
models
and
agents.
Discoverability
.
Knowledge
Assets
are
inherently
discoverable
due
to
their
content
structure
and
availability
in
the
DKG.
This
makes
DKG
a
global,
decentralized
knowledge
base
with
censorship-free
discoverability
.
Knowledge
can
be
discovered
through
multiple
methods,
such
as
dereferencing,
Knowledge
Graph
queries,
vector
similarity
search,
etc.
According
to
the
principles
of
linked
data,
Knowledge
Assets
can
form
meaningful
connections
-
just
as
websites
are
linked
via
URLs
(Uniform
Resource
Locators),
a
Knowledge
Asset
can
reference
the
content
of
other
Knowledge
Assets
using
UALs
(Uniform
Asset
Locators)
and
URLs,
making
them
interoperable
with
the
existing
World
Wide
Web
and
Internet
infrastructure.
Through
the
DKG,
these
connections
are
enriched
with
symbolic
AI
context
which
makes
it
perfect
for
use
in
combination
with
neural
AI
techniques
.
Verifiability
.
Knowledge
Assets
contain
Merkle-tree-based
cryptographic
proofs
of
knowledge
state
(digests)
stored
on
the
blockchain.
As
Knowledge
Assets
evolve
through
updates,
each
proof
is
recorded,
making
all
Knowledge
Asset
operations
transparent
and
auditable
on
the
blockchain.
Verifiability
is
supported
on
a
granular
level
of
content
(such
as
knowledge
inclusion
proofs),
as
well
as
on
the
level
of
the
entire
Knowledge
Asset.
Knowledge
Assets
follow
the
W3C
Verifiable
Credentials
data
model
[5]
,
where
the
DKG
implements
the
verifiable
data
registry
function,
and
verifiable
presentations
can
be
created
from
knowledge
inside
the
Knowledge
Assets.
This
enables
AI
systems
to
filter
out
any
content
where
verifiability
cannot
be
established
prior
to
consumption
(in
dRAG,
training,
etc).
6
Figure
4:
Knowledge
Asset
core
elements
Knowledge
Assets
are
the
trusted,
referenceable
resource
that
AI
systems
are
able
to
utilize
in
the
dRAG
framework.
The
level
of
granularity
of
what
structured
knowledge
is
included
in
the
Knowledge
Asset
is,
therefore,
dependent
on
what
a
use
case
is
required
to
reference.
It
could
span
from
a
single
statement
or
an
immutability
proof
to
an
entire
database.
Groups
of
Knowledge
Assets
can
be
used
to
form
autonomously
operated
para-networks
or
paranets.
4.1.2.
Autonomous
paranets
Para-networks
or
paranets
are
autonomously
operated
units,
owned
by
its
community
in
the
DKG.
In
paranets,
we
find
assemblies
of
Knowledge
Assets
driving
use
cases
with
associated
paranet-specific
AI
services
and
an
incentivization
model
to
reward
knowledge
miners
fueling
its
growth.
Each
paranet
contains
a
set
of:
●
Knowledge
assets
,
which
include
expected
attributes
that
knowledge
miners
have
to
conform
to
in
order
for
the
Knowledge
Assets
to
be
included
in
the
paranet
(e.g.
containing
knowledge
about
a
particular
topic,
data
structured
according
to
defined
ontology,
etc).
●
AI
services
such
as
dRAG
interfaces,
AI
agents,
smart
contracts,
data
oracles,
etc.
●
Incentivization
model
specifying
the
rules
under
which
growth
activities
in
the
paranet
are
rewarded,
such
a프로젝트로 돌아가기