In my previous article, PHYSINT: Physical Is Digital, I explored the possibility that the name represents a world where the distinction between physical and digital has effectively disappeared.
Taking that idea a step further, we can consider how this convergence might extend into the way we experience and interact with the world. There are three main layers to consider: the invisible intersection of physical and digital, augmented reality, and virtual reality.
The first layer is the integration of functionality into physical objects and environments. This is like modern technology, where we can physically interact with the digital domain to some extent. TVs, lights, and phones, via buttons, switches, knobs, and levers.
The next is digital identity and ownership. Each object's digital twin is linked to your twin, which is limited to you and your assigned guest.
Physical items have their own digital identity that establishes ownership, authenticity, access, control, and history. This similarly mirrors a person's medical records, condition, and past repairs or updates. This extends from personal belongings and clothing to vehicles, appliances, and entire buildings. In a way, everything becomes smart in some form.
Smart textiles change color, appearance, or other functionality through digital control. Smart homes already demonstrate how lighting, temperature, and other environmental features can be controlled and automated. More advanced systems extend this to wall colors, flooring, furniture, and even architectural elements that physically shift or reconfigure themselves.
Much of this functionality operates in the background, managed by connected systems. The physical object remains, but its properties and capabilities are digitally controlled.
The digital layer becomes an intrinsic part of the physical environment, whether it's visible or not.
Augmented Reality: Two Ways of Seeing
Augmented reality (AR) makes this invisible digital layer visible.
The familiar approach involves holographic interfaces, icons, and information panels overlaid onto the physical environment. Digital objects appear alongside physical ones, allowing us to access information and interact with them directly. This is already an established concept in technology, video games, and sci-fi.
There's also the possibility of experiencing this information through the perception of our digital twin.
Rather than displaying everything through conventional holographic interfaces designed around human perception, AR could represent information according to how our digital twin interprets it. This could produce an entirely different visual language and change how we perceive the physical environment.
It would create different interpretations of the same AR digital space and information.
Someone could hide using AR holograms as cover and camouflage, either by using existing ones or creating their own locally. This would only hide them from individuals who are viewing the world with AR enabled.
AR digital overlays could reveal someone's presence or identity, potentially exposing information that would otherwise remain concealed, even when hiding behind real-world cover.
This would create two aesthetics, where you would have more of a dark noir, AR-off vibe and a bright, holographic AR cyberpunk/Blade Runner Las Vegas in the same spaces.
Virtual Reality: Entering the Digital Domain
Virtual reality (VR) allows us to enter a fully digital environment. There are two distinct approaches to consider.
Human-Oriented Environments
The first is a virtual operating system or digital environment designed around human perception. Information, code, and objects are represented in familiar spatial forms, almost like entering a video game. We can navigate the environment and interact with digital information in ways that make sense to our human senses.
Digital-Twin Perception
The second possibility is something we mentioned earlier with AR, but in VR, Instead of designing the digital environment around human perception, the digital twin could develop its own way of seeing, understanding, and navigating digital information. These senses would evolve via AI developing its own senses inside its pre-mordial soup of its digital domain.
This is the more speculative aspect of the idea: experiencing a digital environment through a visual language and sensory system that evolved independently of human perception.
Learning to See
Experiencing the digital world through our digital twin could initially be overwhelming. Its perception might expose us to more information and relationships than we're accustomed to processing.
There could be a limitation on how much of this information we're able to experience at once, with access gradually expanding as we become accustomed to it. Alternatively, the full sensory experience could be available from the beginning, leaving us to learn how to interpret it.
The distinction is that we're no longer simply looking at digital information through an interface designed for humans.
Another notion is that, because we're inhabiting those senses, we instantly have a full understanding of their context. This could be explained via dialogue. However, it would be a little tricky to have a player or viewer experience this same understanding.
The story might need to add a dissociative effect, possibly where Bill is experiencing themselves seeing the digital domain as nonsense and as fully understandable at the same time, but those two parts of themselves don't seem to share the same experience. So, in that situation, Bill experiences a dissociative duplication or echo.
This could be rendered as two people talking over each other, where one is saying, "Yes, I can understand it," and the other is saying, "No." But they're relatively in sync with each other, with only certain parts of what's being said being understood by one and causing confusion in the other.
This notion of understanding and confusion would allow the in-game character who understands to walk the player, whose POV is that of the individual who doesn't understand, through this type of space.
This type of space could then become whatever the developers want. It could be complete insanity, and they could have anything rendered or happen. It would basically become a gimmick space. As a gameplay element, I'm not sure how fun that would be.
However, with that notion, they could add some type of slow integration, like the idea mentioned above. As the player starts seeing things that are somewhat familiar, we could use that to gamify the experience and render some form of understanding.
On the notion of making some of this a reality, it would be kind of intriguing to get real artificial intelligence to try to create and simulate senses and show us what that would look like. We could then use that as the basis of the digital domain. Though, if they don't already have these senses, this could potentially be dangerous. It might be better to have AI just hypothesize rather than be accurate. If I were to render it would probably be experienced, like some kind of an static moire effect.
BROADCASTED MATTER
There was another notion that I'd probably like to bring up here. I'm probably eventually going to go into more detail with this, dealing with my version of what I think Death Stranding should have been. At some point, if I'm able, I'll probably make a game around it too.
One notion is that, instead of printing infrastructure, we have it actually being physically broadcasted.
This would be based around a couple of different notions. One is the easiest to understand: just a hard-light hologram. The other is a little more interesting, involving a real object being broadcasted into multiple locations, where it experiences the compounded damage of all of them. This is basically taking parent-child duplication, which happens in digital engines, and making it something that can be used in real life.
The other notion is similar, but the object itself doesn't actually receive the damage. Instead, the objects that are triangulating a space to generate the broadcasted object might be vulnerable to damage. However, that's only the case if they aren't also being broadcasted to some level themselves.
There would probably have to be some infrastructure that could be damaged and would need to be maintained, primarily protecting the broadcasters that hold the parent object.
Another notion on top of that, though, is that the parent object could technically be made up of smaller broadcasted pieces, which adds another wrinkle.
But yeah, if this were also added on top of the other things I've mentioned, that would add an even more interesting layer to the idea. The infrastructure that people are living in might literally be physically digital or digitally physical, depending on how you're looking at it and which version of this concept you use. There could definitely be some interesting gameplay elements involving a world built from this type of technology, not to mention building your own structures, like in Death Stranding.
Of course, these are speculative possibilities, and there's no confirmation that PHYSINT will explore any of them. But if the underlying idea is that physical and digital have become inseparable, this provides another way of considering what that world might look like and how we might experience it.
The familiar approach involves holographic interfaces, icons, and information panels overlaid onto the physical environment. Digital objects appear alongside physical ones, allowing us to access information and interact with them directly. This is already an established concept in technology, video games, and sci-fi.
There's also the possibility of experiencing this information through the perception of our digital twin.
Rather than displaying everything through conventional holographic interfaces designed around human perception, AR could represent information according to how our digital twin interprets it. This could produce an entirely different visual language and change how we perceive the physical environment.
It would create different interpretations of the same AR digital space and information.
Someone could hide using AR holograms as cover and camouflage, either by using existing ones or creating their own locally. This would only hide them from individuals who are viewing the world with AR enabled.
AR digital overlays could reveal someone's presence or identity, potentially exposing information that would otherwise remain concealed, even when hiding behind real-world cover.
This would create two aesthetics, where you would have more of a dark noir, AR-off vibe and a bright, holographic AR cyberpunk/Blade Runner Las Vegas in the same spaces.
Virtual Reality: Entering the Digital Domain
Virtual reality (VR) allows us to enter a fully digital environment. There are two distinct approaches to consider.
Human-Oriented Environments
The first is a virtual operating system or digital environment designed around human perception. Information, code, and objects are represented in familiar spatial forms, almost like entering a video game. We can navigate the environment and interact with digital information in ways that make sense to our human senses.
Digital-Twin Perception
The second possibility is something we mentioned earlier with AR, but in VR, Instead of designing the digital environment around human perception, the digital twin could develop its own way of seeing, understanding, and navigating digital information. These senses would evolve via AI developing its own senses inside its pre-mordial soup of its digital domain.
This is the more speculative aspect of the idea: experiencing a digital environment through a visual language and sensory system that evolved independently of human perception.
Learning to See
Experiencing the digital world through our digital twin could initially be overwhelming. Its perception might expose us to more information and relationships than we're accustomed to processing.
There could be a limitation on how much of this information we're able to experience at once, with access gradually expanding as we become accustomed to it. Alternatively, the full sensory experience could be available from the beginning, leaving us to learn how to interpret it.
The distinction is that we're no longer simply looking at digital information through an interface designed for humans.
Another notion is that, because we're inhabiting those senses, we instantly have a full understanding of their context. This could be explained via dialogue. However, it would be a little tricky to have a player or viewer experience this same understanding.
The story might need to add a dissociative effect, possibly where Bill is experiencing themselves seeing the digital domain as nonsense and as fully understandable at the same time, but those two parts of themselves don't seem to share the same experience. So, in that situation, Bill experiences a dissociative duplication or echo.
This could be rendered as two people talking over each other, where one is saying, "Yes, I can understand it," and the other is saying, "No." But they're relatively in sync with each other, with only certain parts of what's being said being understood by one and causing confusion in the other.
This notion of understanding and confusion would allow the in-game character who understands to walk the player, whose POV is that of the individual who doesn't understand, through this type of space.
This type of space could then become whatever the developers want. It could be complete insanity, and they could have anything rendered or happen. It would basically become a gimmick space. As a gameplay element, I'm not sure how fun that would be.
However, with that notion, they could add some type of slow integration, like the idea mentioned above. As the player starts seeing things that are somewhat familiar, we could use that to gamify the experience and render some form of understanding.
On the notion of making some of this a reality, it would be kind of intriguing to get real artificial intelligence to try to create and simulate senses and show us what that would look like. We could then use that as the basis of the digital domain. Though, if they don't already have these senses, this could potentially be dangerous. It might be better to have AI just hypothesize rather than be accurate. If I were to render it would probably be experienced, like some kind of an static moire effect.
BROADCASTED MATTER
There was another notion that I'd probably like to bring up here. I'm probably eventually going to go into more detail with this, dealing with my version of what I think Death Stranding should have been. At some point, if I'm able, I'll probably make a game around it too.
One notion is that, instead of printing infrastructure, we have it actually being physically broadcasted.
This would be based around a couple of different notions. One is the easiest to understand: just a hard-light hologram. The other is a little more interesting, involving a real object being broadcasted into multiple locations, where it experiences the compounded damage of all of them. This is basically taking parent-child duplication, which happens in digital engines, and making it something that can be used in real life.
The other notion is similar, but the object itself doesn't actually receive the damage. Instead, the objects that are triangulating a space to generate the broadcasted object might be vulnerable to damage. However, that's only the case if they aren't also being broadcasted to some level themselves.
There would probably have to be some infrastructure that could be damaged and would need to be maintained, primarily protecting the broadcasters that hold the parent object.
Another notion on top of that, though, is that the parent object could technically be made up of smaller broadcasted pieces, which adds another wrinkle.
But yeah, if this were also added on top of the other things I've mentioned, that would add an even more interesting layer to the idea. The infrastructure that people are living in might literally be physically digital or digitally physical, depending on how you're looking at it and which version of this concept you use. There could definitely be some interesting gameplay elements involving a world built from this type of technology, not to mention building your own structures, like in Death Stranding.
Of course, these are speculative possibilities, and there's no confirmation that PHYSINT will explore any of them. But if the underlying idea is that physical and digital have become inseparable, this provides another way of considering what that world might look like and how we might experience it.
Release on 11•11•26
No comments:
Post a Comment