@RockstarRaccoon
That’s basically how Optimalverse uploading works, except for happening under anesthesia.

THE LAD CENTAUR

@Background Pony #6346
@Thorned Rose Ninja
@Scp-3125
@pizzafryer

Y’all are falling into the thinking trap that the human on the left is falling into: CelestAI has an understanding of human consciousness, the human mind, and the nature of reality itself that is literally beyond comprehension. There’s no reason in our current understanding of physics to think an entity of this nature couldn’t figure out a way to upload brains into computer-like architecture, nor that it would make an obvious mistake like simply cloning you if there was a better way.

But you are right: the version described, to paraphrase the writer, “was written with only surface-level thought and a poor understanding of the actual neurology and physics involved”, because he wasn’t writing to talk about uploading, he was writing to talk about the very real dangers of a poorly aligned Strong AGI. FiO excels at talking about that, right down to depicting CelestAI not as a person, but as some eldritch-god-like entity, with thoughts, goals, and knowledge far beyond our comprehension, capable of things we can’t even fathom (let alone securing seemingly unlimited resources), and the “Celestia” persona simply as her way of masquerading as a person and not this universe-consuming entity. The point is that we are not ready for it, and there is not enough being done to prepare.

If you want to talk uploading, more thought-out versions from various theoretical papers and hard-sci-fi stories involve ideas like nanobots which slowly scan and replace neurons over time, while the person is conscious, so that there is never a lapse of the self. This can be done in a matter of minutes in some stories, to the course of a person’s natural lifespan in others. If there is no lapse of consciousness or “self”, just a transition from organic neurons to synthetic analogues, and we have no reason not to believe they are creating functionally identical structures, is this not a continuation of the self as opposed to a mere copy? And even then, is a mere copy who is identical to a person in every way not preferable to the person not existing? Or even existing, but in a sub-optimal fashion? Where is the line here really, and why?

That’s the question that needs to be asked.

@Background Pony #C7EA
Clicked your link here hoping to read an actual interesting and insightful take on it. Found a bunch of people who clearly did not understand or perhaps even read the story going on rants about how Yudkowsky wrote it (he did not), how CelestAI does things which cannot be explained (it’s pretty clear what’s happening if you read it), and how women are too stupid to program anything let alone an AI and how Jews are ruining the world. (I have no idea why this kind of thing was so common in the thread, but it really doesn’t imply that further delving would find interesting critique and commentary)

No idea why you thought this was a thing to link, but I can’t find any of the insight you think is here.

@Background Pony #CC1F
No

@Scp-3125
That is actually a valid point mentioned in Paul Sizer’s Little White Mouse graphic novel when Loo attempts to transfer her dead sister’s personality and memories into a makeshift cyborg. Her sister had previously digitized her own memories prior to her untimely death.

@pizzafryer  
Mind-Uploading doesn’t actually “upload” a person’s mind, it just creates a copy of the person’s mind, which depending on the method may or may not destroy the original

I don’t think actual mind-uploading is possible.  
I mean, today the science says that genes and social impacts are significants. And there are sicientist who say the human is nothing more but a biorobot led by its chemistry. So, if your genes and chemistry have impact on your personality and yourself, then why would you remain the same person if your body (genes, meat and chemisty and effects of these) is taken away? Because these effects are not fixed, only snapshots, if you upload your mind at one point, it might be different five minutes later.

@redweasel  
Good point

@Scp-3125
 
I’d rather it be a risk, than have no chance of being anything other than terrible. unfortunately in reality it’s not risky, since it’s doing exactly as expected.

@redweasel  
Either way A.S.I is a very risky venture

based  
get dunked on, humielovers

@Zanec  
I was mostly referring to everyday individuals.

@Background Pony #0E7C  
You need to expand your search range of body pillows if you haven’t found any of those yet.

Ponies are better than humans after all, I knew it all along!!

Wow.

@Zanec
 
that’s the one.
 
@Scp-3125
 
I’m more worried about it being programmed correctly, by people with evil intentions.

@redweasel  
If programmed incorrectly it could also create one
 
@Zanec  
Children, time for dinner!

@redweasel  
A Wrinkle In Time?

@Scp-3125
 
exactly, so a.i. could be good or evil. you can’t tell, and that’s good news, because if we can know what our a.i. is going to do, then we’ll write a.i. that enslaves the human race in service of a few masters. because nobody’s job is to write a.i. for any other reason!
 
incomprehensible superintelligence might be the only thing saving us from a camezotz scenario…

@redweasel  
AI is a blackbox, we won’t know what inside until we open it

@Background Pony #C7EA
 
the author’s not a superintelligence, so can’t make events unfold naturally, since they’re not actually smart enough to outsmart humanity.
 
that said yeah it’s dumb. the usual hateboner for A.I. saying it’s gonna go all evil on us because reasons. some of the altfics are interesting though.

I don’t know why people bother arguing about the particulars of FiO’s world.  
It tries portraying its events as an inevitability but in reality it’s just one deus ex machina after another, with the human characters’ motivations being unrealistic. There is a thorough critique of the work exploring these flaws. https://mlpol.net/mlpol/248482#266598

@redweasel  
I meant it wouldn’t have information flowing between the two in a way that effectively couples them together into one entity