1
$\begingroup$

This question already has an answer here:

If an A.I. system ( 'housed' in a Robotic exterior) actually passed the Turing test and was therefore 'functionally similar to the human 'mind-brain' would it also have the potential for information processing instability analogous to 'mental' problems in the mind-brain. ( Where the instabilities are not just because of information or important-definitions mismanagement but are also from info.-processing mismanagement.) Could one A.I system test another with the Turing Test and regard the other as an 'unstable', human , if the responses were sufficiently 'unstable' sounding? Could an A.I. system pretend through the Turing Test to be 'stupid' to another A.I. system?

$\endgroup$

marked as duplicate by Chuck Sherrington, jona, theMayer, Steven Jeuris Nov 26 '14 at 13:30

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

  • 1
    $\begingroup$ @James sorry, that's my fault, he posted it as a comment before and I thought it sounded different enough for a new question. My bad. Apparently, him and I are still learning how to use this website. $\endgroup$ – Seanny123 Oct 3 '14 at 13:07
  • 1
    $\begingroup$ @Seanny123 No harm, no foul. You can incorporate any of the changes you want into the other question. $\endgroup$ – Chuck Sherrington Oct 4 '14 at 9:11
0
$\begingroup$

Mental disorders, which are fundamentally undesirable phenomena, can be both environmentally and innately caused. There are both neurological components as well as environmental components almost exclusively sourcing from childhood.

In the same way, a "thinking machine" can have the same undesirable problems. I imagine the "neurological problems" would be tantamount to bugs in the original software and hardware malfunctions. Much more common would be the environmental causes, similarly in the AI's "childhood".

Human childhood is a very impressionable time. Love and proper care leads to healthy growth, proper perspectives of safety and danger, proper priorities leading to healthy adult human lives. Abuse and neglect lead to psychological malformations such as unhealthy concepts of danger, of self, of the meaning of love and family, etc.

Similarly, AI "childhood" will be the beginning period of discovery and learning (which may happen in R&D labs, rather than the real world, depending on the circumstances). While it's difficult to say what might cause malformations, it's safe to assume that improper training of the AI, just like improper raising of a human child, will result in odd, unpredictable, and undesired behavior.

As a note, this is all technically true for AI less sophisticated than "thinking", but the simpler it is, the easier it is to properly train and prevent hardware and fundamental software errors. For example, an AI that identifies pictures would show unpredictable and undesirable behavior if, for some reason, it was trained randomly (say, by using crowd-sourced training and being the victim of trolling). A 'thinking' AI would likewise have undesirable results if it were "abused" or never taught the value of, say, life. One, in that case, might easily end up with a "sociopathic" AI.

$\endgroup$
  • $\begingroup$ Very interesting analysis. You mention 'bugs' in the programming and hardware problems and 'environmental' concerns ,and maybe bugs and viruses and malware from the internet; all helping to cause system problems in an A.I. 'childhood'. The thing is could a 'young' A.I. system have no bugs or malware or hardware problems ; in other words a stable set of system processes yet develope instability from STABLE programs and their usage. And if an A.I. system is really the ONLY 'thing' programming itself it could be unstable in terms of 'internal logic' and program itself badly. $\endgroup$ – user128932 Oct 5 '14 at 5:05
  • $\begingroup$ There could easily be some fatal flaw in either the original coding, the hardware for the AI, or the original training. The former two would be akin to a genetic predisposition for a mental disorder while the latter would be akin to a learned or acquired disorder. But all are definitely possible. Note that we're speaking of "thinking" AI, which is orders of magnitude more sophisticated than what we currently achieve. $\endgroup$ – Attackfarm Oct 6 '14 at 8:02
  • $\begingroup$ If an A.I system is 'set-up' so it can program itself and NEVER need any info. or 'programming' from outside itself or from programmers this would be a 'thinking' A.I. which would be many orders of magnitude more sophisticated. All this might require is'getting' the A.I. system to be able to program itself.( without ANY outside help) $\endgroup$ – user128932 Oct 6 '14 at 19:38
  • $\begingroup$ If an A.I. system is 'designed' and running with no present flaws whatsoever , could it develope system instabilities just from how it manipulates its own processes. $\endgroup$ – user128932 Oct 6 '14 at 19:46
  • $\begingroup$ The closest technology we have to a "thinking machine" is a neural network. This is a tech that, while not needing explicit "programming", still needs training. This is sourced from either data sets, environmental variables, or more intelligent agents (e.g. humans). If these sources of training were flawed in some way, problems could easily develop. This is similar to the "training" of human childhood being filled with unhealthy variables such as neglect and abuse, which result in undesired (but initially useful) mechanisms of thought, emotion, and behavior $\endgroup$ – Attackfarm Oct 7 '14 at 7:04

Not the answer you're looking for? Browse other questions tagged or ask your own question.