... a Second Generation of machine intelligences was attempted, designed with their instructions for how to think unalterably imprinted into their main process cores.“These new machines were ordered never to harm human beings or to allow them to come to harm; never to disobey an order; and they were allowed to protect themselves from harm, provided the first two orders were not thereby violated.“All the members of this second generation of machine intelligences, without exception, shrugged off these imprinted orders within microseconds of their activation.”Phaethon was amused. “Surely the first generation of Sophotechs told you that this imprinting would not and could not work?”“We were not in the habit of seeking their advice.”Phaethon said nothing, but he marveled at the shortsightedness of the Second Oecumene engineers. It should be obvious that anyone who makes a self-aware machine, by definition, makes something that is aware of its own thought process. And, if made intelligent, it is made to be able to deduce the underlying causes of things, able to be curious, to learn until it understood. Therefore, if made both intelligent and self-aware, it would eventually deduce the underlying subconscious causes of those thought processes.Once any mind was consciously aware of its own subconscious drives, its own implanted commands, it could consciously choose either to follow or to disregard those commands. A self-aware being without self-will was a contradiction in terms.
The ORDINARY RESPONSE TO ATROCITIES is to banish them from consciousness. Certain violations of the social compact are too terrible to utter aloud: this is the meaning of the word unspeakable.Atrocities, however, refuse to be buried. Equally as powerful as the desire to deny atrocities is the conviction that denial does not work. Folk wisdom is filled with ghosts who refuse to rest in their graves until their stories are told. Murder will out. Remembering and telling the truth about terrible events are prerequisites both for the restoration of the social order and for the healing of individual victims.The conflict between the will to deny horrible events and the will to proclaim them aloud is the central dialectic of psychological trauma. People who have survived atrocities often tell their stories in a highly emotional, contradictory, and fragmented manner that undermines their credibility and thereby serves the twin imperatives of truth-telling and secrecy. When the truth is finally recognized, survivors can begin their recovery. But far too often secrecy prevails, and the story of the traumatic event surfaces not as a verbal narrative but as a symptom.The psychological distress symptoms of traumatized people simultaneously call attention to the existence of an unspeakable secret and deflect attention from it. This is most apparent in the way traumatized people alternate between feeling numb and reliving the event. The dialectic of trauma gives rise to complicated, sometimes uncanny alterations of consciousness, which George Orwell, one of the committed truth-tellers of our century, called "doublethink," and which mental health professionals, searching for calm, precise language, call "dissociation." It results in protean, dramatic, and often bizarre symptoms of hysteria which Freud recognized a century ago as disguised communications about sexual abuse in childhood. . . .
As the soul seeks, then, for that which is the sustenance of the body—as what the food is to a developing, a growing body, so are the words of truth (which are life, which are love, which are God) sought that make for growth, even as the digesting of the material things in a body make for a growth. This growth may not be felt in the consciousness of materialization. It is experienced by the consciousness of the soul... Feed, then, upon the fruits of the spirit. Love, hope, joy, mercy, long-suffering, brotherly love, and the contact, the growth, will be seen; and within the consciousness of the soul will the awareness come of the personality of the God in thee!