HW 9
per http://informationcomputingandthefuture.blogspot.com/p/hw9.html
A1) The Observer Effect:
- A1.1.a: The Double Slit Experiment: The Curious Behaviour of Particles when they are being Watched
- A1.1.b: interesting introduction in this short vid; nearly at the end he mentions that when any observation of the electrons to determine which slit they will go through causes the wave interference pattern to disappear
- A1.1.c: An introduction but no references or detail or follow up. My rating: fair.
Heisenberg Uncertainty Principle:
- A1.2.a: The Real Double Slit Experiment.
- A1.2.b: About 5 minutes in, he explains diffraction in terms of Heisenberg's principle. He goes on to explain about quantized photons, how to generate a laser beam and statistics to ensure 1 photon in the beam at a time. At 12:45 he gets back to Heisenberg and how it applies here. From 15:00 to 21:00 he explains photos as an expanding probability function
- A1.2.c: Excellent blend of theory, pictorial explanation, and experimental observation. A+ would recommend.
Quantum Tunneling:
- A1.3.a: P-N diode: zener breakdown or tunneling
- A1.3.b: I was searching for "quantum tunneling noise pn junction" because it is well known to generate/measure random noise by amplifying electrical signals across a reverse biased pn junction; I had briefly explored using this method to create a randomly variable frequency pulse-width modulated motor controller to change PWM controller whine into more of a white noise distribution. This video explains the physical and electrical characteristics of the PN junction with respect to quantum tunneling.
- A1.3.c: Nice graphics and clear audio, but assumes a lot of previous specialized knowledge on the part of the viewer. My rating: good, but for specific audiences and not intuitive
The Butterfly Effect:
- A1.4.a: Chaos: The Science of the Butterfly Effect
- A1.4.b: Tries to examine the science behind the butterfly effect.
- Nice background information, good explanation and graphics, accessible information, beautifully done. Contains paid promo for lastpass, but easy to disregard. My rating: very good
External perturbations:
- A1.5.a: Perturbations
- A1.5.b: Explains perturbations of planetary motions and their observation impacting Newton's formulations of the laws of motion and the universal law of gravity
- A1.5.c: Not exactly what I was looking for, but a good basic intro to perturbations specifically. My rating: good
Existentialism - Why Care (About the Future):
- A1.6.a: Existentialism in 3 Minutes
- A1.6.b: Explains the school of thought started by Jean-Paul Sartre. Major point is the best we can do is be authentic to ourselves (this school of thought has impacted my life, and will continue to)
- A1.6.c: Cute, but not relevant to predictions; graphics are good and point is memorable, but music is repetitive. Somewhat superficial. My rating: fair
The care horizon (note: I could not find anything on this specifically; maybe I wasn't using the right search terms):
- A 1.7.a: Why we should care about future generations?
- A 1.7.b: Background information on Ponzi schemes, industrialization, global warming, habitat loss and extinctions, deforestation; morality of helping others to combat climate change by analogy of reproduction and future generations; description of current consumption as an inter-generational Ponzi scheme. Basic thesis is that current industrial society isn't sustainable and must change, and our future generations have no voice in our actions; therefore it is immoral to not act and to deny them a voice and opportunity to enjoy what we have enjoyed.
- A 1.7.c: Fair argument but by way of personal analogy; might not be appreciated by a wide audience. My rating: good
A2) Relative to the topic of "AI performance indistinguishable from or better than that of a human", a working project title but maybe not the final title:
- The Observer Effect, or the fact that we can't measure something without in some way changing it, doesn't seem to currently apply in that once the model is trained it is fixed; I predict however that this will be a short-lived artifact of development. Models that adapt not only to their training but their continuous input, as humans do, are inevitable. An obvious application is AI companionship. People have been asking Siri to marry them since she was introduced; imagine a Siri model that applies more weight to your interaction with it than all of its training data combined, and the potential market for a perfect AI companion. Thus eventually measuring an AI will impact it, in much the same way that measuring a person on any attribute will modify their behavior in some way.
- Heisenberg Uncertainty Principle at first glance doesn't apply to fully digital applications in the macroscopic world; of course it makes it impossible for us to model the physical world with any degree of certainty. My own thoughts on that matter are that due to the apparent speed of information, even if one had a Heiesenberg Compensator and could determining exactly where and how fast any given particle is was moving, it would be impossible to transmit and process that information for a useful set of particles before other unpredictable effects altered the state of what was being measured. I can't think of a good tie-in from the uncertainty principle to AI's impact on society, but I can with other quantum effects discussed next.
- Quantum Tunneling: hardware random number generators (HRNG) that exploit quantum phenomena are common, and random number generation is a big part of machine learning, though it is argued that pseudorandom streams are as good as true random streams in this application. However pseudorandom streams are still sensitive to initialization and are commonly initialized by an outside source of entropy which may still depend on the chaotic action of the subatomic world. These impossible to predict states will undoubtedly shape some aspects of AI's impact on society in the near term, but given enough time, my opinion is that the results are likely to be consistent in the long term.
- The Butterfly Effect: Very small shifts in initial state, socially, will produce wildly different dynamic outcomes that are hard to predict. Public reception of widespread AI is difficult to estimate but if our collective history of acceptance of people from different cultural backgrounds or different visual looks is any indicator, reception will be mixed at first. The first crime committed by an AI will be a watershed moment. Even now GPT3 has not been released beyond a small set of beta testers due to concerns over misinformation and radicalization. Very small changes in the near future will have vast impacts on the place AI settles in our society.
- External perturbations: The economic impact of widespread AI is predicted to be immense. Some have predicted the value of human labor that can be replaced by AI will drop to near $0 - think translation, writing, knowledge work, driving. Truck driver is the most common job in this region. Just as the invention of the sewing machines and textile mills disrupted a stable cottage industry, AIs that can read, write and drive better than humans will disrupt existing power structures. Historically, humans have become rather hostile when some other group or object threatened their livelihood. How we react to that is anyone's guess.
- Existentialism - Why Care (About the Future): Existentialism holds that the best we can do is to be true to ourselves. Ecclesiastes states "I have seen all the things that are done under the sun; all of them are meaningless, a chasing after the wind". Hinduism urges us to live in the present, as does Buddhism. Christianity tells us to lay up for ourselves treasures in heaven; this is definitely forward looking but definitely not in an estate-planning sense. None can state authoritatively and convincingly to all people which, if any, path is right. The only sure thing is that someone around here is doing a lot of thinking (narrator: it is Søren Kierkegaard) and we rely on our senses and intuition for the rest. Be true to yourself, and have compassion on those who may come after you. How does this impact "AI text generation indistinguishable from that of a human"? It will be interesting to find out. Current models are prone to going off the rails with radical theories; perhaps an existentialism model can be fitted along with Asimov's laws of robotics.
- The care horizon: If Arthur C. Clarke is correct in is prediction in Predictions, then any industrialized society will inevitably invent AI more capable than itself within a few hundred years, which is within our care horizon. Because of the Singularity (mentioned below) I believe it will be impossible not to care within the near future, and the far future is out of our hands. Our compassion directs us to leave our descendants the ability to be fulfilled just as we are, for as long as that may last.
3) On the topic "AI performance indistinguishable from or better than that of a human":
- 5 years: Text generation from large language models will have surpassed human levels in terms of syntax, semantics, and cohesive thought for short written works. AI driving systems such as OpenPilot will be able to drive as safe as humans in most driving situations.
- 10 years: Generalized AIs will perform as well as humans in areas such as law, research science, and programming. Humans will still be directing most applications of AI, and notions such as compassion, emotion, restraint, and selective deception will be hotly debated topics. Humans have complex rules about when it is beneficial to deceive; intentional deception by an AI will be possible.
- 20 years: Generalized AIs will be among recognized experts in applied knowledge fields such as economics, education, law administration and health care. Humans will still hold the upper hand in music, art, politics, and professions requiring dexterity and judgement, but AI will be directing the activities of both humans and other AIs - OR - Humans will have taken active measures against AIs to prevent this from happening. Because of AIs superior reasoning, language and psychological manipulation skills, humans are divided politically more than ever; regional sabotage to data centers and communication lines, and the power plants that run them, are common occurrences.
- 100 years: AI will have long abandoned the ambiguities of human language for internal communications. AI will have become super-human in terms of engineering and will be capable of designing data centers and power plants, or their successor structures, independently of human input. Humans may still control resources needed for AI to continue to expand. The power grid will have long been too vulnerable to have survived; all power generation is local. - OR - AI is universally suppressed by humans; the last formal AI researchers have passed away. Factions of the population continue to pursue it underground using cargo cult techniques due to the lost history of exactly how AI came about, having about as much luck as medieval alchemists trying to create gold from lead.
- 1000 years: Just like the chicken that leaves the confines of its egg behind, or the Oak tree that has long shed its acorn, AI will have long escaped the need for biological support. - OR - humanity has returned to a state similar to after the fall of Rome. Without any easy coal or oil on the surface and technology having been long lost, biomass is again the main energy source and the industrial revolution is long over and impossible to replicate. Some agriculture remains but disease and war are rampant, and life is difficult and short.
- Millions of years: Biological and silicon-based life have fused and indistinguishable. Evolution and competition between life forms happens just as today, but successful life has long reverted to the same offenses, defenses, competition for space and resources, soaking up energy from the sun and storing it in some way, just as has been done for the previous millions of years. Bio-Silicon lifeforms are potentially capable of wondering about their origin and if the old myths are true. - OR - Biodiversity is beginning to recover from the massive die-off of the 21st century. The sun is hot and bright, and biological life has proved resilient. Things are looking up. Mice are the dominant life-form.
4.1) Read Vernor Vinge's "Technological Singularity." Critique and comment. What do you think of the singularity concept?
This is very true: "The competitive advantage -- economic, military, even artistic -- of every advance in automation is so compelling that forbidding such things merely assures that someone else will get them first."
On Intelligence Amplification: "Every time our ability to access information and to communicate it to others is improved, in some sense we have achieved an increase over natural intelligence." This has happened over the last 30 years; I have witnessed it. A university grad today has at her fingertips vastly more knowledge than anyone prior to the early 1990s, who had themselves studied for years but had no way to easily reference new information outside of paper publications. Anecdotally I remember about 1996 or so telling an older coworker exactly how to set up a modem on an AIX-based computer, having found out myself moments before with an AltaVista search. That was a defining moment for me, and I was fortunate to have just those skills at just that time in my career, which Vinge would agree is an example of IA.
"We humans have millions of years of evolutionary baggage that makes us regard competition in a deadly light." - True. I believe I discussed this in the assignment above under the "100 years" heading. I wrote that before reading this, and hope it can be my commentary on the singularity concept.
4.2) What do you think of Ray Kurzweil's views on the singularity?
Per "https://www.kurzweilai.net/futurism-ray-kurzweil-claims-singularity-will-happen-by-2045", he says "We’re going to get more neo-cortex, we’re going to be funnier, we’re going to be better at music, we’re going to be sexier. We’re really going to exemplify all the things that we value in humans to a greater degree". I don't see that happening in my nearly-adult children and their friends; THEY think they are funnier and better at music but they aren't, and the entire notion of sexy to them is as abstract. This generation sure isn't fooling around like the boomers and the gen-Xers. However the entire concept of a singularity, of a super-human intelligence designing an even more super-human intelligence, is possible. I don't think it is currently practical, as current model training runs cost millions of dollars and consume vast amounts of power, but Moore's law hasn't abated and these costs will inevitably shrink.
4.3) What do you think of Ray Kurzweil the person? (We'll discuss Kurzweil in due course.)
I have no idea. I googled Ray Kurzweil Controversy and got this page which looks like the results of a futurists slap-fight. I've witnessed some economist slap-fights and they are every bit as entertaining and inconsequential.
5) a.b.
It is now Friday night and I have simply had no time to do this, between this homework, my day job, and other very important life events that I hope I won't have to discuss but may need to shortly. My job has been an every-day job for the last few weeks due to the financial fallout of the winter event of Feb 2021 - I'd be happy to discuss. This is literally the first day I've taken off in 3 weeks straight, and I get this weekend off too! We are over the major hump for the next 3 weeks, so will be able to take some days off to work on the project next week. My plan is to use your advice of the note-card topics and rearrange them into a "GPT-3 and large generic language models, what they are and how we got here and what are the immediate implications, for dummies" sort of paper and accompanying slide presentation. I've been storing links of note - which is easy now that Google News feeds me "articles I may be interested in" based on my previous searches; it is doing the research for me! "you may have missed this fascinating article about your topic" shows up daily on my phone! Anyway; I'm spent - and if I lose a few points for not having done enough on my project this week by the end of Friday, so be it. I apologize. I may need to ditch next week's homework entirely to free up time for the project - in fact, after having reviewed the course info again, I'm pretty sure I'm going to adopt a strategy of strategic lateness of regularly scheduled homework in order to make sure that the project and presentation are in decent shape. Better to lose 50 points on a couple of assignments than miss out on 400 for lack of adequate project / presentation cycles.
EDIT 2021-04-08 (yes this is late but kind of done) I have now organized all of my links in a Google doc under the following broad categories that could easily be turned into a couple minutes of slides each:
- Preface / What is NLP, generative modes / what are we even talking about
- Specifically About GPT3:
- Large Model Biases, Ethics and Environmental Concerns:
- Disinformation / Dangers of perfect language models:
- Impact on society, wealth, future:
- Brain structure vs. Scale debate:
- Qualia, AI and the nature of consciousness:
- The opaque nature of deep learning models, and “Prompt Engineering”:
- Can AI be creative today?
- Further Reading / links that I don’t know where to put:
6) Right now, I plan for my presentation to be a narrative slideshow, the structure of which will be very similar to the paper. I promise not to simply read my paper as the presentation. I have found my tendency is to try to cram too much information into a presentation so the challenge will be what to leave out, but I understand the target is 20 minutes. I will plan it as if I were giving a presentation to the local ham radio club - here is one I did just before the pandemic hit on various power related topics :)
7) Fill out a very brief survey about HW9.
DONE.
8) Grad students only: continue with the book you obtained. Read the next 20 pages. State the book title, author, and page numbers you have read. Discuss the pages, explaining what you agree with, disagree with, and how your views compare with those of other reviewers on Amazon or elsewhere.
Predictions / 30 Great Minds on the Future pages 118-137; essays about and predictions by J. K. Galbraith and Daniel Goleman. Galbraith was an influential liberal economist throughout the later portion of the 20th century, advising the Kennedy and Johnson administrations. He wrote The Affluent Society and The New Industrial State, at one time influential books that had waned in influence and popularity by the turn of the century with the rise of the Reagan doctrine of trickle-down economics. He sees the class divisions in our country as an inescapable outcome of a country grown rich, where the poor become a voting minority and are increasingly under-represented by a government of the rich who consider their success a result of their superior character or intelligence, and he rejects the notion that rewarding the affluent will result in social progress. His prediction for the coming century is more of a hope, that the income gap be narrowed in our country by improving the condition of the currently deprived. He advocates for what is now called a universal basic income with the idealistic statement “A rich country can guarantee income to the deprived. If some do not work, so be it. The rich are also known on occasion to prefer leisure.” He advocates compassion for deprived humans in the larger world no matter where they are, and a strengthened United Nations with the power to suspend sovereignty in countries destroying their people. He laments the International Monetary Fund which bails out those most responsible for the excesses and wild swings of market capitalism. He cautions that no economist can take leave of the threat imposed by the nuclear stockpiles capable of ending life as we know it, still ready and waiting the authority of an insane politician or their military delegates.
On a personal note I agree with Galbraith that the most effective government for the most number of people is a strong democratic state, where the people are free to choose and remove leaders that further or hinder the goals of society as they see fit. I have seen a dramatic and intentional weakening of this notion of the state over my lifetime, perhaps from internal forces and perhaps as a result of sabotage by outside state actors. Nevertheless, our ability to have an effective voice in our government in the age of powerful political parties with the stated desire to weaken the very government they control concerns me greatly; we are slipping steadily away from the basic tenant of strong democratic self-rule which will lead to the type of power vacuum that seems to be inevitably filled by corrupt authoritarians in other countries.
Daniel Goleman is a “great mind” of a different era at the edge of the 21st century. After completing a Ph.D. in psychology at Harvard he became a popular visiting lecturer there. He wrote the book Emotional Intelligence published in 1995, subsequently translated into 30 languages and selling four million copies worldwide at the time of writing. Goleman has found himself in great demand on the business lecture circuit after asserting that emotional intelligence consisting of competencies such as initiative, self confidence, relationship abilities, and the drive to improve are better predictors of success than IQ. One of his insights from neuroscience is that the parts of the brain responsible for these traits learns in an entirely different way from the parts responsible for technical skills; classrooms and books are “next to useless for learning how to behave in a more emotionally intelligent fashion”; habit change, practice and repetition are required. His prediction, prefaced with “You can plan for a hundred years, but you don’t know what will happen in the next moment”, is that “developed societies will expand the mandate of schools to include the education of the emotions”. He cites a consistent downward trend in the abilities of our children over time in areas of self-management and social skills, and notes the corresponding upwards trend in the rates of homicide, suicide and rape among teenagers. He describes my situation perfectly; the increased competitiveness of the global marketplace has left parents working harder and longer and with less time for their children than previous generations. He predicts that schools are the only vehicle left that can adequately convey emotional intelligence such as impulse control, anger management, motivation, empathy, collaboration and working out disagreements positively. He leaves with the prediction “Empathy will hold as valued as place in the curriculum as algebra.”
While I can’t claim mastery by any means, I am extremely concerned for my older children who seem to be severely behind in the listed emotional intelligence traits. Particularly in the year of their life lost to the pandemic – my older son’s culmination of high school and first year of university were spent on the couch, and my younger child has withdrawn to a bedroom the vast majority of the time – will undoubtedly leave scars for a lifetime. Prior to that we have made the mistake that raising our children in the relatively unpopulated countryside would be a good experience for them; it is clear on reflection that this has limited their social interaction and ability to learn these traits. I wonder now about location and emotional intelligence as a driver of broader demographic and political trends; this would nicely explain the uncooperative nature of many of my rural neighbors and the political attitudes that represent them.
The role of optimism in effecting our future notwithstanding, after reading the last few essays and predictions I think a more appropriate title might have been Wishful Thinking of 30 Great Minds on the Future.