Wednesday, April 12, 2023

GOFAI

 Good Old Fashioned Artificial Intelligence (GOFAI)

Practice yourself, for heaven's sake in little things, and then proceed to greater. Share this Quote Epictetus
Read more at https://www.brainyquote.com/topics/little-things-quotes

Practice yourself, for heaven's sake in little things, and then proceed to greater.
- Epictetus
 
 
 
Practice yourself, for heaven's sake in little things, and then proceed to greater. Share this Quote Epictetus
Read more at https://www.brainyquote.com/topics/little-things-quotes
Practice yourself, for heaven's sake in little things, and then proceed to greater. Share this Quote Epictetus
Read more at https://www.brainyquote.com/topics/little-things-quotes
Practice yourself, for heaven's sake in little things, and then proceed to greater. Share this Quote Epictetus
Read more at https://www.brainyquote.com/topics/little-things-quotes

20 comments:

  1. I think that symbolic logic and expert systems may make a comeback due to the need for AI to provide explanations and trace its thinking. LLMs are quite mysterious to the end user.

    ReplyDelete
  2. Plus, not everyone who wants to play with AI has access to a $100 million supercomputer.

    ReplyDelete
  3. Another thought about ChatGPT (and others like it)
    Debate rages along the spectrum from rigid AI 'purists' to ad hoc 'need a few paragraphs' users about what it actually is. The former dismisses it as predictive text mimicry, while the latter doesn't really care. I find myself gradually sliding from the former to the latter. There's an old French joke: "Sure it works in practice, but will it work in theory?"

    ReplyDelete
  4. Symbolic AI stumbled because it simply could not keep up with the tsunami of data that had to be labelled and curated. Knowledge bases of trillions of cells were simply not possible. Generative AI is not really 'artificial' (basically mimics human responses) nor 'intelligent' (no experience, no goals, no theory of mind). However, an old timey symbolic AI, capable of harnessing and directing a generative LLM, could be fun to watch.

    ReplyDelete
    Replies
    1. Well...

      Lenat was bragging about millions.

      And frankly... hardly there need to be more.

      We people -- not that complex, at all.

      Delete
    2. Yes, as a long-time fan of Jeff Hawkins (Palm, Numenta), I'm intrigued by the 'sparse network' concept. I suspect that we abandoned GOFAI way, way too soon.

      Delete
    3. Well... without some good hypothesis -- we destined to re-create all evolution of a Brain/Mind... to re-create it.

      And it means trying, trying and trying again.

      Delete
  5. OpenAI fires Sam Altman, Microsoft hires him. 500 OpenAI staffers say 'bring him back or we quit'. Another slow news day.

    ReplyDelete
  6. Well... there is a caveat in all that Lenat's endevor -- who said that One Size Suits all?

    Most surely... different problems would need different KBs.

    So... instead of One... there need to be multitude of KB.

    I though about personal for each human... bunch of em, even.

    So every one of us could train his... and they could communicate too -- ask questions they cannot know themself. ;-)

    ReplyDelete
    Replies
    1. Common sense emerges from 20 (or more) years of self-training a tiny model of reality (a human mind). These models (minds) interact (communicate) to form a society. That's very different from training a neural net, and very, very different from distributing such a trained NN in something like a self-driving car. Again, current AI is neither artificial nor intelligent.

      Delete
    2. Ditto.

      "But we do not like to know that it don't work... we want to make it WORKING!!!" ;-)

      Delete
    3. Well... common sense in its linguistic form.

      But basiest of it (like recognizing oneself in a mirror) -- is built-in cognitive ability. ;-)

      Delete
  7. Wanna share my accidental findings.

    https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/

    Good link, it seems. Showing that all that mumbo-jumbo about NNs... are not that different from regular juggling with bytes we do and love to do...

    It's just... it would be nearly to impossible for any average... or even any programmer at all, to get a hold of equipment to write such program and test it working....

    On the data pool like ALL WORDS in ALL TEXTS people have had written. ;-)

    ReplyDelete
    Replies
    1. Yes. I've written several things about concatenative programming, mainly about biology/evolution and mainly in the context of FORTH. The real magic in any of this is not AI, but rather COMPUTATION itself. The universe is a realm of computation and evolution. Tools like math allow a vastly simplified model of reality to be stored in a 3lb hominid brain. But that isn't easily monetized or exploited, so we have critters like ChatGPT from farms like OpenAI.
      //nearly to impossible for any average...//
      Don't fret too much. The lowly ribosome can do much the same thing, and a modern CPU chip can do much more than that. I can talk about this more...

      Delete
    2. Well. We have GPUs. And even FPGAs.

      But that is... not low hanging fruit at all. Especially when task is not to optimize existing algorithm. But frollicing with trying this or that.

      Remember -- Lenat's experience with Eurisco. Big part of hos success -- is using very expensive LISP machines...

      And now.... when progress in computing seems like stalled...

      Delete
    3. Means... raw power it's still raw power.

      What it would be, if we'd have PetaFLOP CBUs on our desks? In our pockets?

      Delete
    4. Also... you can explore that link to Wolfram site.

      That where he (trying to) explaining "ruliad". ;-)

      Idea that Universe is just and ultimately IS a COMUTATION. In and Out. ;-)

      Delete
    5. Thanks. We speak a similar language. A lot of my ideas about computation either come from Wolfram or were 'discovered' in the course of my own wanderings. Ruliad is mind-bending, and is one of the reasons I'm so hesitant to give up on GOFAI and embrace the neural network black box religion :)

      Delete
    6. Well... though that is TOTALLY opposite things... yawn.

      Delete

Science

    [Our research] has nothing to do directly with defending our country except to help make it worth defending ...