Questions about training Neural Networks from the maker

 

The maker : For who’s pleasure do we train the models?

Who is the curator/ the audience?

What is the purpose?

“If we employ machine intelligence to augment our writing activities, it’s worth asking how such technology would affect how we think about writing as well as how we think in the general sense.” (Ross Godwin )

How to start

https://towardsdatascience.com/how-to-build-a-neural-network-with-keras-e8faa33d0ae4

Things about Coding Resources

Chatbot
Tom Bocklish : https://towardsdatascience.com/personality-for-your-chatbot-with-recurrent-neural-networks-2038f7f34636

D.Shiffmann : https://www.youtube.com/watch?v=slmSCEho31g&list=PLRqwX-V7Uu6aDUo_ia-Vq2UZZGaxJ9nRo
Using RiverScript https://www.rivescript.com/

Machine Talking
Text to Speech p5 js : https://www.youtube.com/watch?v=v0CHV33wDsI
Speech to Text p5 js https://www.youtube.com/watch?v=q_bXBcmfTJM

Machine Learning
Riverscript to process the input text to output text https://www.rivescript.com/
Text Generator, All about Chatbot
Markov Chain with D.Shifman https://www.youtube.com/watch?v=v4kL0OHuxXs

App Recommanded by Janelle Shanne:
1. textgen-rnn – an open-source framework by Max Woolf, written in Python and powered by Tensorflow. It’s the easiest to install (though you still have to know your way around command line a bit) and comes pre-trained so you can get interesting results even from tiny datasets. It runs fine on an ordinary computer’s CPU, and lets you train the same network successively on different datasets, which is fun. It’s not as powerful as the other frameworks, but just fine for simple lists of names. (tested 15th may )
 
2. tensorflow char-rnn – an open-source framework by Chen Liang, written in Python. It has tons of flexibility, including the ability to adjust dropout, save frequency, and number of saved snapshots during training, and the ability to adjust temperature during sampling. There’s a tutorial here for running it on AWS, and I’m hoping to find a good tutorial for Google Cloud as well.
3. Andrej Karpathy’s char-rnn, an open-source neural network framework for torch (written in Lua). This one has great flexibility in training/sampling parameters, and it seems to run faster on my 2010 Macbook Pro’s CPU than the python/tensorflow models. I’ve been using this one for the simpler datasets.

Ross Goldwin General Method

  • prepend the seed with a pre-seed (another paragraph of text) to push the LSTM into a desired state.
  • Use high quality sample of output from the model you’re seeding with length approximately equal to the sequence length (see above) you set during training.
  • Seed the LSTM with a meaningful text, that the machine would complete
  • build a data set , corpus
  • Choosing the right settings for a given corpus
  • train the model
  • generate output
  • train again

James Loy : How to build your own Neural Network from scratch in Python- A beginner’s guide to understanding the inner workings of Deep Learning
Chatbot Personality by 5agado , github

Question about the node language, surrealist legacy

The perspective is from the node artifacts not the human visitor. The piece is more about a bot for them to communicate with each other rather than building a chatbot to talk with us. It is machine and not human centered, The plan is  to give them a script to perform together as a network. I like the surrealist tone of the generative poetry bots and how the Dada movment was quite in advance in their practice of text collage and random writing. 

A list of tutorial to explore and start prototyping :

I have to learn Python , and how to work with Tensor Flow to manipulate text data sets

Questions about scripts

How to stage a

Network of artifacts????

 ChatBot exploration

  • <create a surrealist “conversation”between the nodes and with the nodes>
  • use the bibi dictionary as a base, binary system with letters , “Ho, He, BikEDa” , translated into shapes
    • code the binary letters, still to be done, shape equivalence bibiDico
    • http://www.graner.net/nicolas/nombres/bibibinaire.php
  • work with pattern making in processing , to create the “landscape” of the cell? 

 Embedded Signal

Signal can be embedded in an object by adding textured patterns or by modifying an object’s natural texture.This form of watermarking is currently employed to track sensitive or high-value machine parts and to identify containers carrying toxic or hazardous materials. Three-dimensional objects also raise the possibility of encoding signal by arranging artistic elements in space”

  • No one has trespassed the border, the nodes are “talking”/ interacting with each other.
  • Someone crossed the border, his face is snapshot by the LAO mask, the nodes stopped talking to each other, mirroring/ framing/hiding/revealing the human.
  • Human is crossing back, when he is out of the “view”, the nodes are “talking” again, they are talking about him, something about this human remains with the nodes to “talk” about.
  • inspiration : chinese whispers, 1 ,2 ,3 soleil, gossip, bid/offer and how news are spread across exchange markets and transformed into (non)tangible assets, lemurs and their group behaviour
  • border is a framing a door for accessing the nodes world , behind the screen, nodes , projecting their shadows on screen . on the order side the viewers trying to pass

 Secret conversations

UCCC : Ekman,U Ubiquitous Computing, Complexity and Culture, 2016 Edited by Ulrik Ekman, Jay David Bolter, Lily Díaz, Morten Søndergaard, Maria Engberg – Routledge, p125 Irene Mavrommati :  “Ubiquitous computing (Ubicomp ) are complex computing systems; they can also be understood as ecologies of artifacts, services, people, and infrastructure. Systems with such complexity can be approached as component-based systems. …Component based systems are independent systems with loose coupling of interchangeable parts, which communicate via interfaces.”

AmI : http://blog.teleplanglobe.no/ami-and-internet-of-things ,“The encrypted tunnels allow the private network to communicate privately over public networks.” “The way devices communicate, in a mesh network of devices”

 create a Network of artefacts , interacting with each others and with people
Slip in two groups, on two different locations

-When “alone”, the artefacts are moving accordingly to patterns generated by one algorithm and data previously collected, input/ parameters should include time and location
-When a presence is detected, new data are collected and new patterns, movement, sound or visual are generated, informations are processed , some of them shared to the viewer, so he could modify its input.
-The two groups will evolve to separate species after few iterations, even if they started identical

(Uncanny space).

– using the programming publish-suscribe concepts?

– artefacts moving accordingly to patterns generated by cellular automata algorithms ( ref simulating neural transmissions, synaptic caguama by Lozano-Hemmer)?  make them evolve with genetic algorithm ( the more people looking at them, ref Jessica Field)?

– repulsion / attraction systems, 10 prints, L systems, machine learning, MaxMSP , using OpenData to map to a visual. Use of OSC touch on my mobile to draw.artefacts mixing digital and analog making, embedded with sensors and OSC technology, talking to each other while receiving data from external input ( open data?)

 

  • algorithms to work on : GA, CA, particle systems,L system
  • technology for input : OSC touch , kinect,OpenData access, web Scraping
  • technology for output : machine learning, rasperry pi, 

draft scenario

  • Input is human , through sensors or data collecting. Output group 1 is visual- Output group 2 is sonic
  • If there is no input, the group 1 are drawing some shapes and machines of group 2 are reacting to the drawings by making sounds,
  • If there is some external input group 1 is taking the input and changes the patterns of its drawing , sending informations to the group 2,  having a private conversation between them . machine 2 output as sounds responding,
  • If the two groups have people , they count the people, the group with more people will have the possibility to evolve and/ or making more noise/ expanding drawings….

 the machine talks to each other in a foreign language

the machine talks to each other in a foreign language, we gave and forgot about it , they still talk this language< Check the ASCII control characters table from old teletype days>

 

<Define the Network of artefacts contolled via OSC touch?  Network is the Mask, its artefacts are the nodes>

 Listen to the Other via EMF

<the machines will feel the EMF on visitor ‘s body and react with sounds or visuals>

Questions about installation – K- cells-Knitted cells

the cells, could functions as kinetic drawing bots:

01/10/2018

 In relation to my essay proposal about the  ”NetWork : the Ultimate Mask “
Find the Poetic Space of the Network , I have the intention is to build up some Knitted cells units.  I would like to be able to stitch them together to make either a costume , a quilt , a mask,  a 3D sculpture  , a sensitive environment, or reactive bodies for puppets…

“Rules” :

  • The cells will have different functions , and different structures . They could store visual memories . They could produce or record sounds, be thermo sensitives.  They could produce lights etc…
  • Combined and stiched together they form a body. Each of this unit has its own functions and life, stich together they form a collective and have a collective behaviour. Individually they have a autonomous behaviour.
  • Like puppets can do one thing , dancing versus walking, or a mask is expressing one quality ( neutral, clown, buffon ….)  each type of K cells have limited functions , either data feed, ligth or sound. their design should reflect this particular feature.
  • Decide whether together they are stronger or weaker ? amplification process? they can also relate to each other remotely ie not stitch together.

Strategy

  • >Build K cells in electronics and transpose into soft e textile
  • > Build two families KL, knitted light fiber cells .and KA knitted audio fiber cells

    • Wearable Antennae Speaker FM Transmitter (KA)
  •  Puppetry and mask making process of animating objects
  • then WA weaved audio cells
  • combine the two families in a collective structure
    yep
    Birdy, found objects puppet by theatredu1k
Mona Luison
credit : Mona Louison

“Variables and functions”:

To achieve the design of each family of K cells,  I will use ( list to be completed)

  • mapping technology ( Max/ MSP, Mad Mapper)
  • generative code to find interesting patterns for each type of cells
generative sin pattern in Processing by SRQ
 

Luce - Lucette & Lulu