Things about devising process with the node-artifacts

Developing a methodology to improvise with objects

from research to production
looking for the seeds3
research feed, find the sources, read and find the subject
essay writing feed, write and explore other paths
playing with codes, learn new languages and environment (python, node.js, atom, github) ,practice, trial and errors, tame the compiler
playing with the artefacts, develop a closed relationship with your puppet artefact, the puppet mirror effect projecting a part of your soul in it

staging the interface with the viewer respond to the same tricks as in puppetry: variation in your effects , in time, intensity and type

prototyping and devising process with the machines

prototyping warming up
engage with the material through little exercises
find the momentum
use repetitions to open imaginary paths
explore new paths and feed the process
create a new system

stop prototyping
let it grow,
engage with the artefacts
nurture the system
stage, script and scenario

harvest
let it go, engage with the characters we created

feedback , external/ internal input
watch the seeds grow and cut the remnants

pitch it and be your own outside eye
feedback , go and find another outside eye to get new input
when is the time to stop listening to other voices and hold on to your artistic vision?

messy creative process is painful but necessary
keeping tracks is essential

deadlines are useful

curators
about sharing the vision, taking the feedback input, listening/ not listening

when everyThing goes wrong

sensors
hardware/ software
soldering

go back to the basic and repeat and scale it step by step.

 

Questions about designing the sound visualisation

 Like the idea of sound visualisation and how it embodies the impact of the machines on their environment. What sort of shapes or visualisation to use? Testing the shapes for the backdrop with human and machines in connection of their talking. 

“In the fusion torch recycling, The emancipated spectator The torch of the sensor is ashamed Cheat the eyelash! 9dfbf0 for the node torch. Grumbling makes the loaf no larger The buildings look like endangered blouses The vertices will link their uncapped mask”

Things about Sound vizualisation

Finally giving a backdrop to my node performers. Like the idea to use the sound produced by their sole movement and that they do not need humans  to have those drawings on the wall.  As if now they have their body character, they need to communicate with it.

Need to calibrate the drawings should allow to see the distinction between frequencies of human  and non human voices.  Allow the shadows and node silhouettes to appear along with the drawings .

Learning with https://www.unicornsfartpixels.com/posts/2017-10-25audio-fft/ and https://www.openprocessing.org/sketch/446310 with Alexander Quadratov

Things about the voice for the crafted nodes

Prototyping Char RNN Neural networks generating text

Trying to find a voice for the crafted electronic nodes- Node Poetry

In the process of characteristation, the nodes need a voice .  I like the idea of the nodes generating their own poetry based on texts I will fed to them. The challenge then , is to find appropriate texts to train the neural network

testing a Char RNN model based on Max Woolf ‘s training model : https://github.com/minimaxir/textgenrnn, an open-source framework by Max Woolf, written in Python and powered by Tensorflow.

First set of seeding texts were user guide for tourist and servo safety guide , 

“Keep quiet when you are punctual if taking part in a shop
loosen up and bring an adventurous spirit
take time to a complete stop
applicable regulations will result in death or serious
Install and avoid hazards involved are authorized to work on your knife.
loosen up and bring an adventurous spirit
Install and all other people’s belongings with the fork parallel across the right side of your host
Ensure you are punctual if taking part in a shop
It is advisable to take your place in the right while eating.”\

The result is fun but  not any relations with the idea of the network of nodes.

Better result with another set of texts :   Wendy Chun and Updating to remain the same. Cambridge, Massachusetts : The MIT Press, 2016 and U.A Meijas . Off the Network. USA: Electronic Mediations , University of Minnesota Press, 2013, in addition to extract from my essay on network masks and some further thoughts about puppetry. 

Put the mask on your face, and become a node’, ‘between 0 and 1
This is the marionette
the Network is Blind
Internet is Myopic
the puppet is Workaholic
the Network is a Trail
the interface is Sniffing
the interface is a Collective Traveller
sensor is on
sensor is off
the code is binary
shadows are invisible
we are the machines
Ask the marionette
a puppet never dies
we are humans…

asking the model to qualify the main social media : ” google computers are invisible,  google the mask on your face, and become a node “

taking the “good sentences ” produced by the model and put it again in the training model

Questions about Narrative in Physical Computing

Things about actuators , sensors and calibration is there a natural order when scripting a story telling in physical computing?
Actuators are designed to activate not to inactivate

As per definition of actuators in wikipedia : “An actuator is a component of a machine that is responsible for moving and controlling a mechanism or system, for example by opening a valve. In simple terms, it is a “mover”.”

So among the electronics artefacts, I have the actuator, the passive and the one which could be moved by the actuator. stop moving when the actuator is not on anymore . stop moving is not a positive form, form of resistance of non moving
Odd that it is more easy to activate than to inactivate a servo… It looks less easy than you think .The way things are built with motors is that their actuators are there to make them move , but not make them stop …

Questions about work in progress

ChatBot using speech recognition  p5jS > create a River script for the interaction between audience and computer , (D.Shiffman Tutorial)

The bot is triggered by proximity sensor monitored via Arduino. Arduino send via Serial to Computer , 1 if there is someone in front of the sculpture. If there is no one, bot is only displaying DataText.

Speaker sculpture is made of a sound sensor connected to an Arduino and a speaker plugged to computer. The audio speaker sculpture is acting as an actuator for the first servo which body is spinning and touching the other sculptures.

Still have to find the link between the proximity sensor with the bot and the speaker sculpture

DataText is produced by training Texts on masks and object in theatre and Text about components specifications. Training model is Markov Chain.

River script is based on waiting for keywords , and ability to display long sentences. This is a limitation to the conversation.

Need to set up a private router , to have the installation free from overcrowded network

Questions about training Neural Networks from the maker

The maker : For who’s pleasure do we train the models?

Who is the curator/ the audience?

What is the purpose?

“If we employ machine intelligence to augment our writing activities, it’s worth asking how such technology would affect how we think about writing as well as how we think in the general sense.” (Ross Godwin )

How to start