Installation version IV work in progress

05/04/2018

ChatBot using speech recognition  p5jS > create a Script for the interaction between audience and computer , (D.Shiffman Tutorial)

Chatbot is triggered by ultra sound sensors monitored via Arduino. Arduino send via Serial to Computer , 1 if there is someone in front of the sculpture. If there is no one, Chatbot is only displaying DataText. The installation is moving mechanically after the first trigger by Audio Speaker Sculpture

DataText is produced by training Texts on masks and object in theatre and Text about components specifications. Training model is Markov Chain

Audio Speaker sculpture with microphone and speakers plugged to computer: role is to get the Chatbot starting, has to drive the audience in, to start the conversation,

Chatbot ‘s script should be based on waiting for keywords ,and ability to display long sentences

Need to set up a private router , to have the installation free from overcrowded network

Questions about training Neural Networks from the maker

The maker : For who’s pleasure do we train the models?

Who is the curator/ the audience?

What is the purpose?

“If we employ machine intelligence to augment our writing activities, it’s worth asking how such technology would affect how we think about writing as well as how we think in the general sense.” (Ross Godwin )

How to start

Installation version III

 

 

04/27/2018 after tutorial with R. Fiebrink

Use sound recognition to find if there is someone talking to one of the artefact, will solve the problem of how many people are interacting effectively with the installation, play with the sensitivity level , to get the data sound we need

  • Build up one “ear” node, with microphone , check this  and that to understand wich type of microphone we need. > lavalier microphone
  • Build up a “mouth” to display the response of the chatbot installation, play with idea that a microphone is a reverse speaker?
    • version 1 simple version via p5js with the need to have access to cloud to do speech recognition ,
    • version 2 for speech recognition with BitVoicer API , speech recognition, check Arduino Tuto : speech recognition and synthesis,
    • would need to use a private router to secure access to the cloud for the text to speech > check authorisation for plugging the private router to internet, 

To generate responses from the ChatBot : build up different training set with different methods : Markov Chain , char RNN review and  basic char RNN training with github source,   , Tensor Flow‘s sequence to sequence library feed ,

write different scripts via RiverScript to compute the input text  to ouput text, use array in Riverscript? generate different characters , who you are talking to, use a list of trigger words in an array to output a certain sentence

or use the mic from MAC

04/26/2018 after tutorial with H. Pritchard

produce a mix reality with the electronic node devices and human interpretation by the nodes Node A activate node B/ one sensor, one motor, one movement, / small (or big)size nodes

create the narrative: when (no one/ or not enough people) is (looking or talking) , the nodes are interacting  with each other- when there is enough people or one person( looking or talking), the nodes stop moving, and talk back

Using text to speech and maybe speech recognition

 

 

Practice Report

 

02/21/2018

  • plan how many type of artefacts:?  4 sounds spinner , 4 lights walkers, 4 touch
  • mechanical interactions rather than serial interaction
  • more precise sketch with the mask in , working as a gate what is the link with the network of artefacts? how the mask activate the network?
  • look at this work for inspiration

3D printing fabric exploration

3D printing ideas and download : https://www.myminifactory.com/

sinus wave to Servo :

02/14/2018

Worked :

motor A, continuous servo is activated by sound, holder A turn and stop. While turning, touch holder B which  in turn activate motor B , servo 180  ” nervous servo”. Using two arduinos.  

to do :

  • use only one arduino, stabilise the holders
  • test other fabrics for nervous servo, and elastic thread to fabric from servo, shibori technic to enclose artifacts
  • transfer to textile circuits with Attiny 85
  • add a sound producing ,  Speaker playing a short record
  • add EMF transmitter

02/10/2018

about Creativity assessment, be recognized by the System, freedom of the artist and material approach

“Prototype A  – Presentation for the MA continued development of your project so that it fully realises some of the features which you previously sketched out.(assessed) : 5%”

I developed mixed feelings about the compatibility between my artistic process and an academic frame. How to assess creativity is though, and highly subjective, thus not to be trusted as a source for inspiration.

Should creativity aims for an academic success, that is a “delivery”, this creativity will be formatted in such a way that will fit external constraints determined in order to “please” a bureaucratic system. Thus the importance of choosing to belong or not in the system, to be able to use it and be “recognized” by the system.

My creative approach is from the material not from preconceived ideas, although as an artist researcher, I do have a area of investigation.  For example,   play with codes and trust the focus from the right brain who will lead to create an algorithm which help my investigations . In my process, I trust my intuition, right brain again, about which material , equipment, technology I should use and finding out how to use it as opposed to try to create a predefined work and in the process creating an artwork for the purpose I was looking for.

Although, recognition of the effort put in the work could and should be assessed., while processing the work there is neither a  “clear” picture neither a stop frame faithful to the final “product”. Similarly,  is it relevant to judge a painting by it sketches ? I should be free to create my work at my own path.

 

This raises questions about my art practice. Could I choose to not care about how whatever system will index me ? If the answer is yes, can I stay in this systems? How strong , how careless should I be? Does it matter to fit?  How worth is it to surrender to the frame versus staying in an individual and lonely process? What is worth in the artistic making: processing or sharing?

Is it linked to the ability to be self centered and deaf to my environment?  or to a strong belief in my artistic process? If there were no one to understand my art piece, here and now, would I stop being an artist?

02/06/2018

  1. Script for a Network of Artefacts
  2. Coding
  3. Prototyping

 

Modelling in 3D digital

  • https://www.blenderguru.com/
  • using 3D modelling for having repetition
  • export to laser cutting or 3D printed
  • example of use : bits and bots to make a plotter controlled by arduino and processing sketches
  • “object is embedded by information, fabrication process has to be honest” Lior Ben Gai
  • https://www.blenderguru.com/tutorials/lightbulb-tutorial