RunwayML & Glitch

To be completely honest, I started this assignment with zero ideas on where to begin. I think I lost track of what tools are meant for what. It took a bit of work to kind of set myself on track. (although I admit I am still kind of confused) I chose the wrong week to travel.

When I tried to run the runwayML glitch template on my computer I got this error.

I later realized I didn’t give a runway url or token. I think because of my overall frustration I made some really stupid mistakes. I then got the skyGAN model to work (yay).

As a next step, I tried to use a p5.js sketch with one of the style transfer models. I based it on one of the class templates but added a drag and drop instead of the webcam. I had a lot of error connecting p5 and runway. The first model I chose had 2 inputs whereas I was was only giving it 1 input, the image.

I was not sure what this second input was and it was giving me errors so I switched to a different model.

All the errors that were showing up in p5 looked like this, which I guess is the annoying thing about working with p5 as it tells you nothing about what is actually going on.

When I inspected the page though I kept receiving an error that the model cannot be found. I checked and double checked that the url is correct and the model is active but to no avail.

My first observation was that hosting the model on glitch was much faster then p5.js in terms of simplicity and performance. I think since runway ml is still so new there are a lot of unexpected hurdles when working with it (though that is probably because I don’t know much about servers. I haven’t tried hosting the model locally but I assume it would be easier to handle/debug than p5.js.