Neural Style Transfer

This forum is dedicated for discussions on making creative images of nature. Images can be attached too as part of the discussion thread.

Moderators: Adithya Biloor, Madhav Jois, Vikas T R, Prashanth Sampagar, Nevil Zaveri, Raviprakash S S, Saurabh R. Desai








Neural Style Transfer

Postby Ganesh H Shankar » Thu May 21, 2020 8:42 pm

A few years ago myself and RD thought of "somehow" merging our images to make a new image. RD made a series of images with "clutter" as a theme. On the contrary most of my frames are empty or have a few pixels in them! The idea was to merge the both to see how it might look. We went to Nagara fort during one of our monsoon trips to Adithya's place and made some images. After coming back somehow we felt we could not meaningfully merge them.

During last couple of months I was going through a very interesting area in machine learning called Neural Style Transfer (original paper here). This is exactly what we were trying to do then. But then we failed because all that we had then was "photoshop merge" which did not work out. Neural style transfer does a very intelligent merge! Neural Style Transfer takes two images, a style image and a content image. Then the content image will be morphed by bringing in gist from style image!! Here are three images. With RD's permission I am inserting RD's clutter image (used as style) and my elephant & calf image (used as content) to create the new "neural style transferred" image.

Style Image

Image

Content Image

Image

Generated image with "Neural Style Transfer" - RD's style, my content (Who has the copyright for this one?!)

Image

The algorithm provides many tweaking options to control the look and feel of the generated image. In particular we can adjust the relative weightage of style and content components.

I think artistically neural style transfer offers many avenues to explore. In particular I would like to explore whether it is possible to match the style from a music on to an image (instead of picture to picture). This goes back to our experiments earlier on matching "ragas" with tones/mood of an image. You may find the related discussion we had long ago here. I think this will be a novel area to explore for style transfer.

Acknowledgement: The image above has been generated using the nice program written by Harish Narayanan for the neural style transfer.

I hope you find this post interesting!

For the image post in the Nature Art Gallery and further discussion please click the thumbnail here below.

image_id: 17217
Ganesh H. Shankar
Wishing you best light,

Image
Personal Websites Fine Art Nature Photography
Facebook Pages Ganesh H. Shankar | Fine Art Nature Photography | Art Of Life
User avatar
Ganesh H Shankar
Site Admin
 
Posts: 956
Joined: Thu Apr 24, 2008 6:54 pm
Location: Bangalore, INDIA








Return to Discussions on Creative & Fine Art Nature Photography

Who is online

Users browsing this forum: No registered users and 6 guests