As a part of a ‘1 day in Python’ workshop, the capabilities of this versatile language were showcased with cases and demonstrations. We realized the underlying logic of the various data science algorithms through these demonstrations; or, to put it in other words – We got an insight into how computers think!

Natural Language Processing

Natural language procesing

Natural Language Processing (NLP) is concerned with programming computers to process and analyze large amounts of natural language data. These find implementations in: Search engines, Social website feeds, Speech engines and Spam filters.

There are two components of NLP:

  1. Natural Language Understanding (NLU)– It involves analyzing different aspects of the language.
  2. Natural Language Generation (NLG)– It is the process of producing meaningful phrases and sentences in the form of natural language from some internal representation.

We were given a mixture of words. Our task was to sort and arrange these words in such an order so as to form meaningful phrases or sentences. For this, we tried to structure and organize these words so that they form some meaning or connection with each other. After this, we aggregated the formation of sentences; analyzing what parts should come before or after the sentence so as to form some logic in the story.

The similar stages are followed in natural language generation, and also in ‘end-to-end’ machine learning building of a system.

The applications of NLG are:

  • Generating text summaries of databases and datasets
  • Automated journalism
  • Chatbots
  • Generating product descriptions for e-commerce sites

Facial Emotion Recognition

Facial Emotion Recognition

Human facial expressions can be easily classified into 7 basic emotions: happy, sad, surprise, fear, anger, disgust, and neutral. Facial emotions are expressed through activation of specific sets of facial muscles. These contain an abundant amount of information about our state of mind. Through facial emotion recognition, we can measure the effects that content and services have on the audience/users.

We were given a set of images and our aim was to identify the emotion in each of these. For each of the faces, we started from the top of the face observing the forehead- whether there were wrinkles or not, then we went to eyebrows and the analysis was done so on. These key differentiators helped us in identifying the emotion. After predicting and labelling each of these faces as per their emotions- disgust or neutral, we were shown the actual labels. We then realised which of the faces we had correctly marked and which of the faces we had falsely marked. Thus we found out the true negatives, false negatives, true positives and false positives. After writing these in the form of a confusion matrix, we could find out the accuracy, precision and recall. The computer algorithm for facial emotion detection works in the same way.

Examples of facial emotion recognition include:

  • Retailers may use these metrics to evaluate customer interest.
  • Healthcare providers can provide better service by using additional information about patients’ emotional state during treatment.
  • Entertainment producers can monitor audience engagement in events to consistently create desired content.

Building a Movie Recommender System

WhatsApp Image 2019-03-10 at 11.27.23 PM (1).jpeg

Why are recommender systems becoming more and more popular these days? How do sites like Netflix, Amazon Prime, YouTube give us recommendations?

There are basically two types of recommender systems-

  1. Collaborative Filtering– This type of filter is based on users’ ratings, and it will recommend us movies that we haven’t watched yet, but users similar to us have watched and liked. The algorithm predicts a rating for a movie from a user’s past behaviour as well.
  2. Content Based Filtering– This type of filter uses a series of discrete characteristics of a movie in order to recommend additional movies with similar features.

We were given an activity to recommend a movie to a user.

In the first scenario, there were 5 different movies (M1, M2, M3, M4 and M5) and 4 people. There were three tables listing the movie ratings in three different universes. In this simple denotion of a complex problem, we were able to look at a granular level of such problems of a real-world scenario. We started out by filling the missing values – by looking at the pattern of data. This indicated the fact that data at the elementary stage requires pre-processing and cleaning. Looking at the data provided, we were able to form decisions such as – if A likes action movies, and B likes comedy movies, then which type of movies does C like as can be seen from the data? We could identify people having similar movie tastes.

In the second scenario, we were given a table listing the features of movies. The features included whether the film was Animated, or Marvel, or had particular actors, etc. The labels were Yes or No for each of the movies. We were to then answer questions such as, if A was a fan of animated movies, and he just watched the movie Inside Out, then which movie would you recommend to him next? If B is a super Marvel fan, and just watched a movie XYZ, which movie would you recommend her to watch next?


Shape Clustering

WhatsApp Image 2019-03-11 at 3.58.43 PM.jpeg

The shape clustering problem is of practical importance in many areas where image or video data collections are used. These can significantly facilitate the automatic labeling of objects. For example, it could outline the existing groups of pathological cells in a bank of cyto-images; the groups of species on photographs collected from certain aerials; or, the groups of objects observed on surveillance scenes from an office building.

We were given a mixture of shapes for this one, and had to segregate them in clusters. Firstly, we were asked to do this individually and later in group. The task, when performed in a group was significantly faster. This also represents that when a task is distributed among the nodes in the computer algorithm, the training and testing time is lesser than running the program on a single node.


Story-telling

“Maybe stories are just data with a soul.”   -Brené Brown

Storytelling in data science is to take the data, ideas, facts, incidents and convert it into a story. Stories provoke thoughts and bring out insights.

We had initially been grouped based on our interests. Through this activity, we were to choose a common topic and come up with a creative story. We represented data by drawing pictures and illustrations, connecting the elements which have a certain relationship between them. We used different types of visuals to make it more engaging. Some of us used timelines, pie charts, network diagrams, flowcharts and so on. Later, a presentation on each of these stories was conducted by the team members.

20190223_164948.jpg

“Data makes people think, emotions make them act.”  -Antonio Damasio


This event on ‘1 day in Python’ was organized by WiDS Pune 2019.

Here are the links to the learnings from the other pre-conference events-

–> Data Science Problem Formulation through Lego Serious Play (LSP)

–> Design Thinking for Data Science!

–> How to give High-Impact Presentations?

–> Industry 4.0, Convergence of IOT and Artificial Intelligence

29 Comments

  1. Does your website have a contact page? I’m having a tough time locating it but, I’d like
    to send you an e-mail. I’ve got some suggestions for your blog you might be interested in hearing.
    Either way, great blog and I look forward to seeing it grow over
    time. It is perfect time to make some plans for the longer term and it’s
    time to be happy. I have read this publish and if I may just I want to counsel you few attention-grabbing things or suggestions.
    Maybe you could write next articles referring to this article.
    I desire to read even more issues approximately it!
    I truly love your blog.. Very nice colors & theme. Did you build
    this web site yourself? Please reply back as I’m wanting to create my very own website and
    would like to know where you got this from or exactly what the theme is named.

    Thanks! http://dell.com

  2. Hey there would you mind sharing which blog platform you?re using?

    I?m looking to start my own blog in the near future but I?m having
    a difficult time choosing between BlogEngine/Wordpress/B2evolution and
    Drupal. The reason I ask is because your layout seems different then most blogs and
    I?m looking for something completely unique.

  3. Terrific article! This is the kind of info that should
    be shared around the web. Shame on Google for not
    positioning this put up higher! Come on over and
    seek advice from my web site . Thanks =)

  4. Have you ever considered about including a little bit more than just your articles?
    I mean, what you say is important and everything. Nevertheless think of if you
    added some great graphics or video clips to give your posts more, “pop”!
    Your content is excellent but with images and videos, this website could certainly be one of the most beneficial in its niche.
    Amazing blog!

  5. I truly love your site.. Great colors & theme.
    Did you make this amazing site yourself? Please
    reply back as I’m looking to create my very own blog and would love to find out where you got this from or what the theme is called.
    Many thanks!

  6. Thanks for writing this awesome article. I’m a long time reader but I’ve
    never been compelled to leave a comment. I subscribed to your blog and
    shared this on my Twitter. Thanks again for a great post!

  7. I have been exploring for a bit for any high quality articles or blog posts on this kind of area .
    Exploring in Yahoo I finally stumbled upon this website.
    Reading this info So i am satisfied to show that
    I have an incredibly excellent uncanny feeling I found out just what I needed.
    I most indubitably will make certain to do not overlook this
    site and provides it a glance regularly.

  8. Excellent weblog right here! Also your web site
    loads up fast! What web host are you the use of?
    Can I get your affiliate hyperlink for your host? I want my website loaded up as fast as
    yours lol

  9. Hi I am so grateful I found your weblog, I really found you by accident,
    while I was looking on Aol for something else, Anyhow I am here now and would just
    like to say cheers for a tremendous post and a all round thrilling blog (I also love the theme/design), I don’t have time to look
    over it all at the moment but I have book-marked it and also added in your RSS feeds, so when I have time I will be back to read a
    great deal more, Please do keep up the awesome work.

  10. Nice read, I just passed this onto a colleague who was doing some research on that. And he just bought me lunch as I found it for him smile Thus let me rephrase that: Thanks for lunch! “One who’s our friend is fond of us one who’s fond of us isn’t necessarily our friend.” by Geoffrey F. Albert.

  11. Hello there! This article couldn’t be written any better!
    Reading through this post reminds me of my previous roommate!
    He always kept preaching about this. I will forward this article to him.
    Pretty sure he’s going to have a great read.
    Thanks for sharing!

  12. Thank you for some other wonderful article. Where else may just
    anybody get that kind of info in such a perfect means of writing?
    I’ve a presentation next week, and I am on the look
    for such information.

  13. Hi, I just looked at your website and really impressed by it’s design and information. You are doing an excellent job by providing such content to the world. Thank you so much.

  14. Fantastic goods from you, man. I’ve bear in mind
    your stuff prior to and you’re just extremely magnificent.
    I really like what you’ve obtained here, certainly like what you are stating and the way in which
    by which you assert it. You make it entertaining and you
    continue to care for to keep it wise. I cant wait to read far
    more from you. That is actually a terrific site.

  15. Its like you read my mind! You seem to know
    so much about this, like you wrote the book in it or something.
    I think that you could do with a few pics to drive the message home a bit, but instead
    of that, this is magnificent blog. An excellent
    read. I will definitely be back.

Leave a Reply

Your email address will not be published. Required fields are marked *

twenty + five =