{"id":760,"date":"2018-01-01T05:38:55","date_gmt":"2018-01-01T05:38:55","guid":{"rendered":"http:\/\/www.rangakrish.com\/?p=760"},"modified":"2018-01-03T10:21:00","modified_gmt":"2018-01-03T10:21:00","slug":"analysing-screenplay-with-mathematica","status":"publish","type":"post","link":"https:\/\/www.rangakrish.com\/index.php\/2018\/01\/01\/analysing-screenplay-with-mathematica\/","title":{"rendered":"Analysing Screenplay with Mathematica"},"content":{"rendered":"

I have a close relative who is an aspiring movie screenplay writer. During one of our recent meetings, he shared with me with a lot of interesting information about screenplay writing and its challenges. He even lent me a few good books to read further. One of the books is Essentials of Screenwriting<\/strong><\/em> by Richard Walter<\/strong><\/em>. I thoroughly enjoyed reading it!<\/p>\n

After reading the book, I was quite eager to go through some actual film screenplays. I searched the net and found the script for the movie\u00a0The Prestige (2006)<\/strong><\/em>. I downloaded the PDF version and started reading it. It was then that another thought crossed my mind: Wouldn\u2019t it be nice if we can parse and analyse the script programmatically? Now, why would anyone want to do that? Computational analysis can throw up interesting statistics about the screenplay, and if you are into text mining, this can be an interesting source of data.<\/p>\n

Properly formatted scripts have a well-defined structure. Instead of worrying about low-level parsing, I wanted to convert the script file to XML format so that I can process the file without much difficulty. There is a script writing software called Fade In<\/strong><\/em><\/a>\u00a0that allows opening script files in PDF format and exporting in XML. I used that software and converted the original PDF version of the script to XML format.<\/p>\n

I then decided to use Mathematica for analysing the script. It is quite straightforward to work with XML files in Mathematica. I am not describing the code in this article, but you can download the source for the program using the link given later in the article.<\/p>\n

Let us first load the XML file and list the top 20 Characters that appear in the script.<\/p>\n

\"Character<\/a>
Character Names<\/strong><\/figcaption><\/figure>\n

Remember that the script only talks about characters, not about the real actors who play these characters.<\/p>\n

OK. Next, how many scenes are there in the script and what are some scene headings<\/strong><\/em> (also called slug lines<\/strong><\/em>)? The following table lists the first 25 scenes (there are 219 scenes overall).<\/p>\n

\"Scene<\/a>
Scene Headings<\/strong><\/figcaption><\/figure>\n

Let us find out some of the locations where the scenes are set, and how many such locations are there.<\/p>\n

\"Locations\"<\/a>
Locations<\/strong><\/figcaption><\/figure>\n

When you study the various scene headings, you will notice prefixes such as INT. (Interior)<\/strong><\/em>\u00a0and EXT. (Exterior)<\/strong><\/em>, and some form of time specification such as DAY<\/strong><\/em>, NIGHT<\/strong><\/em>, etc. The following table shows the different types of scenes in this screenplay.<\/p>\n

\"Scene<\/a>
Scene Types<\/strong><\/figcaption><\/figure>\n

Looks good so far. How can we find out the dialogues spoken by a specific character? That is easy. The following tables lists the first 10 dialogues uttered by the character called\u00a0Borden<\/strong><\/em>.<\/p>\n

\"Borden<\/a>
Borden Dialogues<\/strong><\/figcaption><\/figure>\n

And if you want to know the number of dialogs uttered by each of the characters in the screenplay, that is also easy to get:<\/p>\n

\"Dialogues<\/a>
Dialogues of All Characters<\/strong><\/figcaption><\/figure>\n

The same information plotted as a Bar chart appears below.<\/p>\n

\"Dialogs<\/a>
Dialogues Bar Chart<\/strong><\/figcaption><\/figure>\n

For ease of decoding, I am listing the top 20 dialogue counts by different characters in the following table.<\/p>\n

\"Dialogues<\/a>
Dialogues Table<\/strong><\/figcaption><\/figure>\n

The number of dialogues spoken by each character is likely to reveal the prominence of that character in the movie. Here\u00a0Angier, Borden<\/strong><\/em> and Cutter<\/strong><\/em> seem to be key characters.<\/p>\n

As you can see, it is quite easy to perform such interesting analysis on a screenplay once you have the right tool. If you are into deep text analysis, you can even scan the dialogues for patterns, sentiments, etc.<\/p>\n

That was an interesting exercise for me. I learnt a fair amount of technicalities of movie screenplay writing while doing this study. Hope you enjoyed reading this article! You can find the XML version of the screenplay here<\/a>, and the Mathematica source here<\/a>.<\/p>\n

I want to take this opportunity to thank you for your continued support.\u00a0 Have a fantastic New Year! Let this year bring you lots of happiness and prosperity!<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

I have a close relative who is an aspiring movie screenplay writer. During one of our recent meetings, he shared with me with a lot of interesting information about screenplay writing and its challenges. He even lent me a few good books to read further. One of the books is Essentials of Screenwriting by Richard […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[72,17],"tags":[127,43,126],"class_list":["post-760","post","type-post","status-publish","format-standard","hentry","category-mathematica","category-programming","tag-fade-in","tag-mathematica","tag-screenplay"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9OLnF-cg","jetpack-related-posts":[{"id":783,"url":"https:\/\/www.rangakrish.com\/index.php\/2018\/01\/14\/analysing-screenplay-in-mathematica-part-2\/","url_meta":{"origin":760,"position":0},"title":"Analysing Screenplay in Mathematica – II","author":"admin","date":"January 14, 2018","format":false,"excerpt":"In the previous post I showed how we can use Mathematica to analyse screenplays, and gave some interesting statistics about the various characters and scenes from the movie The Prestige. In today\u2019s post, I want to continue that discussion by sharing some more statistics, and then look at another movie,\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Characters vs. Scenes","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2018\/01\/Num-Scenes.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":409,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/11\/02\/working-with-linguistic-data-in-mathematica\/","url_meta":{"origin":760,"position":1},"title":"Working with Linguistic Data in Mathematica","author":"admin","date":"November 2, 2016","format":false,"excerpt":"There are many interesting functions in Mathematica for working with language data, not just in English but in many other languages too. The DictionaryLookup[] function is a good starting point. Let us see what languages are supported as part of dictionary lookup: That is a good collection. It is nice\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Supported Languages","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/11\/dict-1.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/11\/dict-1.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/11\/dict-1.png?resize=525%2C300 1.5x"},"classes":[]},{"id":328,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/09\/11\/natural-language-processing-in-mathematica\/","url_meta":{"origin":760,"position":2},"title":"Natural Language Processing in Mathematica","author":"admin","date":"September 11, 2016","format":false,"excerpt":"Welcome back. Today I am going to share with you some of the nice capabilities of Mathematica in the area of Natural Language Processing (NLP). Let us start with words. What if we wish to know\u00a0the various definitions of the word image?\u00a0Here is the answer. Mathematica gives the various senses\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Word Definition","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=700%2C400 2x"},"classes":[]},{"id":348,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/09\/26\/computer-vision-with-mathematica\/","url_meta":{"origin":760,"position":3},"title":"Computer Vision with Mathematica","author":"admin","date":"September 26, 2016","format":false,"excerpt":"Over the past several weeks, I have been discussing many interesting features of Mathematica. As a continuation, today, I would like to show some cool functionality in the domain of computer vision and machine learning. The function ImageIdentify[] tries to identify the object in the given image. According to the\u2026","rel":"","context":"In "Machine Learning"","block_context":{"text":"Machine Learning","link":"https:\/\/www.rangakrish.com\/index.php\/category\/machine-learning\/"},"img":{"alt_text":"A Truck","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/truck-fig.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":285,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/07\/22\/using-julia-to-interact-with-mathematica\/","url_meta":{"origin":760,"position":4},"title":"Using Julia to Interact with Mathematica","author":"admin","date":"July 22, 2016","format":false,"excerpt":"Mathematica is a powerful environment for symbolic and numerical computation. I have been using it for many years now. In this post\u00a0I had explained how we can use Mathematica bundled with Raspberry distribution to control littleBits devices. When I saw that there is support in Julia for interacting with Mathematica,\u2026","rel":"","context":"In "Julia"","block_context":{"text":"Julia","link":"https:\/\/www.rangakrish.com\/index.php\/category\/julia\/"},"img":{"alt_text":"Julia Session","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/07\/Julia-1.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/07\/Julia-1.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/07\/Julia-1.png?resize=525%2C300 1.5x"},"classes":[]},{"id":1541,"url":"https:\/\/www.rangakrish.com\/index.php\/2019\/04\/21\/textcontents-function-in-mathematica-12\/","url_meta":{"origin":760,"position":5},"title":"TextContents[ ] Function in Mathematica 12","author":"admin","date":"April 21, 2019","format":false,"excerpt":"Mathematica 12 was released a few days ago.\u00a0 It has been over a year since version 11.3 came out in March 2018. The long wait appears justified since the new release boasts of numerous improvements and new features across several areas. You may want to read this blog post\u00a0by Stephen\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Importing Text File","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2019\/04\/FileImport.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2019\/04\/FileImport.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2019\/04\/FileImport.png?resize=525%2C300&ssl=1 1.5x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts\/760","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/comments?post=760"}],"version-history":[{"count":0,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts\/760\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/media?parent=760"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/categories?post=760"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/tags?post=760"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}