{"id":1541,"date":"2019-04-21T11:24:51","date_gmt":"2019-04-21T05:54:51","guid":{"rendered":"https:\/\/www.rangakrish.com\/?p=1541"},"modified":"2019-04-21T11:30:52","modified_gmt":"2019-04-21T06:00:52","slug":"textcontents-function-in-mathematica-12","status":"publish","type":"post","link":"https:\/\/www.rangakrish.com\/index.php\/2019\/04\/21\/textcontents-function-in-mathematica-12\/","title":{"rendered":"TextContents[ ] Function in Mathematica 12"},"content":{"rendered":"

Mathematica 12<\/strong><\/em> was released a few days ago.\u00a0 <\/span>It has been over a year since version 11.3<\/strong><\/em> came out in March 2018. The long wait appears justified since the new release boasts of numerous improvements and new features across several areas. You may want to read this blog post<\/strong><\/em><\/a>\u00a0by Stephen Wolfram<\/strong><\/em>.<\/p>\n

In the area of Natural Language Processing<\/strong><\/em>, one function that appeals to me is TextContents<\/strong><\/em><\/a>. This allows us to extract meaningful information, such as entities, numbers, locations, etc. form a given piece of text. A list of all the things that we can look for in the text is given here<\/strong><\/em><\/a>.<\/p>\n

In today\u2019s post, I will run through some examples of this function.<\/p>\n

Instead of using a toy 2-liner text as example, I decided to use a longer one. So, I put together some information about Florence Nightingale<\/strong><\/em> (sorry, I do not remember the source). Here is the text<\/strong><\/em><\/a>.<\/p>\n

First, we import the text from the file.<\/p>\n

\"Importing<\/a>
Importing Text File<\/strong><\/figcaption><\/figure>\n

The interesting thing is we can even ask for syntactic elements appearing in the text. Below, I am asking for all Prepositional Phrases<\/strong><\/em>\u00a0in the example text:<\/p>\n

\"Prepositional<\/a>
Prepositional Phrases<\/strong><\/figcaption><\/figure>\n

The result above shows the first 20 matches out of 28. It looks good! Since the system needs to download some resources as part of evaluating these functions, it can take several seconds when you evaluate the expression for the first time. I think there is an option to pre-download these locally so as to save time later.<\/p>\n

Next, let us look for any text fragments that express positive sentiment:<\/p>\n

\"Positive<\/a>
Positive Sentiment<\/strong><\/figcaption><\/figure>\n

Looking closely at the result, it is not clear to me how the 4th element in the result \u201cAt night, Florence walked around the hospital\u201d<\/strong><\/em><\/span> is considered to be positive. It seems to be neutral to me (because if you work in the hospital, this is normal). This could be subjective I suppose.<\/p>\n

What about negative sentiment?<\/p>\n

\"Negative<\/a>
Negative Sentiment<\/strong><\/figcaption><\/figure>\n

This looks OK to me.<\/p>\n

We can specify multiple features in the same expression. Below, I am asking for all occurrences of \u201cDate\u201d<\/strong><\/em>, \u201cLocation\u201d<\/strong> <\/em>and \u201cNumber\u201d<\/strong><\/em> appearing in the sample text.<\/p>\n

\"Multiple<\/a>
Multiple Features<\/strong><\/figcaption><\/figure>\n

If you observe carefully, you will see that the system has wrongly mapped the person \u201cFlorence\u201d<\/strong><\/em> to the city \u201cFlorence\u201d<\/strong><\/em> in some places. Looks like more training needs to be done!<\/p>\n

We can use the \u201cContaining[]\u201d<\/strong><\/em> function to extract sentences that contain certain features, for example, Pronouns<\/strong><\/em>.<\/p>\n

\"Sentences<\/a>
Sentences with Pronouns<\/strong><\/figcaption><\/figure>\n

We can also use the \u201cEntity[]\u201d<\/strong><\/em> function to look for specific entities as given here<\/strong><\/em><\/a>:<\/p>\n

\"Using<\/a>
Using Entity[] Function<\/strong><\/figcaption><\/figure>Quite interesting! Definitely a useful function in the area of NLP. One of the remarkable things about Mathematica is that it exposes functionality at the right level of abstraction, making it much easier for the user.<\/p>\n

One feature I was quite eagerly anticipating in this release is support for Text Summarization. <\/strong><\/em>I am a bit disappointed it is not there, but I am sure it would be included in a future release because summarization is a hot topic today.<\/p>\n

You can download the sample text file<\/strong><\/em><\/a>\u00a0as well as the Mathematica Notebook<\/strong><\/em><\/a>.<\/p>\n

Have a great weekend!<\/p>\n","protected":false},"excerpt":{"rendered":"

Mathematica 12 was released a few days ago.\u00a0 It has been over a year since version 11.3 came out in March 2018. The long wait appears justified since the new release boasts of numerous improvements and new features across several areas. You may want to read this blog post\u00a0by Stephen Wolfram. In the area of […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[72,107,17],"tags":[206,207],"class_list":["post-1541","post","type-post","status-publish","format-standard","hentry","category-mathematica","category-natural-language-processing","category-programming","tag-mathematica-12","tag-textcontents"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9OLnF-oR","jetpack-related-posts":[{"id":328,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/09\/11\/natural-language-processing-in-mathematica\/","url_meta":{"origin":1541,"position":0},"title":"Natural Language Processing in Mathematica","author":"admin","date":"September 11, 2016","format":false,"excerpt":"Welcome back. Today I am going to share with you some of the nice capabilities of Mathematica in the area of Natural Language Processing (NLP). Let us start with words. What if we wish to know\u00a0the various definitions of the word image?\u00a0Here is the answer. Mathematica gives the various senses\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Word Definition","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=700%2C400 2x"},"classes":[]},{"id":870,"url":"https:\/\/www.rangakrish.com\/index.php\/2018\/03\/25\/question-answering-in-mathematica\/","url_meta":{"origin":1541,"position":1},"title":"Question Answering in Mathematica","author":"admin","date":"March 25, 2018","format":false,"excerpt":"About 10 days ago, I received an update for Mathematica. The latest version is 11.3.0. As usual, I looked through the list of new features\u00a0in this release. There are several new features, but one of them attracted my attention immediately: There is a new function FindTextualAnswer\u00a0that, given a piece of\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Example 1","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2018\/03\/Example1.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2018\/03\/Example1.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2018\/03\/Example1.png?resize=525%2C300 1.5x"},"classes":[]},{"id":2131,"url":"https:\/\/www.rangakrish.com\/index.php\/2020\/09\/13\/mathematica-using-textcases-to-extract-information-from-natural-language-text\/","url_meta":{"origin":1541,"position":2},"title":"Mathematica: Using TextCases to Extract Information from Natural Language Text\u00a0","author":"admin","date":"September 13, 2020","format":false,"excerpt":"Extracting meaningful information from unstructured, human readable text is a hot topic of research today and has important applications in many domains. I have written a few blogs related to this topic, for example, see this\u00a0and this. In today\u2019s article, I would like to show how Mathematica can be a\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Extracting Sentences","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2020\/09\/ex1-2-300x106.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":3545,"url":"https:\/\/www.rangakrish.com\/index.php\/2024\/11\/09\/semantic-search-in-wolfram-mathematica\/","url_meta":{"origin":1541,"position":3},"title":"Semantic Search in Wolfram Mathematica","author":"admin","date":"November 9, 2024","format":false,"excerpt":"In an earlier article, I explained how to use OpenAI from Wolfram Mathematica ver 14.1. This latest release of Wolfram supports Semantic Search as well. In today\u2019s article, let me discuss this feature. As in the case of using LLMs, using Semantic Search requires an account with one of the\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Remedy Description","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2024\/11\/image1-300x225.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2024\/11\/image1-300x225.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2024\/11\/image1-300x225.png?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":348,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/09\/26\/computer-vision-with-mathematica\/","url_meta":{"origin":1541,"position":4},"title":"Computer Vision with Mathematica","author":"admin","date":"September 26, 2016","format":false,"excerpt":"Over the past several weeks, I have been discussing many interesting features of Mathematica. As a continuation, today, I would like to show some cool functionality in the domain of computer vision and machine learning. The function ImageIdentify[] tries to identify the object in the given image. According to the\u2026","rel":"","context":"In "Machine Learning"","block_context":{"text":"Machine Learning","link":"https:\/\/www.rangakrish.com\/index.php\/category\/machine-learning\/"},"img":{"alt_text":"A Truck","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/truck-fig.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2084,"url":"https:\/\/www.rangakrish.com\/index.php\/2020\/08\/16\/pattern-matching-comparing-elixir-and-mathematica\/","url_meta":{"origin":1541,"position":5},"title":"Pattern Matching: Comparing Elixir and Mathematica","author":"admin","date":"August 16, 2020","format":false,"excerpt":"One of the things I like about Elixir\u00a0is its support for patterns at the core language level, not through library functions as in most other languages. This contributes to writing cleaner code, in my opinion. \u00a0 Another environment that I am familiar with, namely Mathematica, boasts of (arguably) the most\u2026","rel":"","context":"In "Elixir"","block_context":{"text":"Elixir","link":"https:\/\/www.rangakrish.com\/index.php\/category\/elixir\/"},"img":{"alt_text":"Symbolic Expressions","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2020\/08\/pattern-mm.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2020\/08\/pattern-mm.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2020\/08\/pattern-mm.png?resize=525%2C300&ssl=1 1.5x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts\/1541","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/comments?post=1541"}],"version-history":[{"count":0,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts\/1541\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/media?parent=1541"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/categories?post=1541"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/tags?post=1541"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}