{"id":2131,"date":"2020-09-13T14:25:43","date_gmt":"2020-09-13T08:55:43","guid":{"rendered":"https:\/\/www.rangakrish.com\/?p=2131"},"modified":"2020-09-13T14:25:43","modified_gmt":"2020-09-13T08:55:43","slug":"mathematica-using-textcases-to-extract-information-from-natural-language-text","status":"publish","type":"post","link":"https:\/\/www.rangakrish.com\/index.php\/2020\/09\/13\/mathematica-using-textcases-to-extract-information-from-natural-language-text\/","title":{"rendered":"Mathematica: Using TextCases to Extract Information from Natural Language Text\u00a0"},"content":{"rendered":"

Extracting meaningful information from unstructured, human readable text is a hot topic of research today and has important applications in many domains. I have written a few blogs related to this topic, for example, see this<\/strong><\/em><\/a>\u00a0and this<\/strong><\/em><\/a>.<\/p>\n

In today\u2019s article, I would like to show how Mathematica<\/strong><\/em><\/a> can be a great help when working with natural language text.<\/p>\n

Mathematica\u2019s Wolfram Language<\/strong> <\/em>has had, since release 10.2<\/strong><\/em>, a function called \u201cTextCases<\/a>\u201d<\/strong><\/em>\u00a0that can find interesting syntactic and semantic patterns in natural language text. The good news is that its functionality is continuously being enhanced in each release. The current version 12.1.1<\/strong><\/em> offers some incredible features that I haven\u2019t seen in any other framework or API.<\/p>\n

Let us start with a straightforward and common example. Given a paragraph, extract all the sentences contained in it. This functionality is available in many libraries.<\/p>\n

\"Extracting<\/a>
Extracting Sentences<\/strong><\/figcaption><\/figure>\n

No fancy stuff here. Next, let us ask for \u201cadjectives\u201d<\/strong><\/em> and \u201cproper nouns\u201d<\/strong><\/em> in the text.<\/p>\n

\"Adjectives\"<\/a>
Adjectives<\/strong><\/figcaption><\/figure>\n

The result shows that the function has correctly identified the requested POS<\/strong><\/em> words. This feature is also widely available.<\/p>\n

What about word groups, such as phrases? In the following, the function identifies the different \u201cnoun groups\u201d<\/strong><\/em>:<\/p>\n

\"Noun<\/a>
Noun Groups<\/strong><\/figcaption><\/figure>\n

The following is an example of \u201cquantifier phrase\u201d<\/strong><\/em>:<\/p>\n

\"Quantifier<\/a>
Quantifier Phrase<\/strong><\/figcaption><\/figure>\n

Note that the extracted item contains both a number and the corresponding measurement unit. We can also extract \u201cwh-adjective phrases\u201d<\/strong><\/em>:<\/p>\n

\"WH-Phrase\"<\/a>
WH-Phrase<\/strong><\/figcaption><\/figure>\n

We know that \u201cfortunate\u201d<\/strong><\/em> is an adjective. The \u201cWH\u201d<\/strong><\/em> words are who, whose, whom, which, what, where, when, why, how<\/strong><\/em>. <\/i>The phrase \u201chow fortunate\u201d<\/strong><\/em> is therefore a \u201cwh-adjective phrase\u201d<\/strong><\/em>.\u00a0<\/span><\/p>\n

The above examples show how we can extract \u201csyntactic\u201d<\/strong><\/em> information from the given text. Let us look at some cases involving \u201csemantic\u201d<\/strong><\/em> patterns.\u00a0<\/span><\/p>\n

The following example illustrates how we can identify sentences that mention dog \u201cbreed\u201d<\/strong><\/em>.<\/p>\n

\"Dog<\/a>
Dog Breed<\/strong><\/figcaption><\/figure>\n

Here “doberman”<\/strong><\/em> is a dog breed. The function has correctly identified that. How about checking for positive or negative sentiments? We can do that too. Look at the following example.<\/p>\n

\"Positive<\/a>
Positive Sentiment<\/strong><\/figcaption><\/figure>\n

Here we are asking for text that represents positive sentiment. The function has returned two fragments. I agree with the first one, but the second looks suspicious. In fact, I believe that the sentence \u201cShe is a hyperactive doberman\u201d<\/strong><\/em> is also positive statement.<\/p>\n

The following is an interesting case (and common too) where we extract email addresses<\/strong><\/em> and web URL<\/strong><\/em>:<\/p>\n

\"Emails\"<\/a>
Email Address<\/strong><\/figcaption><\/figure>\n

Works perfectly.<\/p>\n

Next, let us ask the function to identify country<\/strong><\/em> names and prominent persons<\/strong><\/em>.<\/p>\n

\"Countries<\/a>
Countries and Persons<\/strong><\/figcaption><\/figure>\n

\u201cIndia\u201d<\/strong><\/em> appears twice because there are two occurrences of the word in the text.<\/p>\n

Here is an interesting example from the medical<\/strong><\/em> domain. The function is able to identify body parts<\/strong><\/em> and disease<\/strong><\/em> names present in the text:<\/p>\n

\"Medical<\/a>
Medical Domain Example<\/strong><\/figcaption><\/figure>\n

Nice, isn\u2019t it?<\/p>\n

Our last example is sure to appeal to all. Here, we take the \u201cWikipedia\u201d<\/strong><\/em> text pertaining to \u201cYoga\u201d<\/strong><\/em> and extract words and phrases that are related to the concepts \u201cMythology\u201d<\/strong><\/em> or \u201cReligion\u201d<\/strong><\/em>. We then present this data as a word cloud<\/strong><\/em>:<\/p>\n

\"Mythology<\/a>
Mythology and Religion<\/strong><\/figcaption><\/figure>\n

There is a lot more that one can do with this function. If you are curious to know what content types are supported by \u201cTextCases\u201d<\/strong><\/em> function, take a look at this page<\/strong><\/em><\/a>.<\/p>\n

I hope you enjoyed this article. There are two other related functions in the Wolfram Language: \u201cTextPosition\u201d<\/strong><\/em>\u00a0and \u201cTextContents\u201d<\/strong><\/em>. I wrote an article on the latter some time ago. Check it out<\/strong><\/em><\/a>.<\/p>\n

Have a nice weekend!<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

Extracting meaningful information from unstructured, human readable text is a hot topic of research today and has important applications in many domains. I have written a few blogs related to this topic, for example, see this\u00a0and this. In today\u2019s article, I would like to show how Mathematica can be a great help when working with […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[72,107,17],"tags":[43,250,74,249],"class_list":["post-2131","post","type-post","status-publish","format-standard","hentry","category-mathematica","category-natural-language-processing","category-programming","tag-mathematica","tag-natiural-language-precessing","tag-nlp","tag-textcases"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9OLnF-yn","jetpack-related-posts":[{"id":328,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/09\/11\/natural-language-processing-in-mathematica\/","url_meta":{"origin":2131,"position":0},"title":"Natural Language Processing in Mathematica","author":"admin","date":"September 11, 2016","format":false,"excerpt":"Welcome back. Today I am going to share with you some of the nice capabilities of Mathematica in the area of Natural Language Processing (NLP). Let us start with words. What if we wish to know\u00a0the various definitions of the word image?\u00a0Here is the answer. Mathematica gives the various senses\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Word Definition","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/09\/word-data1-1024x238.png?resize=700%2C400 2x"},"classes":[]},{"id":1541,"url":"https:\/\/www.rangakrish.com\/index.php\/2019\/04\/21\/textcontents-function-in-mathematica-12\/","url_meta":{"origin":2131,"position":1},"title":"TextContents[ ] Function in Mathematica 12","author":"admin","date":"April 21, 2019","format":false,"excerpt":"Mathematica 12 was released a few days ago.\u00a0 It has been over a year since version 11.3 came out in March 2018. The long wait appears justified since the new release boasts of numerous improvements and new features across several areas. You may want to read this blog post\u00a0by Stephen\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Importing Text File","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2019\/04\/FileImport.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2019\/04\/FileImport.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2019\/04\/FileImport.png?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":870,"url":"https:\/\/www.rangakrish.com\/index.php\/2018\/03\/25\/question-answering-in-mathematica\/","url_meta":{"origin":2131,"position":2},"title":"Question Answering in Mathematica","author":"admin","date":"March 25, 2018","format":false,"excerpt":"About 10 days ago, I received an update for Mathematica. The latest version is 11.3.0. As usual, I looked through the list of new features\u00a0in this release. There are several new features, but one of them attracted my attention immediately: There is a new function FindTextualAnswer\u00a0that, given a piece of\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Example 1","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2018\/03\/Example1.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2018\/03\/Example1.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2018\/03\/Example1.png?resize=525%2C300 1.5x"},"classes":[]},{"id":2084,"url":"https:\/\/www.rangakrish.com\/index.php\/2020\/08\/16\/pattern-matching-comparing-elixir-and-mathematica\/","url_meta":{"origin":2131,"position":3},"title":"Pattern Matching: Comparing Elixir and Mathematica","author":"admin","date":"August 16, 2020","format":false,"excerpt":"One of the things I like about Elixir\u00a0is its support for patterns at the core language level, not through library functions as in most other languages. This contributes to writing cleaner code, in my opinion. \u00a0 Another environment that I am familiar with, namely Mathematica, boasts of (arguably) the most\u2026","rel":"","context":"In "Elixir"","block_context":{"text":"Elixir","link":"https:\/\/www.rangakrish.com\/index.php\/category\/elixir\/"},"img":{"alt_text":"Symbolic Expressions","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2020\/08\/pattern-mm.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2020\/08\/pattern-mm.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2020\/08\/pattern-mm.png?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":409,"url":"https:\/\/www.rangakrish.com\/index.php\/2016\/11\/02\/working-with-linguistic-data-in-mathematica\/","url_meta":{"origin":2131,"position":4},"title":"Working with Linguistic Data in Mathematica","author":"admin","date":"November 2, 2016","format":false,"excerpt":"There are many interesting functions in Mathematica for working with language data, not just in English but in many other languages too. The DictionaryLookup[] function is a good starting point. Let us see what languages are supported as part of dictionary lookup: That is a good collection. It is nice\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Supported Languages","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/11\/dict-1.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/11\/dict-1.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2016\/11\/dict-1.png?resize=525%2C300 1.5x"},"classes":[]},{"id":3545,"url":"https:\/\/www.rangakrish.com\/index.php\/2024\/11\/09\/semantic-search-in-wolfram-mathematica\/","url_meta":{"origin":2131,"position":5},"title":"Semantic Search in Wolfram Mathematica","author":"admin","date":"November 9, 2024","format":false,"excerpt":"In an earlier article, I explained how to use OpenAI from Wolfram Mathematica ver 14.1. This latest release of Wolfram supports Semantic Search as well. In today\u2019s article, let me discuss this feature. As in the case of using LLMs, using Semantic Search requires an account with one of the\u2026","rel":"","context":"In "Mathematica"","block_context":{"text":"Mathematica","link":"https:\/\/www.rangakrish.com\/index.php\/category\/mathematica\/"},"img":{"alt_text":"Remedy Description","src":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2024\/11\/image1-300x225.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2024\/11\/image1-300x225.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.rangakrish.com\/wp-content\/uploads\/2024\/11\/image1-300x225.png?resize=525%2C300&ssl=1 1.5x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts\/2131","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/comments?post=2131"}],"version-history":[{"count":0,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/posts\/2131\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/media?parent=2131"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/categories?post=2131"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rangakrish.com\/index.php\/wp-json\/wp\/v2\/tags?post=2131"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}