Info Extraction: Improving?
November 21, 2019
Information extraction (IE) is key to machine learning and artificial intelligence (AI), especially for natural language processing (NLP). The problem with information extraction is while information is pulled from datasets it often lacks context, thusly it fails to properly categorize and rationalize the data. Good Men Project shares some hopeful news for IE in the article, “Measuring Without Labels: A Different Approach To Information Extraction.”
Current IE relies on an AI programmed with a specific set of schema that states what information needs to be extracted. A retail Web site like Amazon probably uses an IE AI programmed to extract product names, UPCs, and price, while a travel Web site like Kayak uses an IE AI to find price, airlines, dates, and hotel names. For law enforcement officials, it is particularly difficult to design schema for human trafficking, because datasets on that subject do not exist. Also traditional IE methods, such as crowdsourcing, do not work due to the sensitivity.
In order to create a reliable human trafficking dataset and prove its worth, the IE dependencies between extractions. A dependency works as:
“Consider the network illustrated in the figure above. In this kind of network, called attribute extraction network (AEN), we model each document as a node. An edge exists between two nodes if their underlying documents share an extraction (in this case, names). For example, documents D1 and D2 are connected by an edge because they share the extraction ‘Mayank.’ Note that constructing the AEN only requires the output of an IE, not a gold standard set of labels. Our primary hypothesis in the article was that, by measuring network-theoretic properties (like the degree distribution, connectivity etc.) of the AEN, correlations would emerge between these properties and IE performance metrics like precision and recall, which require a sufficiently large gold standard set of IE labels to compute. The intuition is that IE noise is not random noise, and that the non-random nature of IE noise will show up in the network metrics. Why is IE noise non-random? We believe that it is due to ambiguity in the real world over some terms, but not others.”
Using the attributes names, phone numbers, and locations, correlations were discovered. AI systems that have dependencies creates a new methodology to evaluate them. Network science relies on non-abstract interactions to test IE, but the AEN is an abstract network of IE interactions. The mistakes, in fact, allow law enforcement to use IE AI to acquire the desired information without having a practice dataset.
Whitney Grace, November 21, 2019
Comments
One Response to “Info Extraction: Improving?”
-
- Subscribe to Beyond Search
Feature archive
News archive
-
Dear Mr. Arnold,I found you through The International Tribunal for Natural Justice, under the following link : https://www.itnj.org/commission/commissioners/
I would like to talk to you personally. I tried to call the phone number listed on your website but could not get through as it seems to have been disconnected.
I have also tried to contact the Tribunal and sent a lot of information through their webpage but never got an answer.
Would it be possible to talk with you on the phone or even better meet with you in person?I live in New York city but would be very willing to fly to Louisville if needed.
Hoping to hear from you soon.Kind regards and Merry Christmas.
Sophie LaguësCell 917 484 0511