GoPubMed Sorts Searching
March 31, 2016
Do you search the US government’s PubMed.gov content? If you use the PubMed.gov system, you may want to come at the information in different or more useful ways.
The German company Transinsight makes available its search system, GoPubMed.org.
You can use the semantic search system to explore the knowledgebase.
Features of the system include:
- A sidebar which allows one click access to concepts, authors, journals, etc.
- A search box which accepts keyword queries and offers suggestions for the query
- A results list.
The layout is clear. A bit of hunting around is necessary, but that is a common experience when trying to figure out if there is a way to narrow a broad search based on a lousy query.
There have been many search systems built to make the PubMed information findable. My favorite, though long gone, was Grateful Med. Like patent searching, queries of medical information are tricky. Some day I will write about the Information Health Reference Center, circa 1989. That was exciting.
Stephen E Arnold, March 31, 2016
Patents and Semantic Search: No Good, No Good
March 31, 2016
I have been working on a profile of Palantir (open source information only, however) for my forthcoming Dark Web Notebook. I bumbled into a video from an outfit called ClearstoneIP. I noted that ClearstoneIP’s video showed how one could select from a classification system. With every click,the result set changed. For some types of searching, a user may find the point-and-click approach helpful. However, there are other ways to root through what appears to be patent applications. There are the very expensive methods happily provided by Reed Elsevier and Thomson Reuters, two find outfits. And then there are less expensive methods like Alphabet Google’s odd ball patent search system or the quite functional FreePatentsOnline service. In between, you and I have many options.
None of them is a slam dunk. When I was working through the publicly accessible Palantir Technologies’ patents, I had to fall back on my very old-fashioned method. I tracked down a PDF, printed it out, and read it. Believe me, gentle reader, this is not the most fun I have ever had. In contrast to the early Google patents, Palantir’s documents lack the detailed “background of the invention” information which the salad days’ Googlers cheerfully presented. Palantir’s write ups are slogs. Perhaps the firm’s attorneys were born with dour brain circuitry.
I did a side jaunt and came across a white paper from ClearstoneIP called “Why Semantic Searching Fails for Freedom-to-Operate (FTO).”i The 12 page write up is from a company called ClearstoneIP, which is a patent analysis company. The firm’s 12 pager is about patent searching. The company, according to its Web site is a “paradigm shifter.” The company describes itself this way:
ClearstoneIP is a California-based company built to provide industry leaders and innovators with a truly revolutionary platform for conducting product clearance, freedom to operate, and patent infringement-based analyses. ClearstoneIP was founded by a team of forward-thinking patent attorneys and software developers who believe that barriers to innovation can be overcome with innovation itself.
The “freedom to operate” phrase is a bit of legal jargon which I don’t understand. I am, thank goodness, not an attorney.
The firm’s search method makes much of the ontology, taxonomy, classification approach to information access. Hence, the reason my exploration of Palantir’s dynamic ontology with objects tossed ClearstoneIP into one of my search result sets.
The white paper is interesting if one works around the legal mumbo jumbo. The company’s approach is remarkable and invokes some of my caution light words; for example:
- “Not all patent searches are the same.”, page two
- “This all leads to the question…”, page seven
- “…there is never a single “right” way to do so.”, page eight
- “And if an analyst were to try to capture all of the ways…”, page eight
- “to capture all potentially relevant patents…”, page nine.
The absolutist approach to argument is fascinating.
Okay, what’s the ClearstoneIP search system doing? Well, it seems to me that it is taking a path to consider some of the subtlties in patent claims’ statements. The approach is very different from that taken by Brainware and its tri-gram technology. Now that Lexmark owns Brainware, the application of the Brainware system to patent searching has fallen off my radar. Brainware relied on patterns; ClearstoneIP uses the ontology-classification approach.
Both are useful in identifying patents related to a particular subject.
What is interesting in the write up is its approach to “semantics.” I highlighted in billable hour green:
Anticipating all the ways in which a product can be described is serious guesswork.
Yep, but isn’t that the role of a human with relevant training and expertise becomes important? The white paper takes the approach that semantic search fails for the ClearstoneIP method dubbed FTO or freedom to operate information access.
The white paper asserted:
Semantic
Semantic searching is the primary focus of this discussion, as it is the most evolved.
ClearstoneIP defines semantic search in this way:
Semantic patent searching generally refers to automatically enhancing a text -based query to better represent its underlying meaning, thereby better identifying conceptually related references.
I think the definition of semantic is designed to strike directly at the heart of the methods offered to lawyers with paying customers by Lexis-type and Westlaw-type systems. Lawyers to be usually have access to the commercial-type services when in law school. In the legal market, there are quite a few outfits trying to provide better, faster, and sometimes less expensive ways to make sense of the Miltonesque prose popular among the patent crowd.
The white paper, in a lawyerly way, the approach of semantic search systems. Note that the “narrowing” to the concerns of attorneys engaged in patent work is in the background even though the description seems to be painted in broad strokes:
This process generally includes: (1) supplementing terms of a text-based query with their synonyms; and (2) assessing the proximity of resulting patents to the determined underlying meaning of the text – based query. Semantic platforms are often touted as critical add-ons to natural language searching. They are said to account for discrepancies in word form and lexicography between the text of queries and patent disclosure.
The white paper offers this conclusion about semantic search:
it [semantic search] is surprisingly ineffective for FTO.
Seems reasonable, right? Semantic search assumes a “paradigm.” In my experience, taxonomies, classification schema, and ontologies perform the same intellectual trick. The idea is to put something into a cubby. Organizing information makes manifest what something is and where it fits in a mental construct.
But these semantic systems do a lousy job figuring out what’s in the Claims section of a patent. That’s a flaw which is a direct consequence of the lingo lawyers use to frame the claims themselves.
Search systems use many different methods to pigeonhole a statement. The “aboutness” of a statement or a claim is a sticky wicket. As I have written in many articles, books, and blog posts, finding on point information is very difficult. Progress has been made when one wants a pizza. Less progress has been made in finding the colleagues of the bad actors in Brussels.
Palantir requires that those adding content to the Gotham data management system add tags from a “dynamic ontology.” In addition to what the human has to do, the Gotham system generates additional metadata automatically. Other systems use mostly automatic systems which are dependent on a traditional controlled term list. Others just use algorithms to do the trick. The systems which are making friends with users strike a balance; that is, using human input directly or indirectly and some administrator only knowledgebases, dictionaries, synonym lists, etc.
ClearstoneIP keeps its eye on its FTO ball, which is understandable. The white paper asserts:
The point here is that semantic platforms can deliver effective results for patentability searches at a reasonable cost but, when it comes to FTO searching, the effectiveness of the platforms is limited even at great cost.
Okay, I understand. ClearstoneIP includes a diagram which drives home how its FTO approach soars over the competitors’ systems:
ClearstoneIP, © 2016
My reaction to the white paper is that for decades I have evaluated and used information access systems. None of the systems is without serious flaws. That includes the clever n gram-based systems, the smart systems from dozens of outfits, the constantly reinvented keyword centric systems from the Lexis-type and Westlaw-type vendor, even the simplistic methods offered by free online patent search systems like Pat2PDF.org.
What seems to be reality of the legal landscape is:
- Patent experts use a range of systems. With lots of budget, many fee and for fee systems will be used. The name of the game is meeting the client needs and obviously billing the client for time.
- No patent search system to which I have been exposed does an effective job of thinking like an very good patent attorney. I know that the notion of artificial intelligence is the hot trend, but the reality is that seemingly smart software usually cheats by formulating queries based on analysis of user behavior, facts like geographic location, and who pays to get their pizza joint “found.”
- A patent search system, in order to be useful for the type of work I do, has to index germane content generated in the course of the patent process. Comprehensiveness is simply not part of the patent search systems’ modus operandi. If there’s a B, where’s the A? If there is a germane letter about a patent, where the heck is it?
I am not on the “side” of the taxonomy-centric approach. I am not on the side of the crazy semantic methods. I am not on the side of the keyword approach when inventors use different names on different patents, Babak Parviz aliases included. I am not in favor of any one system.
How do I think patent search is evolving? ClearstoneIP has it sort of right. Attorneys have to tag what is needed. The hitch in the git along has been partially resolved by Palantir’’-type systems; that is, the ontology has to be dynamic and available to anyone authorized to use a collection in real time.
But for lawyers there is one added necessity which will not leave us any time soon. Lawyers bill; hence, whatever is output from an information access system has to be read, annotated, and considered by a semi-capable human.
What’s the future of patent search? My view is that there will be new systems. The one constant is that, by definition, a lawyer cannot trust the outputs. The way to deal with this is to pay a patent attorney to read patent documents.
In short, like the person looking for information in the scriptoria at the Alexandria Library, the task ends up as a manual one. Perhaps there will be a friendly Boston Dynamics librarian available to do the work some day. For now, search systems won’t do the job because attorneys cannot trust an algorithm when the likelihood of missing something exists.
Oh, I almost forget. Attorneys have to get paid via that billable time thing.
Stephen E Arnold, March 30, 2016
Celebros Launches Natural Language Processing Ecommerce Extension with Seven Conversions
March 9, 2016
An e-commerce site search company, Celebros, shared a news release touting their new product. Celebros, First to Launch Natural Language Site Search Extension for Magento 2.0 announces their Semantic Site Search extension for Magento 2.0. Magento 2.0 boasts the largest marketplace of e-commerce extensions in the world. This product, along with other Magento extensions, are designed to help online merchants expand their marketing and e-commerce capabilities. Celebros CMO and President of Global Sales Jeffrey Tower states,
“Celebros is proud to add the new Magento 2 extension to our existing and very successful Magento 1 extension. Celebros will offer the new extension free of charge to our entire Magento client base to ensure an easy, fast and pain-free upgrade while providing free integrations to new Celebros clients world-wide. The new extension encompasses our Natural Language Site Search in seven languages along with eight additional features that include our advanced auto-complete, guided navigation, dynamic landing pages and merchandising engine, product recommendations and more.”
For online retailers, extension products like Celebros may make or break the platforms like Magento 2.0, as these products are what add value and drive e-commerce technologies forward. It is intriguing that the Celebros natural language processing technology offers conversions available in seven languages. We live in an increasingly globalized world.
Megan Feil, March 9, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
Italian Firm Adds to the Buzzword Blizzard in an Expert Way
March 7, 2016
I don’t pay too much attention to lists of functions an information intelligence system must have. The needs are many because federation, normalization of disparate data, and real time content processing are not ready for prime time. Don’t believe me? Ask the US Army which is struggling with the challenges of DCGS-A, Palantir, and other vendors’ next generation systems in actual use in a battle zone. (See this presentation for one example.)
I read “No Time to Waste! 5 Essential Features for Your Information Intelligence Solution.” I like the idea of a company (Expert System) which was founded a quarter century ago, urging speedy action.
You can work through the well worn checklist of entity extraction, links and relationships, classification, and sticking info in a “knowledge base.” I want to focus on one point which introduces a nifty bit of jargon which I had not seen in use since I was in college decades ago.
The word is anaphora.
There you go. An anaphora, as I recall, is repetition or word substitution. Not clear? Here are a couple of examples:
Rhetorical:
For want of revenue the investors were lost.
For want of a product credibility was lost.
For want of an application the market was lost.
Grammatical:
The marketing cacophony increased and that drove off the potential customers.
Now you can work these points into your presentation when the users want actionable information which fuses available information into a meaningful output.
Because modern systems are essentially works in progress, buzzwords like anaphora take the place of dealing with real world information problems.
But marketing by thought leaders is so much more fun. That may trouble some. Parse that, gentle reader. What can one make in the midst of a blizzard of buzzwords? One hopes revenue which keeps the stock out of penny territory.
Expert System SpA, if Google Finance is accurate, about $2 a share. Roger, anaphora that.
Stephen E Arnold, March 7, 2016
Mondeca Demos
February 26, 2016
Curious about semantic technology. You may want to navigate to the Mondeca.com Web site, read about the firm’s technology and professional services, and then explore its online demos. The page with various demos includes SPARQL Endpoint Status, a Temporal Search Engine, Linked Open Vocabularies, and eight other semantic functions. You can find the demos at this link. The Mondeca Web site is at www.modeca.com.
Stephen E Arnold, February 26, 2016
Startup Semantic Machines Scores Funding
February 26, 2016
A semantic startup looks poised for success with experienced executives and a hefty investment, we learn from “Artificial Intelligence Startup Semantic Machines Raises $12.3 Million” at VentureBeat. Backed by investors from Bain Capital Ventures and General Catalyst Partners, the enterprise focuses on deep learning and improved speech recognition. The write-up reveals:
“Last year, Semantic Machines named Larry Gillick as its chief technology officer. Gillick was previously chief speech scientist for Siri at Apple. Now Semantic Machines is looking to go further than Siri and other personal digital assistants currently on the market. ‘Semantic Machines is developing technology that goes beyond understanding commands, to understanding conversations,’ the startup says on its website. ‘Our Conversational AI represents a powerful new paradigm, enabling computers to communicate, collaborate, understand our goals, and accomplish tasks.’ The startup is building tools that third-party developers will be able to use.”
Launched in 2014, Semantic Machines is based in Newton, Massachusetts, with offices in Berkeley and Boston. The startup is also seeking to hire a few researchers and engineers, in case anyone is interested.
Cynthia Murrell, February 26, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
DirectEDGAR plus DtSearch Equals Superior Search for Analysts and Researchers
February 17, 2016
The article on PRNewswire titled directEDGAR SEC Edgar Database Research Platform Now Embeds The dtSearch® Engine for Enhanced Search and Retrieval discusses the partnership between dtSearch, AcademicEDGAR+, and AppsPlus. The merger is meant to improve advanced search for analysts and academic researchers who rely on search to enable them to wade through tens of millions of documents. Why did Dr. Kealey, CEO of AcademicEDGAR+ choose dtsearch? He explains in the article,
“We have over two terabytes of SEC filings and there was no other vendor whose offering allowed immediate access to any document in the results set no matter how many documents are returned.” Dr. Kealey also notes that search granularity is critically important, and dtSearch’s unique operators extend far beyond the standard Boolean operators…To complete the implementation, AcademicEDGAR+ chose AppsPlus.”
AppsPlus has been around for over 15 years aiding in a huge range of development projects across industries. The article explains that with directEDGAR, users get more than just search. The product allows for extraction and normalization in one stop. That capability, paired with dtSearch’s instant search of terabytes, makes this partnership very exciting. Those academic researchers must be drooling into their elbow patches to get their hands on the new service.
Chelsea Kerwin, February 17, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
Barry Zane and SPARQL City Acquired by Cambridge Semantics for Graph Technology
February 12, 2016
The article titled Cambridge Semantics Acquires SPARQL City’s IP, Expanding Offering of Graph-Cased Analytics at Big Data Scale on Business Wire discusses the benefits of merging Cambridge’s Semantics’ Anzo Smart Data Platform with SPARQL City’s graph analysis capacities. The article specifically mentions the pharmaceutical industry, financial services, and homeland security as major business areas that this partnership will directly engage due to the enhanced data analysis and graph technologies now possible.
“We believe this IP acquisition is a game-changer for big data analytics and smart data discovery,” said Chuck Pieper, CEO of Cambridge Semantics. “When coupled with our Anzo Smart Data Platform, no one else in the market can provide a similar end-to-end, semantic- and graph-based solution providing for data integration, data management and advanced analytics at the scale, context and speed that meets the needs of enterprises. The SPARQL City in-memory graph query engine allows users to conduct exploratory analytics at big data scale interactively.”
Barry Zane, a leader in database analytics with 40 years experience and CEO and founder of SPARQL City, will become the VP of Engineering at Cambridge Semantics. He mentions in the article that this acquisition has been a long time coming, with the two companies working together over the last two years.
Chelsea Kerwin, February 12, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
Semantic Search: Yep, Everything You Need to Know about Semantic Search. Everything!
February 10, 2016
I love universals like “All men are mortal.” The problem is that there are not too many which click with me. I noted the write up “Everything You Need to Know about Semantic Search and What It Means for Your Website.” Very personal headline. I thought of my grandmother saying, “You should eat your spinach.” Yeah, right.
This write up is a search engine optimization take on “everything” about semantic search. Sure, there are some omissions, no code snippets, no examples of how to overcome computational bottlenecks, etc. But, hey, why quibble. This is 2016 and everything does not mean the “All men are mortal” reasoning. We are after clicks. We want sales leads. We want to be a maven.
The write up defines, illustrates with Google queries (getting smarter everyday, just maybe not with relevant results), dives into “ontology” with a diagram, gives a revisionistic glimpse of the history of semantic search, dips into the categorical affirmative barrel in “What Are All The Factors That Search Engines Use To Perform The Search?”, and offers an explanation of why semantic search is just better than old fashioned precision and recall. Oh, yeah. There is even a section which includes a superlative and this injunction:
Create high quality content.
Yep, eat your kale. Now.
If you want to become really good at semantic search, you may find that other information will be required. But, hey, this is 2016. Good enough is excellence. Close enough for SEO horse shoes is the name of the game.
Stephen E Arnold, February 10, 2016
How Often Do You Use Vocal Search
February 8, 2016
Vocal search is an idea from the future: you give a computer a query and it returns relevant information. However, vocal search has become an actual “thing” with mobile assistants like Siri, Cortana, and build in NLP engines on newer technology. I enjoy using vocal search because it saves me from having to type my query on a tiny keyboard, but when I’m in a public place I don’t use it for privacy reasons. Search Engine Watch asks the question, “What Do You Need To Know About Voice Search?” and provides answers for me more questions about vocal search.
Northstar Research conducted a study that discovered 55% percent of US teens used vocal search, while only 41% of US adults do. An even funnier fact is that 56% of US adults only use the search function, because it makes them feel tech-savvy.
Vocal Search is extremely popular in Asia due to the different alphabets. Asian languages are harder to type on a smaller keyboard. It is also a pain on Roman alphabet keyboards!
Tech companies are currently working on new innovations with vocal search. The article highlights how Google is trying to understand the semantic context behind queries for intent and accuracy.
“Superlatives, ordered items, points in time and complex combinations can now be understood to serve you more relevant answers to your questions…These ‘direct answers’ provided by Google will theoretically better match the more natural way that people ask questions in speech rather then when typing something into a search bar, where keywords can still dominate our search behaviour.”
It translates to a quicker way to access information and answer common questions without having to type on a keyboard. Now it would be a lot easier if you did not have to press a button to activate the vocal search.
Whitney Grace, February 8, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
-
- Subscribe to Beyond Search
Feature archive
News archive
-
