BA Insight New Hire Likes His Job

September 17, 2014

Navigate to “My BA Insight Enterprise Search Adventure Begins.” The enthusiasm, confidence, and Super Bowl winning attitude rips off my screen. With new executive and venture funding, BA Insight seems to be a go to solution. But is the company too closely allied with Microsoft and the aging SharePoint product? Will the forthcoming Delve (a variation on the vision for Fast Search & Transfer revealed during a talk at CERN in 2007) put pressure on the SharePoint centric outfits? I just don’t know.

Here’s the passage I find interesting. I did not have one of the goslings “fix up” the capitalization errors or add links.

As I’ve been ramping up I’ve been learning a lot about their products and solutions.  BA Insight use to be known as the connector company.  The BA Insight Longitude Connectors can connect Microsoft SharePoint to more than 30 enterprise systems for information access and cross-platform search.  They have so many connectors that allow SharePoint 2013, 2010, FAST and previous versions of SharePoint connect to a huge variety of backend systems.  Here are a few examples:  Documentum, eRooms, Websphere, Hummingbird, LiveLink, SAP, Siebel, Notes, Autonomy, FileNet, Connections, Opentext, SalesForce, Netdocs, SQL,  Docushare, and a bunch of different legal systems… I heard they recently setup a connector for Jive and are open to building a connector for companies that need one to other systems not listed.  Even with all of that, I find they don’t want to be known as simply a connector company since they really have a platform for enterprise search.  The autoclassify stuff is brilliant.  It helps set properties on your content based on your managed metadata and with a set of rules for both content already in SharePoint and for the content that will stay in these other systems.  You really need to have good metadata so you can drill down and filter your search results quickly and easily and that’s where their rich search UI comes in providing search parts that give you the ability to drill in without needing to know boolean search.   At that point it’s the smart previews that save you time.  On top of the Office Web Apps in SharePoint 2013, you get previews for PDF, ZIP, and a huge variety of other formats including the old office formats that you’d otherwise miss including to all of those systems I mentioned.  There’s even more, but I think this is a good start for understanding a few of the top products.  As an example they’ve been doing some really innovative work on hybrid search and real federation where the results are in one stream.

My question is, “Why would anyone use SharePoint when BA Insight can fill the bill as “enterprise search experts”? I think Fast Search had a good sense of what it had to do to address the limitations of its technology. The question is, “Will Microsoft want partners to siphon off revenue from the mother ship?”

Stephen E Arnold, September 17, 2014

Microsoft Azure Search is the Search of the Future

September 17, 2014

For a preview of Azure Search, visit Microsoft Azure. The article promises that Azure search is a breakthrough in “search-as-a-service for web and mobile app development.” For fast search, the future is Azure Search, the cloud platform that allows for the building, deployment and management of applications. Developers will be pleased at the ability to incorporate search without the infrastructure to worry about. The Azure client libraries are open source and available through GitHub. The article includes this information,

“Azure Search boosts development speed thanks to support for familiar tools and a consistent global cloud platform. Quickly provision search and start populating the index to get up and running quickly. Like other Azure services, Search uses familiar REST API calls. The worldwide network of Azure datacenters means reduced search latency no matter where your application is located.”

Pricing details are also available here. The pricing details include this information,

“Azure Search is sold in combinable “search units” that have a defined queries-per-second (QPS) benchmark and document count (index storage) benchmark associated with each unit.”

By combining units, users can achieve higher QPS and/or higher document count. Currently Microsoft is offering a month-long free trial, which should be enough time for anyone to ensure that it is worth the investment.

Chelsea Kerwin, September 17, 2014

Sponsored by, developer of Augmentext

Microsoft Azure Search Documentation

September 2, 2014

Microsoft has posted information about the Azure Search service. You can find the information at Azure Search Preview. The features remind me of Amazon’s cloud search approach.

The idea is that search is available. The “How It Works” section summarizes the procedures the customer follows. The approach is intended for engineers familiar with Microsoft conventions or a consultant capable of performing the required steps.

Of particular interest to potential licensees  will be the description of the pricing options. The Preview Pricing Details uses an Amazon like approach as well; for example, combinable search units. For higher demand implementations, Microsoft provides a custom price quote. The prices in the table below represent a 50 percent preview discount:


Microsoft offers different “editions” of Azure Search. Microsoft says:

Free is a free version of Azure Search designed to provide developers a sandbox to test features and implementations of Search. It is not designed for production workloads. Standard is the go-to option for building applications that benefit from a self-managed search-as-a-service solution. Standard delivers storage and predictable throughput that scales with application needs. For very high-demand applications, please contact

Support and service level agreements are available. A pricing calculator is available. Note that the estimates are not for search alone. Additional pricing information points to a page with four categories of fees and more than two dozen separate services. The link to Azure Search Pricing is self-referential, which is interesting to me.

I was not able to locate an online demo of the service. I was invited to participate in a free trial.

If you are interested in the limits for the free trial, Microsoft provides some information in its “Maximum Limits for Shared (Free) Search Service.”

Based on the documentation, correctly formed content uploaded permits full text search, facets, and hit highlighting. Specific functionalities are outlined on this reference page.

Net net: The search system is developer centric.

Stephen E Arnold, September 2, 2014

Governance Information for Office 365

August 18, 2014

Short honk: I am not sure what governance means. But search and content processing vendors bandy about words better than Serena Williams hits tennis balls. If you are governance hungry and use Office 365, Concept Searching has an “online information source” for you. More information is at My hunch is that you will learn to license some smart software to index documents. What happens when there is no Internet connection? Oh, no big deal.

Stephen E Arnold, August 18, 2014

Microsoft Puts Machine Learning in the Cloud

July 25, 2014

Machine learning is ascending to the cloud. The Register asks, “Do Data Centers Dream of Electric Sheep? Microsoft Announces Machine Learning Cloud.” As competition in the world of SaaS and remote hosting continues to escalate, this move may set Microsoft ahead of Amazon and Google (for now). Our question—will this progress rub off on Bing? One can hope.

Writer Jack Clark tells us:

“The company’s new ‘Azure ML’ service was announced on Monday and means developers can access machine learning systems hosted in the Azure cloud and even link their applications directly to them. The tech gives developers a directory of machine learning and associated technologies, including deep learning systems, that they can apply to their applications…

“Azure ML also has ‘a number of tools to help clean data,’ explained Microsoft exec Joseph Sirosh in a chat with El Reg, and has compatibility with popular mathematical software R. The service also gives users a way to drag-and-drop various machine learning technologies together so that they can build an application in a visually striking and understandable way.”

It is interesting to note that Sirosh spent nearly ten years working with (among other things) Amazon’s internal machine learning systems during his stint at that company. Though machine learning itself is nothing new, Microsoft hopes Azure ML will make it more accessible, and tempting, to developers. Likening this advance to the birth of the cloud itself, Sirosh enthuses, “Machine learning is an incredibly underutilized capability—every app around us could be becoming intelligent. I would love to have the excitement around machine learning be unleashed.”

Cynthia Murrell, July 25, 2014

Sponsored by, developer of Augmentext

Google and Microsoft Shuffle the Deck

July 18, 2014

Each company is using different card tricks.

I see a common theme in the termination of employees at Microsoft and the management redeal at Google.

I read “Beyond 12,500 Former Nokia Employees, Who Else Is Microsoft Laying Off?” I am okay with a Microsoft watcher point out that not just Nokia staff getting the axe. The comment that caught my attention reveals how serious a problem Microsoft faces. Here’s the passage I noted:

Under the new structure, a number of Windows engineers, primarily dedicated testers, will no longer be needed….Instead, program managers and development engineers will be taking on new responsibilities, such as testing hypotheses. The goal is to make the OS team work more like lean startups than a more regimented and plodding one adhering two- to three-year planning, development, testing cycles.

As I understand this, a company almost four decades into its life cycle wants to be “like lean start ups”. I am not sure if my experience is similar to that of other professionals, but working with fewer people does not equal a start up. In a start up, life is pretty crazy. Need a purchase order? Well, someone has to work up that system. Need to get reimbursed for that trade show party? No problem we’ll get a check cut. Over time, humans get tired of crazy and set up routines, systems, and procedures. The thrill of a start up is going to be difficult to emulate at Microsoft.

That’s the core problem. Microsoft has missed or just plain failed with Internet search, unified experiences across devices, online advertising, enterprise search, and improving is core applications. Adding features that a small percentage of users try is not innovation. Microsoft is no longer a start up and firing people will not make it one. Microsoft is an aircraft carrier that takes a long time to turn, to stop, and redirect. Microsoft has to demonstrate to its stakeholders that it is taking purposeful action. Firing thousands of people makes headlines. It does not create new products, services, or meaningful innovations. IBM has decided that throwing billions of dollars at project that “could” deliver big revenue is almost as wild and wooly.

Now to Google. The company reported its quarterly earnings. Cheerleaders for the company point to growth in ad revenue. The New York Times states:

Google’s revenue for the quarter was $15.96 billion, an increase of 22 percent over the year-ago quarter.

Tucked into the article were several comments I marked as indicators of the friction Google faces:

ITEM: “The price that advertisers pay each time someone clicks on an ad — or “cost per click,” in Google talk — dropped 6 percent from the year-ago quarter, largely because of the shift to increased mobile advertising.”

ITEM: “Mobile, however, is something that Facebook seems to have cracked. The social media giant accounted for almost 16 percent of mobile advertising dollars spent around the world last year, eMarketer estimates, up from 9 percent in 2012. Google dropped to a 41.5 percent share of the mobile ad market last year, down from 49.8 percent in 2012.”

ITEM: ““There’s a little bit of concern in the markets that there’s some drunken spending going on,” said Mark Mahaney, an Internet analyst with RBC Capital Markets.”

The New York Times’ article omitted one point I found interesting:

Excluding its cost of revenue, Google’s core expenses in the second quarter jumped 26 percent from last year. Source:

The Google “core expenses” are creeping up. Amazon has this problem as well. Is there a reason to worry about the online ad giant? Not for me. But the “drunken spending” comments, while clever, have the ring of truth. Then the swift departure of Glass director Babak Parviz (Amir Parviz, Amirparviz, or Parvis) suggests disenchantment somewhere between the self assembly wizard and Goggle management. After a decade of effort, Google has yet to demonstrate that it can create a no advertising revenue stream of significant magnitude for a $60 billion a year company.

Microsoft’s and Google’s recent actions make clear that both companies are trying to adapt to realities of today’s market. Both companies are under increasing pressure to “just make it work.” Three card Monte

Stephen E Arnold, July 18, 2014

Bing Search: Will It Be Forgotten

July 17, 2014

I read “Bing Implements ‘Right to Be Forgotten’ Ruling, Asks Applicants ‘Are You Famous?’” My reaction to is that search is Google. Microsoft wants to be compliant with the European Union. The Register took a different view of the situation. In a story “Forgotten Bing Responds to Search Index ECJ Rule: Hello? Remember Us?” People don’t want to be in the Google index but don’t seem to think about Bing index.

Microsoft wants respect. “Microsoft to Cut Up to 18,0000 Jobs over Next Year.” some of these soon0to-be-RIFed employees may create blogs and other online content. Microsoft executives may want to make some content about itself go away.

The comment by Daniel Ives, an analyst with FRB Capital Markets, explain the situation like this:

“Under the Ballmer era, there were many layers of management and a plethora of expensive initiatives being funded that has thus hurt the strategic and financial position the company is in, especially in light of digesting the Nokia acquisition,” says Ives. “Nadella is using today as an opportunity to make sure that Microsoft is ready and well positioned to embark on its next chapter of growth around mobile and cloud.”

What strikes me is that the observation can apply to Amazon and Google equally well. As these companies expand, generating new revenues and delivering meaningful profit becomes more and more difficult.

Microsoft’s plight may be a harbinger for other firms as well. Search is a bit of a muddle at Microsoft and time may be running out for Bing to become a substantial contributor to Microsoft’s financial position.

Stephen E Arnold, July 17, 2014

Microsoft and Its Don Quixotesque Deep Learning

July 15, 2014

I know that artificial intelligence, predictive analytics, digital brains, and the other next generation technology will revolutionize search and then everything. I will be pushing up daisies when the future arrives.

I just read “Microsoft Research Reveals Project Adam, A New Deep-Learning System That Trumps Google Brain.” Maybe the future is here. Even though I have a Windows Lumia 925, I don’t have the Windows 8.1 update. I can’t control the colors of the nifty yet obscure icons. I can’t reliably access my email. Yep, the future of Project Adam awaits me.

Wired Magazine, on the other hand, is excited:

Microsoft even brought dogs on to the stage and demoed the system in which the mobile camera recognized the dog breed when pointed at the dog.

I need to do this with my mobile phone.

Here’s another passage I liked:

Lee believes Adam could be part of what he calls an “ultimate machine intelligence,” something that could function in ways that are closer to how we humans handle different types of modalities—like speech, vision, and text—all at once. The road to that kind of technology is long—people have been working towards it since the 50s—but we’re certainly getting closer.

Yep, closer. I am looking forward to news releases and demonstrations from Microsoft’s many competitors. For me, I will be happy with a 925 upgrade that improves the rocket science of getting an email message.

Stephen E Arnold, July 15, 2014

Prepare for Double Life with Office 365

July 15, 2014

Microsoft is pushing all SharePoint clients toward Office 365 for obvious reasons. In fact, they announced discontinuing certain payment plans last month in an effort to consolidate some services. And while some organizations, particularly smaller ones, are hesitant for the transition, even early adopters are finding it is not completely seamless. The Register covers the story in their article, “Face Up to a Double Life with Hybrid Office 365.”

The author sums up the situation:

“The vision is of businesses using Office 365, running in Microsoft’s Global data centres, for collaborating, conferencing, messaging and calendaring . . . If you are migrating to Office 365 from on-premises you will need to set up a hybrid deployment to get your services migrated to the cloud. Once you have done that you can decommission your on-premises environment. But it often turns out that businesses with Exchange, SharePoint and Lync deployed on-premises will need to keep a small portion of that environment running.”

These are the sorts of hiccups that happen often with large implementations like SharePoint, especially SharePoint. Stephen E. Arnold has made his career out of following and analyzing all things search, including SharePoint. His Web service,, is a one-stop-shop for all things search. Check out his SharePoint feed to stay on top of the latest news, tips, and tricks.

Emily Rae Aldridge, July 15, 2014

Microsoft Retires Some SharePoint Online Plans

June 26, 2014

In what is sure to cause a big uproar, Microsoft is discontinuing some popular SharePoint Online payment plans. Redmond Magazine covers all the details in their article, “Microsoft Ending Some SharePoint Online Plans This Month.”

The article begins:

“Microsoft is retiring some of its SharePoint Online and Office Online plans by the end of this month, while offering other plans as substitutes. A total of four plans are going away and won’t be sold after June 30, 2014, Microsoft announced today. Those plans include SharePoint Online Plans 1 and 2 with Yammer, plus Office Online with SharePoint Plans 1 and 2. Organizations currently licensed under those expiring plans can still use the software for a year or two, depending on how the software was purchased.”

Substitutions are suggested in a helpful chart that follows. Stephen E. Arnold also has a few suggestions. He has made a living out of covering all things search, and reports his findings on His SharePoint feed is full of tips and tricks for SharePoint, as well as all manner of search options, enterprise and otherwise. And while users are bound to be frustrated over SharePoint’s pricing changes, it is doubtful that it will do anything to change the demand for its ubiquitous product.

Emily Rae Aldridge, June 26, 2014

Next Page »