Despite Bing's push, Google has held its market dominance. And that's a spot that will be difficult for Bing to take over, according to Kerravala.

"I see Bing doing a lot of advertising now and that has raised the awareness of it. People do like to try something new," he added. "But Google is flat out the fastest and most accurate search engine today. Bing will need to do something completely new with search to gain ground. And Google will need to slip up. Both of those seem unlikely."