Google learns to crawl Flash

Posted by Ron Adler and Janis Stipins, Software Engineers

Google has been developing a new algorithm for indexing textual content in Flash files of all kinds, from Flash menus, buttons and banners, to self-contained Flash websites. Recently, we've improved the performance of this Flash indexing algorithm by integrating Adobe's Flash Player technology.

In the past, web designers faced challenges if they chose to develop a site in Flash because the content they included was not indexable by search engines. They needed to make extra effort to ensure that their content was also presented in another way that search engines could find.

Now that we've launched our Flash indexing algorithm, web designers can expect improved visibility of their published Flash content, and you can expect to see better search results and snippets. There's more info on the Webmaster Central blog about the Searchable SWF integration.

Making it better

Posted by Kristen Holway, Account Executive, Media Sales

Over the summer solstice weekend, Seattle/Kirkland Googlers posed this question to people attending the Fremont Fair: "How would you make our world, or our city, better?" The goal of the Fremont Fair "Make it Better" Project was to engage the Seattle community in an active discussion around improving our world. This is the second year we've partnered with Solid Ground to participate in the fair, a free event organized by The Workshop to benefit local efforts to address homelessness, hunger and racism. Check out the video responses to our question that were just posted on the Solid Ground YouTube channel.

Whether it's about ending poverty, improving equal access to education or any of the myriad of other challenges our world faces, we want to use our technology to stimulate creative discussion about the ideas that are important to Seattle-area citizens and to local Googlers.

I got married... with Google

Posted by Jonathan Rochelle, Product Manager, Google Docs Team

We love hearing stories about how our products help people, and let's face it -- weddings are one time when help is needed. For many couples, planning a wedding can be an organizational nightmare. But for David and Bergin Boyle, the planning turned into a fun experiment on the web.

The Boyles used Google Calendar to pick a wedding date that fit both of their schedules. They created to-do and RSVP lists with Google Docs and shared them with their relatives and friends. And they created a site containing the wedding details for their guests, complete with a personalized Google Map featuring the local Stonington, Conn., sights as well as places of note in the surrounding metropolitan areas.

As a result, David reports he was undaunted by the planning process. And with the help of Blogger's "future-dated posts" feature, the couple was able to post their wedding story on the groom's blog at the same time that they strolled down the aisle. Here's the full story in their own words. Our best wishes to the Boyles!

Using data to fight webspam

Posted by Matt Cutts, Software Engineer

This post is the latest in an ongoing series about how we harness the data we collect to improve our products and services for our users. - Ed.

As the head of the webspam team at Google, I'm in charge of making sure your search results are as relevant and informative as possible. Webspam, in case you've never heard of it, is the junk you see in search results when websites successfully cheat their way into higher positions in search results or otherwise violate search engine quality guidelines. If you've never seen webspam, here's a good example of what you might see if you click on a link in the search results that's spam (click on the image to see it larger).

You can see how unhelpful such a page would be. This example is filled with almost no original content, irrelevant links, and information that is of little use to a user. We work hard to ensure you rarely see search results like this. Imagine how annoyed you would be if you clicked on a link from a Google search result and ended up on a page like this.

Searchers don't often see blatant, outright spam like this in search results today. But webspam was much more of an issue before Google became popular and before we were able to build effective anti-spam methods. In general, webspam can be a real annoyance, such as when a search on your own name returns links to porn pages as results. But for many searches, where getting relevant information is more critical, spam is a serious problem. For example, a search for prostate cancer that's full of spam instead of relevant links greatly diminishes the value of a search engine as a helpful tool.

Data from search logs is one tool we use to fight webspam and return cleaner and more relevant results. Logs data such as IP address and cookie information make it possible to create and use metrics that measure the different aspects of our search quality (such as index size and coverage, results "freshness," and spam).

Whenever we create a new metric, it's essential to be able to go over our logs data and compute new spam metrics using previous queries or results. We use our search logs to go "back in time" and see how well Google did on queries from months before. When we create a metric that measures a new type of spam more accurately, we not only start tracking our spam success going forward, but we also use logs data to see how we were doing on that type of spam in previous months and years.

The IP and cookie information is important for helping us apply this method only to searches that are from legitimate users as opposed to those that were generated by bots and other false searches. For example, if a bot sends the same queries to Google over and over again, those queries should really be discarded before we measure how much spam our users see. All of this--log data, IP addresses, and cookie information--makes your search results cleaner and more relevant.

If you think webspam is a solved problem, think again. Last year Google faced a rash of webspam on Chinese domains in our index. Some spammers were purchasing large amounts of cheap .cn domains and stuffing them with misspellings and porn phrases. Savvy users may remember reading a few blogs about it, but most regular users never even noticed. The reason that a typical searcher didn't notice the odd results is that Google identified the .cn spam and responded with a fast-tracked engineering project to counteract that type of spam attack. Without our logs data to help identify the speed and scope of the problem, many more Google users might have been affected by this attack.

In an ideal world, the vast majority of our users wouldn't even need to know that Google has a webspam team. If we do our job well, you may see low-quality results from time to time, but you won't have to face sneaky JavaScript redirects, unwanted porn, gibberish-stuffed pages or other types of webspam. Our logs data helps ensure that Google detects and has a chance to counteract new spam trends before it lowers the quality of your search experience.

Update: Enlarged image.

Free cross-product webinar for webmasters

Posted by Jon Stona, Product Marketing Team

Three of our most useful products for website owners are Google Webmaster Tools, Google Analytics, and Google Website Optimizer. On July 8, we're joining forces to bring you a free webinar about all of them so you can learn more about how they can boost your website when used together.

Here's the trifecta:

Google Webmaster Tools is a resource to gauge the visibility of your pages on Google. It shows you which of our search queries drive traffic to your site and lets you see where your site is included in the top search results. You'll even be able to identify your top content and view the words that other sites use to link to it.

Google Analytics provides further insight on how people land and navigate on your site, regardless of whether they arrive through Google search, pay-per-click ads, or other means. You can see which geographical regions people come from, view your top landing pages, and compare the effectiveness of all your ads, e-mail newsletters, affiliate campaigns, referrals, and keywords on Google and other search engines.

Google Website Optimizer then enables you to act on the information you've gathered about your site and make concrete improvements. After identifying your high-traffic but low-converting pages, you can test different combinations of content to determine which one most yields the outcome you're looking for.

To be clear, we keep a strict wall between search and ads; your site ranking won't affect your ad placement and vice versa. Still, by using all three tools together, you'll gain a complete, detailed picture of how your site's visitors arrive, interact, and respond to changes in content or design. And if you're already using one tool, you can use your same login for the others.

Our first-ever joint webinar for Webmaster Tools, Analytics, and Website Optimizer will take place:

DATE: Tuesday, July 8
TIME: 9:00 a.m. PT (Pacific Time)
JOIN US: Register to attend

If you can't make that date, you'll be able to access an archived version of the presentation via the same registration URL. And lest you forget, you can always visit Google Webmaster Central to see everything we offer to help you build and maintain your best site.