And while there are some scripting techniques for showing and hiding content that are above board, there are scripting techniques that serve up different content for the spider and user. As the SEO rumor mill spun this week with murmurs of the...
Use a tool like Screaming Frog SEO Spider to spider the site and identify redirects. Ah, mid-December! Unless you’re Amazon, it’s the quietest time of the year for most of us in the SEO industry. Nobody wants a mortgage or a car or life insurance.
The Spider-man robe is just as cool and they also have a Venom version, which I bought as a Christmas gift. One of the most difficult things for me is always wondering which gifts to get my friends and family.
Splitting your page information into 400 pieces of unrelated data makes your page information difficult for the spider to categorize. Use this tool to see what Google’s spider is seeing. Your site is fantastic.
Run a site spider crawl of the live site to get a good list of URLs on the current site. Keep these tips and no-nos in mind and you can keep yourself out of the CEO’s office. SEO Redesign: Teamwork First
There are many tools out there, but Screaming Frog is definitely one of the most popular/powerful scrapers and it is the spider of choice for this tutorial. This article is a simple breakdown of how to go about using an SEO site crawler to quickly...
Broken links can cause in spider traps and wasted crawl budget. Once you’ve finished your on-page SEO audit, the next step is to conduct a technical site audit. You don’t want technical issues to make it difficult for search engines to crawl and...
There are always spider traps and the web is always changing. Cutts joined Incisive Media Global VP Mike Grehan for a discussion on Panda, Penguin, social signals, duplicate content, transparency, and more.
By comparing the two numbers and filtering out any user-agent that declares itself a bot (spider or crawler) we were able to determine the total percentage of visits without JavaScript enabled. Looking at aimClear’s total organic traffic from every...
In a small touch of genius, although SEO Spider has a lot of options, all the defaults are set up to do what you most often want to do: simply crawl a site. Critically, unlike Xenu’s static reports, SEO Spider’s report format is effectively a...
The crawl rate option allows you to slow down the rate of Google’s spider’s crawl. If you don’t have a Google Webmaster Tools (GWT) account, then you need to go get one now. For the princely sum of $0 per month you get to see information directly...
For example, if you're writing about pest control (and for the record I do not work with any pest control clients), then maybe write a piece about how you're never more than a few feet away from a spider.
Our job is to make it easy for someone or some thing (say a search engine spider) to flow through our sites, to read our content, to understand our message, to interact, to buy, to convert, to achieve whatever goal we have set forth.
Told the spider when to come back meta name="revisit-after" content="30 days"> Just add meta tags and your website will magically rise to the top, right? Wrong. Meta tags are one piece in a large algorithmic puzzle that major search engines look at...
You're also giving a search engine spider a sense of which content on your site is the most important via the directional relationship of linked pages. What is the point of garnering a great inbound link profile if your site can hardly be traversed...
Basically, Google is telling us that we should use a regional subtag in our head tag on each URL to help Google’s spider figure out what kind of content is on each page and where it is intended. 2011 was a fantastic year in international search...
Avoid URL structures that can cause duplicate content and text the page template through a spider simulator to ensure that all the content and the page template can be seen by search engines. This can be especially challenging for large companies...
Screaming Frog SEO Spider (a free tool that looks like it provides some great metrics, though I haven't tested it personally). Instead of following your instinct to yell at the person who made the request, today's column will outline a practical...
SEO: Your country selector can make or break the way a spider crawls your site as well as how it serves up content domestically and globally. As a multinational company or a company that’s just launching internationally, choosing your country...
Keep your site away from Google’s spider and the spider thinks your site isn’t there. I just re-emerged to the world of the living from a week of sessions at Black Hat and DEFCON conferences here in Las Vegas.
