Our company have been providing SEO professional services to customers since the birth of the internet. While our approaches have developed over time, our overall aim hasn't and that's to get our customers web pages to rank on the 1st page for appropriate keywords along with only using ethical and long-lasting techniques.
Saturday, June 30, 2018
Surrey in the First World War: Football and fighting in July 1918
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/surrey-first-world-war-football-14809978
Army man from Ash Vale to become Tower of London guard
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/army-man-ash-vale-become-14841793
'Overseas aid should pay for asylum-seeking children in Surrey, not the taxpayer' says council leader
from Surrey Live - News https://www.getsurrey.co.uk/news/local-news/overseas-aid-should-pay-asylum-14841798
Horley mother’s plea to find he son who was ‘studying very hard for his A-levels’ before disappearance
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/horley-mothers-plea-find-son-14850361
Reigate Garden Centre announce when huge closing down sale will end
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/reigate-garden-centre-announce-huge-14849384
Tailbacks to Leatherhead and one injured after ten vehicle crash on M25 near Heathrow Airport
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/tailbacks-leatherhead-one-injured-after-14849813
Operation Rebate: Five arrested in Woking as police take on cross-border drug dealing
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/operation-rebate-five-arrested-woking-14848783
Friday, June 29, 2018
19 things you will only know if you grew up in Windlesham, Lightwater or Bagshot in the 00s
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/19-things-you-only-know-14834794
Banfest Music and Beer Festival will feature Ed Sheeran, Take That and AC/DC tribute acts
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/banfest-music-beer-festival-feature-14816605
Three weeks ago this cyclist was in a coma - now she is campaigning from hospital
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/three-weeks-ago-cyclist-coma-14838961
Your name on this list? Families across Surrey could be sitting on unclaimed fortunes
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/your-name-list-families-across-14831915
Battle of Britain Air Show 2018 all set to dazzle the skies
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/battle-britain-air-show-2018-14847203
Woman dies following two-car crash in East Horsley
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/woman-dies-following-two-car-14847823
Stunning Cornwall homes for sale that capture the spirit of Poldark
from Surrey Live - News https://www.getsurrey.co.uk/special-features/stunning-cornwall-homes-sale-capture-14846870
Council 'saddened' after confirming worker died at Reigate Castle after collapsing
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/council-saddened-after-confirming-worker-14846920
Man who fled after crashing mini on the M25 near Leatherhead sought by police
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/man-who-fled-after-crashing-14844857
Watch breath-taking moment injured Woking Peregrine Falcon fledgling was released back into the wild
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/watch-breath-taking-moment-injured-14845992
The spiders you could find around in your home - and some of them bite!
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/spiders-you-could-find-around-14840762
Planes revealed for RAF100 flypast over Surrey - where to stand to catch a glimpse
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/planes-revealed-raf100-flypast-over-14845398
The summer lowdown on Lagoona Aqua Park based just over the Surrey border
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/summer-lowdown-lagoona-aqua-park-14845451
World Cup afternoon tea launched at secret panoramic bar - and the views are incredible
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/food-drink-news/world-cup-afternoon-tea-launched-14834942
Salute heroic troops as they march through Aldershot for Armed Forces Day
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/whats-on-news/salute-heroic-troops-march-through-14846273
Here is how you can get ice cream delivered straight to your door in Surrey
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/here-how-you-can-ice-14846033
Woman pulled over on M25 near Reigate trying to move ALL her possessions at once
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/woman-pulled-over-m25-near-14846245
Man dies after collapsing outside Reigate Castle despite 'best efforts of everyone at the scene'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/man-dies-after-collapsing-outside-14845696
78 sumptuous afternoon teas to enjoy around Surrey
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/food-drink-news/best-places-for-afternoon-tea-8676504
The weekend weather where you are in Surrey and when it might rain next week
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/weekend-weather-you-surrey-might-14844564
5 creams and products to help treat horsefly bites this summer
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/5-creams-products-help-treat-14844759
Horsefly bites advice - how to tell you've been bitten and what you should do
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/horsefly-bites-advice-how-tell-14844106
Teen banned from Sunbury Cross Shopping Centre after causing ‘chaos in the local community’
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/teen-banned-sunbury-cross-shopping-14843929
Weybridge man found guilty of numerous child sex offences
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/weybridge-man-found-guilty-numerous-14842951
Fitness Space and David Clulow are coming to Guildford's Tunsgate Quarter
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/shopping/fitness-space-david-clulow-coming-14843025
Surrey Coroner investigating death of Farnham rugby player Richard Brember on the Hog's Back
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/surrey-coroner-investigating-death-farnham-14842979
South Western Railway suffers delays or disruption for 31 days straight
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/south-western-railway-suffers-delays-14839646
What Do SEOs Do When Google Removes Organic Search Traffic? - Whiteboard Friday
Posted by randfish
We rely pretty heavily on Google, but some of their decisions of late have made doing SEO more difficult than it used to be. Which organic opportunities have been taken away, and what are some potential solutions? Rand covers a rather unsettling trend for SEO in this week's Whiteboard Friday.
Video Transcription
Howdy, Moz fans, and welcome to another edition of Whiteboard Friday. This week we're talking about something kind of unnerving. What do we, as SEOs, do as Google is removing organic search traffic?
So for the last 19 years or 20 years that Google has been around, every month Google has had, at least seasonally adjusted, not just more searches, but they've sent more organic traffic than they did that month last year. So this has been on a steady incline. There's always been more opportunity in Google search until recently, and that is because of a bunch of moves, not that Google is losing market share, not that they're receiving fewer searches, but that they are doing things that makes SEO a lot harder.
Some scary news
Things like...
- Aggressive "answer" boxes. So you search for a question, and Google provides not just necessarily a featured snippet, which can earn you a click-through, but a box that truly answers the searcher's question, that comes directly from Google themselves, or a set of card-style results that provides a list of all the things that the person might be looking for.
- Google is moving into more and more aggressively commercial spaces, like jobs, flights, products, all of these kinds of searches where previously there was opportunity and now there's a lot less. If you're Expedia or you're Travelocity or you're Hotels.com or you're Cheapflights and you see what's going on with flight and hotel searches in particular, Google is essentially saying, "No, no, no. Don't worry about clicking anything else. We've got the answers for you right here."
- We also saw for the first time a seasonally adjusted drop, a drop in total organic clicks sent. That was between August and November of 2017. It was thanks to the Jumpshot dataset. It happened at least here in the United States. We don't know if it's happened in other countries as well. But that's certainly concerning because that is not something we've observed in the past. There were fewer clicks sent than there were previously. That makes us pretty concerned. It didn't go down very much. It went down a couple of percentage points. There's still a lot more clicks being sent in 2018 than there were in 2013. So it's not like we've dipped below something, but concerning.
- New zero-result SERPs. We absolutely saw those for the first time. Google rolled them back after rolling them out. But, for example, if you search for the time in London or a Lagavulin 16, Google was showing no results at all, just a little box with the time and then potentially some AdWords ads. So zero organic results, nothing for an SEO to even optimize for in there.
- Local SERPs that remove almost all need for a website. Then local SERPs, which have been getting more and more aggressively tuned so that you never need to click the website, and, in fact, Google has made it harder and harder to find the website in both mobile and desktop versions of local searches. So if you search for Thai restaurant and you try and find the website of the Thai restaurant you're interested in, as opposed to just information about them in Google's local pack, that's frustratingly difficult. They are making those more and more aggressive and putting them more forward in the results.
Potential solutions for marketers
So, as a result, I think search marketers really need to start thinking about: What do we do as Google is taking away this opportunity? How can we continue to compete and provide value for our clients and our companies? I think there are three big sort of paths — I won't get into the details of the paths — but three big paths that we can pursue.
1. Invest in demand generation for your brand + branded product names to leapfrog declines in unbranded search.
The first one is pretty powerful and pretty awesome, which is investing in demand generation, rather than just demand serving, but demand generation for brand and branded product names. Why does this work? Well, because let's say, for example, I'm searching for SEO tools. What do I get? I get back a list of results from Google with a bunch of mostly articles saying these are the top SEO tools. In fact, Google has now made a little one box, card-style list result up at the top, the carousel that shows different brands of SEO tools. I don't think Moz is actually listed in there because I think they're pulling from the second or the third lists instead of the first one. Whatever the case, frustrating, hard to optimize for. Google could take away demand from it or click-through rate opportunity from it.
But if someone performs a search for Moz, well, guess what? I mean we can nail that sucker. We can definitely rank for that. Google is not going to take away our ability to rank for our own brand name. In fact, Google knows that, in the navigational search sense, they need to provide the website that the person is looking for front and center. So if we can create more demand for Moz than there is for SEO tools, which I think there's something like 5 or 10 times more demand already for Moz than there is tools, according to Google Trends, that's a great way to go. You can do the same thing through your content, through your social media, and through your email marketing. Even through search you can search and create demand for your brand rather than unbranded terms.
2. Optimize for additional platforms.
Second thing, optimizing across additional platforms. So we've looked and YouTube and Google Images account for about half of the overall volume that goes to Google web search. So between these two platforms, you've got a significant amount of additional traffic that you can optimize for. Images has actually gotten less aggressive. Right now they've taken away the "view image directly" link so that more people are visiting websites via Google Images. YouTube, obviously, this is a great place to build brand affinity, to build awareness, to create demand, this kind of demand generation to get your content in front of people. So these two are great platforms for that.
There are also significant amounts of web traffic still on the social web — LinkedIn, Facebook, Twitter, Pinterest, Instagram, etc., etc. The list goes on. Those are places where you can optimize, put your content forward, and earn traffic back to your websites.
3. Optimize the content that Google does show.
Local
So if you're in the local space and you're saying, "Gosh, Google has really taken away the ability for my website to get the clicks that it used to get from Google local searches," going into Google My Business and optimizing to provide information such that people who perform that query will be satisfied by Google's result, yes, they won't get to your website, but they will still come to your business, because you've optimized the content such that Google is showing, through Google My Business, such that those searchers want to engage with you. I think this sometimes gets lost in the SEO battle. We're trying so hard to earn the click to our site that we're forgetting that a lot of search experience ends right at the SERP itself, and we can optimize there too.
Results
In the zero-results sets, Google was still willing to show AdWords, which means if we have customer targets, we can use remarketed lists for search advertising (RLSA), or we can run paid ads and still optimize for those. We could also try and claim some of the data that might show up in zero-result SERPs. We don't yet know what that will be after Google rolls it back out, but we'll find out in the future.
Answers
For answers, the answers that Google is giving, whether that's through voice or visually, those can be curated and crafted through featured snippets, through the card lists, and through the answer boxes. We have the opportunity again to influence, if not control, what Google is showing in those places, even when the search ends at the SERP.
All right, everyone, thanks for watching for this edition of Whiteboard Friday. We'll see you again next week. Take care.
Video transcription by Speechpad.com
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
from The Moz Blog http://tracking.feedpress.it/link/9375/9594400
Thursday, June 28, 2018
Incredible steam engine rolls through Surrey and it's not too late to catch it again
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/incredible-steam-engine-rolls-through-14842879
This Surrey home is an unbelievable £800,000 a month to rent - and it’s only got one bedroom
from Surrey Live - News https://www.getsurrey.co.uk/news/property-news/surrey-home-unbelievable-800000-month-14842769
Body of man found in Fetcham alongside 'hazardous materials' as neighbours evacuated
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/body-man-found-fetcham-alongside-14842317
Travellers move one mile to Ashley Park, Walton, after eviction from Oatlands Recreation Ground, Weybridge
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/travellers-move-one-mile-ashley-14842151
IT worker claims University of Creative Arts discriminated against him because he was a man
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/worker-claims-university-creative-arts-14842477
How to keep your pet dog cool in a heatwave, according to the RSPCA
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/how-keep-your-pet-dog-14841957
The reason why you didn't feel the earthquake in Dorking
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/reason-you-didnt-feel-earthquake-14839880
Council go to court to try to remove travellers from Kennel Lane Recreation Ground, Fetcham
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/council-go-court-try-remove-14839600
Teacher injured in abseiling accident fails in multi million pound bid for compensation
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/teacher-injured-abseiling-accident-fails-14837287
Waitrose, Tesco, Aldi and ASDA recall own brand soy sauce over fears it contains glass
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/waitrose-tesco-aldi-asda-recall-14839878
Why you should be locking up this common household item during a heat wave
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/you-should-locking-up-common-14836951
Addlestone car wash attacker loses jail sentence appeal
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/addlestone-car-wash-attacker-loses-14840450
Factor 30 sun cream recalled because it is actually factor zero
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/factor-30-sun-cream-recalled-14840283
Disbelief as council hastily scrubs off 'SLOW C*** ROAD' at Godalming pothole hotspot
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/disbelief-council-hastily-scrubs-slow-14834484
Sentimental jewellery stolen from woman in her eighties 'by man claiming to look for leak'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/sentimental-jewellery-stolen-woman-eighties-14839391
Search underway to trace men after two-mile Godstone police car chase
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/search-underway-trace-men-after-14839108
Horses found abandoned in Cranleigh leads to hunt for owner
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/horses-found-abandoned-cranleigh-leads-14839145
M25 closed overnight for emergency resurfacing work after three-lorry crash caused 500 litre diesel spillage
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/m25-closed-overnight-emergency-resurfacing-14839519
Frensham Great Pond closed due to toxic blue-green algae
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/frensham-great-pond-closed-due-14839450
See devastating aftermath after fire destroys part of East Molesey home and damages 'multiple properties'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/see-devastating-aftermath-after-fire-14838884
Man arrested outside George Abbot School in Burpham after elderly woman and teenager 'assaulted'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/man-arrested-outside-george-abbot-14838987
Schoolgirl approached in Oxted by stranger in car
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/schoolgirl-approached-oxted-stranger-car-14839053
Interactive map shows 15 Surrey sites travellers have moved onto this month
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/interactive-map-shows-15-surrey-14835440
RSPCA release sorry looking list of excuses from owners who left dogs in hot cars
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/rspca-release-sorry-looking-list-14835658
Tentative route for aviation fuel pipeline proposed by Esso
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/tentative-route-aviation-fuel-pipeline-14835712
Shocking video shows huge fire burning across four Long Ditton gardens
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/shocking-video-shows-huge-fire-14837215
The Minimum Viable Knowledge You Need to Work with JavaScript & SEO Today
Posted by sergeystefoglo
If your work involves SEO at some level, you’ve most likely been hearing more and more about JavaScript and the implications it has on crawling and indexing. Frankly, Googlebot struggles with it, and many websites utilize modern-day JavaScript to load in crucial content today. Because of this, we need to be equipped to discuss this topic when it comes up in order to be effective.
The goal of this post is to equip you with the minimum viable knowledge required to do so. This post won’t go into the nitty gritty details, describe the history, or give you extreme detail on specifics. There are a lot of incredible write-ups that already do this — I suggest giving them a read if you are interested in diving deeper (I’ll link out to my favorites at the bottom).
In order to be effective consultants when it comes to the topic of JavaScript and SEO, we need to be able to answer three questions:
- Does the domain/page in question rely on client-side JavaScript to load/change on-page content or links?
- If yes, is Googlebot seeing the content that’s loaded in via JavaScript properly?
- If not, what is the ideal solution?
With some quick searching, I was able to find three examples of landing pages that utilize JavaScript to load in crucial content.
I’m going to be using Sitecore’s Symposium landing page through each of these talking points to illustrate how to answer the questions above.
We’ll cover the “how do I do this” aspect first, and at the end I’ll expand on a few core concepts and link to further resources.
Question 1: Does the domain in question rely on client-side JavaScript to load/change on-page content or links?
The first step to diagnosing any issues involving JavaScript is to check if the domain uses it to load in crucial content that could impact SEO (on-page content or links). Ideally this will happen anytime you get a new client (during the initial technical audit), or whenever your client redesigns/launches new features of the site.
How do we go about doing this?
Ask the client
Ask, and you shall receive! Seriously though, one of the quickest/easiest things you can do as a consultant is contact your POC (or developers on the account) and ask them. After all, these are the people who work on the website day-in and day-out!
“Hi [client], we’re currently doing a technical sweep on the site. One thing we check is if any crucial content (links, on-page content) gets loaded in via JavaScript. We will do some manual testing, but an easy way to confirm this is to ask! Could you (or the team) answer the following, please?
1. Are we using client-side JavaScript to load in important content?
2. If yes, can we get a bulleted list of where/what content is loaded in via JavaScript?”
Check manually
Even on a large e-commerce website with millions of pages, there are usually only a handful of important page templates. In my experience, it should only take an hour max to check manually. I use the Chrome Web Developers plugin, disable JavaScript from there, and manually check the important templates of the site (homepage, category page, product page, blog post, etc.)
In the example above, once we turn off JavaScript and reload the page, we can see that we are looking at a blank page.
As you make progress, jot down notes about content that isn’t being loaded in, is being loaded in wrong, or any internal linking that isn’t working properly.
At the end of this step we should know if the domain in question relies on JavaScript to load/change on-page content or links. If the answer is yes, we should also know where this happens (homepage, category pages, specific modules, etc.)
Crawl
You could also crawl the site (with a tool like Screaming Frog or Sitebulb) with JavaScript rendering turned off, and then run the same crawl with JavaScript turned on, and compare the differences with internal links and on-page elements.
For example, it could be that when you crawl the site with JavaScript rendering turned off, the title tags don’t appear. In my mind this would trigger an action to crawl the site with JavaScript rendering turned on to see if the title tags do appear (as well as checking manually).
Example
For our example, I went ahead and did a manual check. As we can see from the screenshot below, when we disable JavaScript, the content does not load.
In other words, the answer to our first question for this pages is “yes, JavaScript is being used to load in crucial parts of the site.”
Question 2: If yes, is Googlebot seeing the content that’s loaded in via JavaScript properly?
If your client is relying on JavaScript on certain parts of their website (in our example they are), it is our job to try and replicate how Google is actually seeing the page(s). We want to answer the question, “Is Google seeing the page/site the way we want it to?”
In order to get a more accurate depiction of what Googlebot is seeing, we need to attempt to mimic how it crawls the page.
How do we do that?
Use Google’s new mobile-friendly testing tool
At the moment, the quickest and most accurate way to try and replicate what Googlebot is seeing on a site is by using Google’s new mobile friendliness tool. My colleague Dom recently wrote an in-depth post comparing Search Console Fetch and Render, Googlebot, and the mobile friendliness tool. His findings were that most of the time, Googlebot and the mobile friendliness tool resulted in the same output.
In Google’s mobile friendliness tool, simply input your URL, hit “run test,” and then once the test is complete, click on “source code” on the right side of the window. You can take that code and search for any on-page content (title tags, canonicals, etc.) or links. If they appear here, Google is most likely seeing the content.
Search for visible content in Google
It’s always good to sense-check. Another quick way to check if GoogleBot has indexed content on your page is by simply selecting visible text on your page, and doing a site:search for it in Google with quotations around said text.
In our example there is visible text on the page that reads…
"Whether you are in marketing, business development, or IT, you feel a sense of urgency. Or maybe opportunity?"
When we do a site:search for this exact phrase, for this exact page, we get nothing. This means Google hasn’t indexed the content.
Crawling with a tool
Most crawling tools have the functionality to crawl JavaScript now. For example, in Screaming Frog you can head to configuration > spider > rendering > then select “JavaScript” from the dropdown and hit save. DeepCrawl and SiteBulb both have this feature as well.
From here you can input your domain/URL and see the rendered page/code once your tool of choice has completed the crawl.
Example:
When attempting to answer this question, my preference is to start by inputting the domain into Google’s mobile friendliness tool, copy the source code, and searching for important on-page elements (think title tag, <h1>, body copy, etc.) It’s also helpful to use a tool like diff checker to compare the rendered HTML with the original HTML (Screaming Frog also has a function where you can do this side by side).
For our example, here is what the output of the mobile friendliness tool shows us.
After a few searches, it becomes clear that important on-page elements are missing here.
We also did the second test and confirmed that Google hasn’t indexed the body content found on this page.
The implication at this point is that Googlebot is not seeing our content the way we want it to, which is a problem.
Let’s jump ahead and see what we can recommend the client.
Question 3: If we’re confident Googlebot isn’t seeing our content properly, what should we recommend?
Now we know that the domain is using JavaScript to load in crucial content and we know that Googlebot is most likely not seeing that content, the final step is to recommend an ideal solution to the client. Key word: recommend, not implement. It’s 100% our job to flag the issue to our client, explain why it’s important (as well as the possible implications), and highlight an ideal solution. It is 100% not our job to try to do the developer’s job of figuring out an ideal solution with their unique stack/resources/etc.
How do we do that?
You want server-side rendering
The main reason why Google is having trouble seeing Sitecore’s landing page right now, is because Sitecore’s landing page is asking the user (us, Googlebot) to do the heavy work of loading the JavaScript on their page. In other words, they’re using client-side JavaScript.
Googlebot is literally landing on the page, trying to execute JavaScript as best as possible, and then needing to leave before it has a chance to see any content.
The fix here is to instead have Sitecore’s landing page load on their server. In other words, we want to take the heavy lifting off of Googlebot, and put it on Sitecore’s servers. This will ensure that when Googlebot comes to the page, it doesn’t have to do any heavy lifting and instead can crawl the rendered HTML.
In this scenario, Googlebot lands on the page and already sees the HTML (and all the content).
There are more specific options (like isomorphic setups)
This is where it gets to be a bit in the weeds, but there are hybrid solutions. The best one at the moment is called isomorphic.
In this model, we're asking the client to load the first request on their server, and then any future requests are made client-side.
So Googlebot comes to the page, the client’s server has already executed the initial JavaScript needed for the page, sends the rendered HTML down to the browser, and anything after that is done on the client-side.
If you’re looking to recommend this as a solution, please read this post from the AirBNB team which covers isomorphic setups in detail.
AJAX crawling = no go
I won’t go into details on this, but just know that Google’s previous AJAX crawling solution for JavaScript has since been discontinued and will eventually not work. We shouldn’t be recommending this method.
(However, I am interested to hear any case studies from anyone who has implemented this solution recently. How has Google responded? Also, here’s a great write-up on this from my colleague Rob.)
Summary
At the risk of severely oversimplifying, here's what you need to do in order to start working with JavaScript and SEO in 2018:
- Know when/where your client’s domain uses client-side JavaScript to load in on-page content or links.
- Ask the developers.
- Turn off JavaScript and do some manual testing by page template.
- Crawl using a JavaScript crawler.
- Check to see if GoogleBot is seeing content the way we intend it to.
- Google’s mobile friendliness checker.
- Doing a site:search for visible content on the page.
- Crawl using a JavaScript crawler.
- Give an ideal recommendation to client.
- Server-side rendering.
- Hybrid solutions (isomorphic).
- Not AJAX crawling.
Further resources
- The Ultimate Guide to JavaScript SEO
- JavaScript and SEO: The Difference Between Crawling and Indexing
- Core Principles of SEO for JavaScript
- How to Audit JavaScript for SEO
- JavaScript SEO Resources
- View Source: Why it Still Matters and How to Quickly Compare it to a Rendered DOM
I’m really interested to hear about any of your experiences with JavaScript and SEO. What are some examples of things that have worked well for you? What about things that haven’t worked so well? If you’ve implemented an isomorphic setup, I’m curious to hear how that’s impacted how Googlebot sees your site.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
from The Moz Blog http://tracking.feedpress.it/link/9375/9584451
Wednesday, June 27, 2018
Badly damaged coach drives SIX MILES on M25 after failing to stop for crash
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/badly-damaged-coach-drives-six-14833939
M25 closed and eight-mile traffic queues as three-lorry crash causes huge diesel spillage
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/m25-closed-eight-mile-traffic-14837238
How to keep your pets cool and safe during a summer heatwave
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/how-keep-your-pets-cool-11634227
Gouge in tarmac as Ockham and Godalming roads melt in heatwave
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/gouge-tarmac-ockham-godalming-roads-14836087
Babies and young children in heatwave weather - keeping them cool and helping them sleep
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/babies-young-children-heatwave-weather-11633897
Your best chance of spotting Saturn when it appears over Surrey skies this week
from Surrey Live - News https://www.getsurrey.co.uk/weather/your-best-chance-spotting-saturn-14834675
How to stop skin peeling after sunburn - hints and tips to avoid, treat and heal
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/how-stop-skin-peeling-sunburn-13218428
RAF100 flypast to go over Surrey in 'once in a lifetime event'
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/raf100-flypast-go-over-surrey-14833848
Here's where you can see the Cathedrals Express pass through Surrey
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/whats-on-news/heres-you-can-see-cathedrals-14829277
Burglars who sprayed corrosive substance into face of pregnant Epsom woman have been jailed
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/burglars-who-sprayed-corrosive-substance-14833868
How hot is too hot to work in an office? Your rights explained during the heatwave
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/how-hot-too-work-office-11634764
What temperature is too hot for school? Teachers' union outlines the guidelines
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/what-temperature-too-hot-school-13206701
Delivery van burnt out after fire in Guildford Road Cranleigh started by 'flat tyre'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/delivery-van-burnt-out-after-14833539
St John the Baptist Woking 'delighted' to top table in Surrey in Real Schools Guide 2018
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/st-john-baptist-woking-delighted-14828648
A24 average speed cameras between Dorking and Leatherhead being activated in next few days
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/a24-average-speed-cameras-between-14827500
When is Farnborough Airshow 2018, what you can expect and how you can get tickets
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/farnborough-airshow-2018-what-you-14827114
Mercers Lake drowning victim named locally as Edward Savage as community reacts with shock
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/mercers-lake-drowning-victim-named-14831670
Tuesday, June 26, 2018
Real Schools Guide 2018 has every secondary school in Surrey rated and ranked
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/real-schools-guide-2018-every-14832364
IT manager hacked St John's School Leatherhead's CCTV and computer systems to hide fraud
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/manager-hacked-st-johns-school-14803360
Pebble Hill closed and two injured after head on collision near Betchworth Station
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/pebble-hill-closed-two-injured-14832440
Stoke Park paddling pool closed on hottest day of the year due to 'serious leaks'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/stoke-park-paddling-pool-closed-14831690
South Western Railway delays expected until end of service after fire 'welds train to tracks'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/south-western-railway-delays-expected-14832068
81-year-old Surrey grandad will pay tribute to his late wife by jumping out of plane
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/81-year-old-surrey-grandad-14825475
Three Elmbridge men charged with number of keyless car thefts across Surrey
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/three-elmbridge-men-charged-number-14831538
Amanda Holden tweets CCTV footage of Richmond motorbike gang attempting to rob mother and child
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/amanda-holden-tweets-cctv-footage-14831106
Body found on MoD land in Sandhurst may be that of homeless woman
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/body-found-mod-land-sandhurst-14831336
16 summery things to do in Surrey when the sun is out
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/16-summery-things-surrey-sun-13095363
Know an animal hero? Then nominate them for an award!
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/know-animal-hero-nominate-award-14830722
Community shocked by alleged rape in 'lovely' Fleet woodland
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/community-shocked-alleged-rape-lovely-14827353
Number one bus in Camberley sees female passenger steal 'handful of change'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/number-one-bus-camberley-sees-14724595
Caravan decimated by possible gas cylinder fire in Mytchett
from Surrey Live - News https://www.getsurrey.co.uk/news/hampshire-news/caravan-decimated-possible-gas-cylinder-14829134
Merstham skate park closed after arsonists set fire to ramp
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/merstham-skate-park-closed-after-14827870
Statue of Suffragette Emily Davison set to be erected in Epsom town centre next June
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/statue-suffragette-emily-davison-set-14815378
The law on keeping your kids home from school during a heatwave
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/kids-home-school-heat-wave-14829673
Real Schools Guide 2018 rates four schools on Surrey border in national top 10
from Surrey Live - News https://www.getsurrey.co.uk/news/local-news/real-schools-guide-2018-rates-14828934
Well House Inn in Mugswell and Punchbowl Inn on Okewood Hill have been sold
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/well-house-inn-mugswell-punchbowl-14813113
Lidl is selling a bargain tower fan and it is going to fly off the shelves
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/shopping/lidl-selling-bargain-tower-fan-14829226
Warning about dangers of swimming in open water after body is found in Mercers Lake
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/warning-dangers-swimming-open-water-14829303
Investigation launched after body found on 'MoD land' at Sandhurst
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/investigation-launched-after-body-found-14829550
Jack Russell rescued from 44.5°C van in Farnham as temperatures climb across Surrey
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/jack-russell-rescued-445c-van-14828769
18 delicious places for ice cream in Surrey
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/food-drink-news/ice-cream-summer-sunny-surrey-9561555
Huge changes for Surrey as Heathrow expansion gets backing from MPs
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/huge-changes-surrey-heathrow-expansion-14823881
RSPCA advice on what to do if you see a dog in a hot car
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/what-you-should-you-see-14548998
South Western Railway delays as soaring temperatures cause tracks to buckle in heat
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/south-western-railway-delays-soaring-14828921
Police patrols stepped up to prevent 'reprisals' after Chessington stabbing
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/police-patrols-stepped-up-prevent-14825784
South Sitting car meet in Ladymead broken up by police due to 'anti-social behaviour'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/south-sitting-car-meet-ladymead-14828492
Jail for trucker who went wrong way down A3 while three times over the limit
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/jail-trucker-who-went-wrong-14826925
Monday, June 25, 2018
Heavy traffic and two-hour delays on M25 after seven-car crash near Godstone
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/heavy-traffic-two-hour-delays-14827765
Flames break out on Horsell Common in fourth wildfire in eight days
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/flames-break-out-horsell-common-14827694
Two men arrested after alleged rape of young woman in Fleet 'woodland'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/two-men-arrested-after-alleged-14827227
What are the best schools in Surrey? County's top 10 rated by Real Schools Guide
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/what-best-schools-surrey-countys-14816035
Smyths Toys is urgently recalling these Nerf products due to a 'laceration or collision hazard to young children'
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/smyths-toys-urgently-recalling-nerf-14826945
Dorking Ducklings swim group faces possible closure as it can't use Wotton House anymore
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/dorking-ducklings-swim-group-faces-14813901
25 pub gardens, roof terraces and restaurants you need to visit in Surrey this summer
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/food-drink-news/21-terraces-around-surrey-hampshire-11710872
Travellers move onto Leg O'Mutton Field in Cobham
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/travellers-move-onto-leg-omutton-14825879
Government advisor says obese Surrey workers should be allowed to start work an hour later than their skinny colleagues
from Surrey Live - News https://www.getsurrey.co.uk/news/health/government-advisor-says-obese-surrey-14825717
Morning traffic chaos on M25 after three crashes and two broken down vehicles
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/morning-traffic-chaos-m25-after-14825356
Woman in 20s raped in 'large area of woodland' in Fleet
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/woman-20s-raped-large-area-14824814
Drone pictures show devastation on Whitmoor Common after wildfire destroys 30 acres of land
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/drone-pictures-show-devastation-whitmoor-14824490
Swan sanctuary believes birds on the Thames were deliberately doused in pink dye
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/swan-sanctuary-believes-birds-thames-14824337
Luxury riverside home on private island for sale but you can only reach it by boat
from Surrey Live - News https://www.getsurrey.co.uk/news/property-news/luxury-riverside-home-private-island-14813065
Body of man in 70s found in car parked up at side of Tadworth road
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/body-man-70s-found-car-14823831
Virat Kohli superfan makes doomed 10,000 mile trip to meet idol in Guildford
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/virat-kohli-superfan-makes-doomed-14804533
Sunday, June 24, 2018
Money Saving Expert Martin Lewis reveals financial benefits to getting married
from Surrey Live - News https://www.getsurrey.co.uk/news/business/money-saving-expert-martin-lewis-14822523
There's a full size regal throne you can sit on at The Red Lion Betchworth
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/theres-full-size-regal-throne-14814064
Burglar steals £500 worth of razors from Camberley store
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/burglar-steals-500-worth-razors-14810478
Aldi is selling a really cheap paddling pool in time for Surrey heatwave
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/shopping/aldi-selling-really-cheap-paddling-14821550
Aldershot Lido summer opening times and prices for 2018
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/aldershot-lido-summer-opening-times-14542206
Guildford Lido opening times, prices and outdoor cinema dates for 2018
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/guildford-lido-opening-times-prices-11371928
Summer opening times for this amazing waterpark just across the Surrey border
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/summer-opening-times-amazing-waterpark-14741875
22 swimming pools and lidos in Surrey and Hampshire
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/swimming-pools-lidos-surrey-hampshire-9005909
Cyclist hospitalised with potential life threatening injuries after crash with car near Ockley
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/cyclist-hospitalised-potential-life-threatening-14821497
Saturday, June 23, 2018
Six unexpected heroes and everyday heroes of Mole Valley
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/six-unexpected-heroes-everyday-heroes-14814071
Lidl sells its own version of Aperol - and it costs almost half the price
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/shopping/lidl-sells-version-aperol-costs-14819787
Holiday company launches blind date package to Prague with flights from London
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/whats-on-news/holiday-company-launches-blind-date-14820350
Loose sheep on road caused delays on Staines Bypass
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/loose-sheep-road-caused-delays-14820091
The Ivy Castle View in Guildford serves afternoon tea and yes, it looks pretty sumptuous
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/food-drink-news/ivy-castle-view-guildford-serves-14819684
Dinosaur World Live is coming to Surrey and here's where you can see it
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/dinosaur-world-live-coming-surrey-14815878
Family rave featuring glow sticks, UV face painting, bubbles and ball ponds sounds amazing fun
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/family-rave-featuring-glow-sticks-14815291
22 beaches in easy reach of Surrey (including a few secret ones, shhh!)
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/nearest-sandy-beaches-to-surrey-9833696
Anyone placing a bet is being urged to look out for vulnerable missing Epsom man
from Surrey Live - News https://www.getsurrey.co.uk/news/anyone-placing-bet-being-urged-14819804
42 pretty picnic spots in Surrey to head to on a sunny day
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/42-pretty-picnic-spots-surrey-9012332
Discounted family cinema screenings near you - tickets from £2.50 at Vue, Odeon and Cineworld
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/family-kids-news/discounted-family-cinema-screenings-near-14816479
Friday, June 22, 2018
Turner Prize-Winning artist unveils new Magna Carta sculpture in Runnymede
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/turner-prize-winning-artist-unveils-14818730
Teenagers charged with attempted murder after Chessington stabbing
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/teenagers-charged-attempted-murder-after-14818224
Bring Your Dog To Work Day: Watch adorable miniature Dachshund spend day at the office
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/bring-your-dog-work-day-14817885
Met Office experts are expecting the hottest day of the year so far next week
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/met-office-experts-expecting-hottest-14816735
Godalming teenager found guilty of stabbing man who accused him of spreading sexuality rumours
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/godalming-teenager-found-guilty-stabbing-14817641
Elderly cyclist hospitalised with 'serious injuries' after crash in Cobham
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/elderly-cyclist-hospitalised-serious-injuries-14817804
See an epic open-air re-enactment of The Life of Jesus in the Surrey countryside
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/arts-culture-news/see-epic-open-air-re-14813935
Gluten free afternoon tea at Audleys Wood Hotel - what you can really expect
from Surrey Live - News https://www.getsurrey.co.uk/whats-on/food-drink-news/gluten-free-afternoon-tea-audleys-14814757
Aldershot Ozone Restaurant in Victoria Road fined £3,000 for poor hygiene practices
from Surrey Live - News https://www.getsurrey.co.uk/news/hampshire-news/aldershot-ozone-restaurant-victoria-road-14813821
Photos show wreckage of cars destroyed in M3 crash near Chobham
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/photos-show-wreckage-cars-destroyed-14817486
Gorgeous baby meerkats at Merrist Wood College make their debut in adorable pictures and video
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/gorgeous-baby-meerkats-merrist-wood-14815425
House of Fraser confirms closures including Camberley and Epsom as 'only way to secure future'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/house-fraser-confirms-store-closures-14817133
World Cup beer shortage looms as CO2 supplies run out across Europe
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/world-cup-beer-shortage-looms-14816474
How to avoid the fake EE text scam that police are warning about
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/how-avoid-fake-ee-text-14816389
See how people used to enjoy summer fun in Surrey in years gone by
from Surrey Live - News https://www.getsurrey.co.uk/news/nostalgia/see-how-people-used-enjoy-14813095
How hot it is forecast to get in Surrey over the next four days
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/how-hot-forecast-surrey-over-14815654
Old Bisley Road traffic expected near Pine Ridge Golf Club during prom season
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/old-bisley-road-traffic-expected-14814971
Fire cover 'halved' in Camberley on day of 'difficult to put out' fire at Zizzi
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/fire-cover-halved-camberley-day-14794496
Godalming teenager accused of stabbing man over sexuality rumours claims he acted in self defence
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/godalming-teenager-accused-stabbing-man-14809231
Video footage shows man police in Tandridge are seeking after Warlingham incident
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/video-footage-shows-man-police-14812924
Two men arrested in Guildford after 'great team effort' from police
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/two-men-arrested-guildford-after-14813391
Firefighters work through the night at Whitmoor Common following third wildfire in five days
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/firefighters-work-through-night-whitmoor-14814733
It's bring your dog to work day! Here is how can you get involved
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/its-bring-your-dog-work-14813605
The Goal-Based Approach to Domain Selection - Whiteboard Friday
Thursday, June 21, 2018
Shocking CCTV footage shows man with huge knife during fight on train
from Surrey Live - News https://www.getsurrey.co.uk/news/local-news/shocking-cctv-footage-shows-man-14812379
Camberley House of Fraser staff supported by job club and petition
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/camberley-house-fraser-staff-supported-14805686
Whitmoor Common fire burns area the size of 15 football pitches as smoke fills Guildford's sky
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/whitmoor-common-wildfire-burns-area-14812937
Camberley assault and attempted robbery injures woman in her 20s
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/camberley-assault-attempted-robbery-injures-14811041
Watch adorable lizard on blackened heathland following huge wildfire on Whitmoor Common
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/watch-adorable-lizard-blackened-heathland-14813062
Confidential result of complaint into Woking CEO Ray Morgan and former leader released
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/confidential-result-complaint-woking-ceo-14802308
X Factor finalist's home damaged in serious flats fire
from Surrey Live - News https://www.getsurrey.co.uk/news/local-news/x-factor-finalists-home-damaged-14812051
Proposed changes to parking at McLaren referred to secretary of state by planning committee
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/proposed-changes-parking-mclaren-referred-14757461
Chessington residents stunned after boy stabbed in chest in Hunters Road
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/chessington-residents-stunned-after-boy-14811305
You could be arrested if you visit this Knaphill house in the next three months
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/you-could-arrested-you-visit-14811460
Kingston man admits throwing flour at woman in Woking Hobbycraft
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/kingston-man-admits-throwing-flour-14810616
Escalator in Aldershot shopping centre to be repaired after six months out of action
from Surrey Live - News https://www.getsurrey.co.uk/news/hampshire-news/escalator-aldershot-shopping-centre-repaired-14810949
Parents angered after Spelthorne council stops them from using car park during school run
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/parents-angered-after-spelthorne-council-14781835
Dad warns other parents after his son spent £691 on Fortnite in three days
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/dad-warns-parents-after-son-14810785
Sandhurst cat Felix shot with air rifle suffers perforated kidney and liver
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/sandhurst-cat-felix-shot-air-14806146
Fire at Brookwood common destroys area larger than football pitch
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/fire-brookwood-common-destroys-area-14809951
Appeal launched to help community and residents replace items damaged by Alfold workshop fire
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/appeal-launched-help-community-residents-14808589
New baby gorilla at Chessington World of Adventures now has a name
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/new-baby-gorilla-chessington-world-14809248
Nests of toxic caterpillars spotted in Elmbridge
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/nests-toxic-caterpillars-spotted-elmbridge-14806370
East Surrey Hospital 'deeply regretful' as teen set for multimillion pound damages award
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/east-surrey-hospital-deeply-regretful-14805360
Surrey set to roast in glorious 30°C Mediterranean heatwave
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/surrey-set-roast-glorious-30c-14809908
More toilets, more seats and more staff... what South Western Railway bosses are promising customers
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/more-toilets-more-seats-more-14807844
Pampers nappies more than 30% off in Boots online offer
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/pampers-nappies-more-30-boots-14808067
Wednesday, June 20, 2018
Crash involving teenage cyclist and car in Guildford closes one lane on A3 slip road
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/crash-involving-teenage-cyclist-car-14809132
Newlywed doctor died of drug-related death, inquest rules
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/newlywed-doctor-died-drug-related-14808052
Mole Valley council applying for court order to remove Ashtead Recreation Ground traveller encampment
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/mole-valley-council-applying-court-14808277
Travellers leave Earlswood cricket pitch in Redhill after five days
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/travellers-leave-earlswood-cricket-pitch-14808867
Travellers ordered to leave Bellfields Green 'as soon as possible'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/travellers-ordered-leave-bellfields-green-14807814
Ministers Philip Hammond and Dominic Raab's home borough up for grabs as Elmbridge by-election called
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/ministers-philip-hammond-dominic-raabs-14807502
Planned strikes by Spanish airport workers could cause chaos for UK holiday-makers
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/planned-strikes-spanish-airport-workers-14807490
Surrey still the worst for unfilled potholes – and the number is getting bigger
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/surrey-still-worst-unfilled-potholes-14807447
'Robust' action promised after massive hunting knife seized in Walton
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/robust-action-promised-after-massive-14806313
Jolly Boatman developers encourage residents to have say on new plans
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/jolly-boatman-developers-encourage-residents-14804254
Surrey social workers to get more training to spot radicalisation after Home Office review
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/parsons-green-bomb-social-workers-14807387
Footage reveals scale of rail chaos following Rolling Stones Twickenham gig
from Surrey Live - News https://www.getsurrey.co.uk/news/local-news/footage-reveals-scale-rail-chaos-14806643
James Corden visits The Mogul restaurant in Bagshot
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/james-corden-visits-mogul-restaurant-14806832
Why WhatsApp is going to stop working on certain phones – and what you can do about it
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/whatsapp-stop-working-phones-soon-14806837
Morrisons unveils spiciest supermarket curry – which is so hot it comes with a safety warning
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/morrisons-unveils-spiciest-supermarket-curry-14806335
'Horrendous' traffic as Guildford gridlocked by gas works, road closures and temporary lights
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/horrendous-traffic-guildford-gridlocked-gas-14805666
Teenager appears in court charged with stabbing man over sexuality rumours
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/teenager-appears-court-charged-stabbing-14804637
Surrey urgently needs transit sites for travellers, says police and crime commissioner
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/surrey-urgently-needs-transit-sites-14804663
Weekend weather forecast warns Surrey can expect 'very high' pollen levels
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/weekend-weather-forecast-warns-surrey-14805311
Surrey County Council apologises after Home Office review into handling of Parsons Green bomber case
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/surrey-county-council-apologises-after-14805329
Head teachers should ban mobile phones from schools, says culture secretary
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/head-teachers-should-ban-mobile-14805274
Tuesday, June 19, 2018
Virgin Media outage leaves Surrey residents without internet for three weeks – and it's still not solved
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/virgin-media-outage-leaves-surrey-14804397
Watch as a car is totally engulfed in flames on the side of a road in Hooley
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/watch-car-totally-engulfed-flames-14804274
Travellers in Bellfields to be given notice to leave 'as soon as possible'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/travellers-bellfields-given-notice-leave-14804093
Why you shouldn't flash other drivers to warn them about a speed camera
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/you-shouldnt-flash-drivers-warn-14802506
Sheep killed and thrown in River Ash after 'unprovoked cruel attack'
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/sheep-killed-thrown-river-ash-14803684
Doctor addicted to drugs unlikely to have committed suicide, inquest hears
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/doctor-addicted-drugs-unlikely-committed-14802583
Wetherspoons customers can now wear England shirts inside – but flags remain banned
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/wetherspoons-customers-can-now-wear-14802810
Roads reopen in Chertsey as 'safety equipment' installed around Old Town Hall
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/roads-reopen-chertsey-safety-equipment-14802723
Police appeal to trace missing 25-year-old man from Salfords
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/police-appeal-trace-missing-25-14802428
Six chickens saved from large workshop fire in Alfold after 'huge plumes of smoke' spotted
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/six-chickens-saved-large-workshop-14801746
'Don't give up the fight,' campaigners urge Ripley residents in battle for school's future
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/dont-give-up-fight-campaigners-14802324
Fetcham residents celebrating after plan to expand chlorine dosing facility is rejected
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/fetcham-residents-celebrating-after-plan-14725836
Caterham restaurant staff have been donating their lunches to support neighbouring single mum with cancer
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/caterham-restaurant-staff-been-donating-14780435
Cyclist airlifted to hospital with 'potentially serious injuries' after coming off bike in Cranleigh
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/cyclist-airlifted-hospital-potentially-serious-14801144
Thames Water to pay for new Guildford High Street setts after 'temporary' tarmac replacement
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/thames-water-pay-new-guildford-14801556
Huge 'sex-crazed moths' could invade Surrey homes this summer
from Surrey Live - News https://www.getsurrey.co.uk/news/uk-world-news/huge-sex-crazed-moths-could-14801709
Two hospitalised following multi-vehicle crash on M3
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/two-hospitalised-following-multi-vehicle-14801074
Man released from hospital after 'deliberate' crash in Walton left him with serious injuries
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/hersham-deliberate-crash-walton-appeal-14801169
Rubbish on Bannisters Field after travellers move on from green by Guildford Tesco
from Surrey Live - News https://www.getsurrey.co.uk/news/surrey-news/rubbish-bannisters-field-after-travellers-14801264
Aerial drone footage shows the scale of fly-tipped rubbish building up on Aldershot estate
from GetSurrey - News https://www.getsurrey.co.uk/news/hampshire-news/aerial-drone-footage-shows-scale-14781566
What's the most commonly used word by South Western Railway's customer service on Twitter?
from GetSurrey - News https://www.getsurrey.co.uk/news/surrey-news/whats-most-commonly-used-word-14797851
Attempted murder, torment and rape – the stories of domestic abuse survivors
from GetSurrey - News https://www.getsurrey.co.uk/news/surrey-news/attempted-murder-torment-rape--14770077
What's happening with Surrey's new towns and garden villages?
from GetSurrey - News https://www.getsurrey.co.uk/news/surrey-news/whats-happening-surreys-new-towns-14788860
The 34 outstanding Surrey schools not inspected by Ofsted for more than six years
from GetSurrey - News https://www.getsurrey.co.uk/news/surrey-news/outstanding-surrey-schools-ofsted-inspection-14790008
Police say speed limit on busy road is too LOW and want it to go up
from GetSurrey - News https://www.getsurrey.co.uk/news/surrey-news/police-say-speed-limit-busy-14799430
Man in 20s has jaw broken after being punched in face by stranger
from GetSurrey - News https://www.getsurrey.co.uk/news/surrey-news/man-20s-jaw-broken-after-14800378
An 8-Point Checklist for Debugging Strange Technical SEO Problems
Posted by Dom-Woodman
Occasionally, a problem will land on your desk that's a little out of the ordinary. Something where you don't have an easy answer. You go to your brain and your brain returns nothing.
These problems can’t be solved with a little bit of keyword research and basic technical configuration. These are the types of technical SEO problems where the rabbit hole goes deep.
The very nature of these situations defies a checklist, but it's useful to have one for the same reason we have them on planes: even the best of us can and will forget things, and a checklist will provvide you with places to dig.
Fancy some examples of strange SEO problems? Here are four examples to mull over while you read. We’ll answer them at the end.
1. Why wasn’t Google showing 5-star markup on product pages?
- The pages had server-rendered product markup and they also had Feefo product markup, including ratings being attached client-side.
- The Feefo ratings snippet was successfully rendered in Fetch & Render, plus the mobile-friendly tool.
- When you put the rendered DOM into the structured data testing tool, both pieces of structured data appeared without errors.
2. Why wouldn’t Bing display 5-star markup on review pages, when Google would?
- The review pages of client & competitors all had rating rich snippets on Google.
- All the competitors had rating rich snippets on Bing; however, the client did not.
- The review pages had correctly validating ratings schema on Google’s structured data testing tool, but did not on Bing.
3. Why were pages getting indexed with a no-index tag?
- Pages with a server-side-rendered no-index tag in the head were being indexed by Google across a large template for a client.
4. Why did any page on a website return a 302 about 20–50% of the time, but only for crawlers?
- A website was randomly throwing 302 errors.
- This never happened in the browser and only in crawlers.
- User agent made no difference; location or cookies also made no difference.
Finally, a quick note. It’s entirely possible that some of this checklist won’t apply to every scenario. That’s totally fine. It’s meant to be a process for everything you could check, not everything you should check.
The pre-checklist check
Does it actually matter?
Does this problem only affect a tiny amount of traffic? Is it only on a handful of pages and you already have a big list of other actions that will help the website? You probably need to just drop it.
I know, I hate it too. I also want to be right and dig these things out. But in six months' time, when you've solved twenty complex SEO rabbit holes and your website has stayed flat because you didn't re-write the title tags, you're still going to get fired.
But hopefully that's not the case, in which case, onwards!
Where are you seeing the problem?
We don’t want to waste a lot of time. Have you heard this wonderful saying?: “If you hear hooves, it’s probably not a zebra.”
The process we’re about to go through is fairly involved and it’s entirely up to your discretion if you want to go ahead. Just make sure you’re not overlooking something obvious that would solve your problem. Here are some common problems I’ve come across that were mostly horses.
- You’re underperforming from where you should be.
- When a site is under-performing, people love looking for excuses. Weird Google nonsense can be quite a handy thing to blame. In reality, it’s typically some combination of a poor site, higher competition, and a failing brand. Horse.
- You’ve suffered a sudden traffic drop.
- Something has certainly happened, but this is probably not the checklist for you. There are plenty of common-sense checklists for this. I’ve written about diagnosing traffic drops recently — check that out first.
- The wrong page is ranking for the wrong query.
- In my experience (which should probably preface this entire post), this is usually a basic problem where a site has poor targeting or a lot of cannibalization. Probably a horse.
Factors which make it more likely that you’ve got a more complex problem which require you to don your debugging shoes:
- A website that has a lot of client-side JavaScript.
- Bigger, older websites with more legacy.
- Your problem is related to a new Google property or feature where there is less community knowledge.
1. Start by picking some example pages.
Pick a couple of example pages to work with — ones that exhibit whatever problem you're seeing. No, this won't be representative, but we'll come back to that in a bit.
Of course, if it only affects a tiny number of pages then it might actually be representative, in which case we're good. It definitely matters, right? You didn't just skip the step above? OK, cool, let's move on.
2. Can Google crawl the page once?
First we’re checking whether Googlebot has access to the page, which we’ll define as a 200 status code.
We’ll check in four different ways to expose any common issues:
- Robots.txt: Open up Search Console and check in the robots.txt validator.
- User agent: Open Dev Tools and verify that you can open the URL with both Googlebot and Googlebot Mobile.
- To get the user agent switcher, open Dev Tools.
- Check the console drawer is open (the toggle is the Escape key)
- Hit the … and open "Network conditions"
- Here, select your user agent!
- IP Address: Verify that you can access the page with the mobile testing tool. (This will come from one of the IPs used by Google; any checks you do from your computer won't.)
- Country: The mobile testing tool will visit from US IPs, from what I've seen, so we get two birds with one stone. But Googlebot will occasionally crawl from non-American IPs, so it’s also worth using a VPN to double-check whether you can access the site from any other relevant countries.
- I’ve used HideMyAss for this before, but whatever VPN you have will work fine.
We should now have an idea whether or not Googlebot is struggling to fetch the page once.
Have we found any problems yet?
If we can re-create a failed crawl with a simple check above, then it’s likely Googlebot is probably failing consistently to fetch our page and it’s typically one of those basic reasons.
But it might not be. Many problems are inconsistent because of the nature of technology. ;)
3. Are we telling Google two different things?
Next up: Google can find the page, but are we confusing it by telling it two different things?
This is most commonly seen, in my experience, because someone has messed up the indexing directives.
By "indexing directives," I’m referring to any tag that defines the correct index status or page in the index which should rank. Here’s a non-exhaustive list:
- No-index
- Canonical
- Mobile alternate tags
- AMP alternate tags
An example of providing mixed messages would be:
- No-indexing page A
- Page B canonicals to page A
Or:
- Page A has a canonical in a header to A with a parameter
- Page A has a canonical in the body to A without a parameter
If we’re providing mixed messages, then it’s not clear how Google will respond. It’s a great way to start seeing strange results.
Good places to check for the indexing directives listed above are:
- Sitemap
- Example: Mobile alternate tags can sit in a sitemap
- HTTP headers
- Example: Canonical and meta robots can be set in headers.
- HTML head
- This is where you’re probably looking, you’ll need this one for a comparison.
- JavaScript-rendered vs hard-coded directives
- You might be setting one thing in the page source and then rendering another with JavaScript, i.e. you would see something different in the HTML source from the rendered DOM.
- Google Search Console settings
- There are Search Console settings for ignoring parameters and country localization that can clash with indexing tags on the page.
A quick aside on rendered DOM
This page has a lot of mentions of the rendered DOM on it (18, if you’re curious). Since we’ve just had our first, here’s a quick recap about what that is.
When you load a webpage, the first request is the HTML. This is what you see in the HTML source (right-click on a webpage and click View Source).
This is before JavaScript has done anything to the page. This didn’t use to be such a big deal, but now so many websites rely heavily on JavaScript that the most people quite reasonably won’t trust the the initial HTML.
Rendered DOM is the technical term for a page, when all the JavaScript has been rendered and all the page alterations made. You can see this in Dev Tools.
In Chrome you can get that by right clicking and hitting inspect element (or Ctrl + Shift + I). The Elements tab will show the DOM as it’s being rendered. When it stops flickering and changing, then you’ve got the rendered DOM!
4. Can Google crawl the page consistently?
To see what Google is seeing, we're going to need to get log files. At this point, we can check to see how it is accessing the page.
Aside: Working with logs is an entire post in and of itself. I’ve written a guide to log analysis with BigQuery, I’d also really recommend trying out Screaming Frog Log Analyzer, which has done a great job of handling a lot of the complexity around logs.
When we’re looking at crawling there are three useful checks we can do:
- Status codes: Plot the status codes over time. Is Google seeing different status codes than you when you check URLs?
- Resources: Is Google downloading all the resources of the page?
- Is it downloading all your site-specific JavaScript and CSS files that it would need to generate the page?
- Page size follow-up: Take the max and min of all your pages and resources and diff them. If you see a difference, then Google might be failing to fully download all the resources or pages. (Hat tip to @ohgm, where I first heard this neat tip).
Have we found any problems yet?
If Google isn't getting 200s consistently in our log files, but we can access the page fine when we try, then there is clearly still some differences between Googlebot and ourselves. What might those differences be?
- It will crawl more than us
- It is obviously a bot, rather than a human pretending to be a bot
- It will crawl at different times of day
This means that:
- If our website is doing clever bot blocking, it might be able to differentiate between us and Googlebot.
- Because Googlebot will put more stress on our web servers, it might behave differently. When websites have a lot of bots or visitors visiting at once, they might take certain actions to help keep the website online. They might turn on more computers to power the website (this is called scaling), they might also attempt to rate-limit users who are requesting lots of pages, or serve reduced versions of pages.
- Servers run tasks periodically; for example, a listings website might run a daily task at 01:00 to clean up all it’s old listings, which might affect server performance.
Working out what’s happening with these periodic effects is going to be fiddly; you’re probably going to need to talk to a back-end developer.
Depending on your skill level, you might not know exactly where to lead the discussion. A useful structure for a discussion is often to talk about how a request passes through your technology stack and then look at the edge cases we discussed above.
- What happens to the servers under heavy load?
- When do important scheduled tasks happen?
Two useful pieces of information to enter this conversation with:
- Depending on the regularity of the problem in the logs, it is often worth trying to re-create the problem by attempting to crawl the website with a crawler at the same speed/intensity that Google is using to see if you can find/cause the same issues. This won’t always be possible depending on the size of the site, but for some sites it will be. Being able to consistently re-create a problem is the best way to get it solved.
- If you can’t, however, then try to provide the exact periods of time where Googlebot was seeing the problems. This will give the developer the best chance of tying the issue to other logs to let them debug what was happening.
If Google can crawl the page consistently, then we move onto our next step.
5. Does Google see what I can see on a one-off basis?
We know Google is crawling the page correctly. The next step is to try and work out what Google is seeing on the page. If you’ve got a JavaScript-heavy website you’ve probably banged your head against this problem before, but even if you don’t this can still sometimes be an issue.
We follow the same pattern as before. First, we try to re-create it once. The following tools will let us do that:
- Fetch & Render
- Shows: Rendered DOM in an image, but only returns the page source HTML for you to read.
- Mobile-friendly test
- Shows: Rendered DOM and returns rendered DOM for you to read.
- Not only does this show you rendered DOM, but it will also track any console errors.
Is there a difference between Fetch & Render, the mobile-friendly testing tool, and Googlebot? Not really, with the exception of timeouts (which is why we have our later steps!). Here’s the full analysis of the difference between them, if you’re interested.
Once we have the output from these, we compare them to what we ordinarily see in our browser. I’d recommend using a tool like Diff Checker to compare the two.
Have we found any problems yet?
If we encounter meaningful differences at this point, then in my experience it’s typically either from JavaScript or cookies
Why?
- Googlebot crawls with cookies cleared between page requests
- Googlebot renders with Chrome 41, which doesn’t support all modern JavaScript.
We can isolate each of these by:
- Loading the page with no cookies. This can be done simply by loading the page with a fresh incognito session and comparing the rendered DOM here against the rendered DOM in our ordinary browser.
- Use the mobile testing tool to see the page with Chrome 41 and compare against the rendered DOM we normally see with Inspect Element.
Yet again we can compare them using something like Diff Checker, which will allow us to spot any differences. You might want to use an HTML formatter to help line them up better.
We can also see the JavaScript errors thrown using the Mobile-Friendly Testing Tool, which may prove particularly useful if you’re confident in your JavaScript.
If, using this knowledge and these tools, we can recreate the bug, then we have something that can be replicated and it’s easier for us to hand off to a developer as a bug that will get fixed.
If we’re seeing everything is correct here, we move on to the next step.
6. What is Google actually seeing?
It’s possible that what Google is seeing is different from what we recreate using the tools in the previous step. Why? A couple main reasons:
- Overloaded servers can have all sorts of strange behaviors. For example, they might be returning 200 codes, but perhaps with a default page.
- JavaScript is rendered separately from pages being crawled and Googlebot may spend less time rendering JavaScript than a testing tool.
- There is often a lot of caching in the creation of web pages and this can cause issues.
We’ve gotten this far without talking about time! Pages don’t get crawled instantly, and crawled pages don’t get indexed instantly.
Quick sidebar: What is caching?
Caching is often a problem if you get to this stage. Unlike JS, it’s not talked about as much in our community, so it’s worth some more explanation in case you’re not familiar. Caching is storing something so it’s available more quickly next time.
When you request a webpage, a lot of calculations happen to generate that page. If you then refreshed the page when it was done, it would be incredibly wasteful to just re-run all those same calculations. Instead, servers will often save the output and serve you the output without re-running them. Saving the output is called caching.
Why do we need to know this? Well, we’re already well out into the weeds at this point and so it’s possible that a cache is misconfigured and the wrong information is being returned to users.
There aren’t many good beginner resources on caching which go into more depth. However, I found this article on caching basics to be one of the more friendly ones. It covers some of the basic types of caching quite well.
How can we see what Google is actually working with?
- Google’s cache
- Shows: Source code
- While this won’t show you the rendered DOM, it is showing you the raw HTML Googlebot actually saw when visiting the page. You’ll need to check this with JS disabled; otherwise, on opening it, your browser will run all the JS on the cached version.
- Site searches for specific content
- Shows: A tiny snippet of rendered content.
- By searching for a specific phrase on a page, e.g. inurl:example.com/url “only JS rendered text”, you can see if Google has manage to index a specific snippet of content. Of course, it only works for visible text and misses a lot of the content, but it's better than nothing!
- Better yet, do the same thing with a rank tracker, to see if it changes over time.
- Storing the actual rendered DOM
- Shows: Rendered DOM
- Alex from DeepCrawl has written about saving the rendered DOM from Googlebot. The TL;DR version: Google will render JS and post to endpoints, so we can get it to submit the JS-rendered version of a page that it sees. We can then save that, examine it, and see what went wrong.
Have we found any problems yet?
Again, once we’ve found the problem, it’s time to go and talk to a developer. The advice for this conversation is identical to the last one — everything I said there still applies.
The other knowledge you should go into this conversation armed with: how Google works and where it can struggle. While your developer will know the technical ins and outs of your website and how it’s built, they might not know much about how Google works. Together, this can help you reach the answer more quickly.
The obvious source for this are resources or presentations given by Google themselves. Of the various resources that have come out, I’ve found these two to be some of the more useful ones for giving insight into first principles:
- This excellent talk, How does Google work - Paul Haahr, is a must-listen.
- At their recent IO conference, John Mueller & Tom Greenway gave a useful presentation on how Google renders JavaScript.
But there is often a difference between statements Google will make and what the SEO community sees in practice. All the SEO experiments people tirelessly perform in our industry can also help shed some insight. There are far too many list here, but here are two good examples:
- Google does respect JS canonicals - For example, Eoghan Henn does some nice digging here, which shows Google respecting JS canonicals.
- How does Google index different JS frameworks? - Another great example of a widely read experiment by Bartosz Góralewicz last year to investigate how Google treated different frameworks.
7. Could Google be aggregating your website across others?
If we’ve reached this point, we’re pretty happy that our website is running smoothly. But not all problems can be solved just on your website; sometimes you’ve got to look to the wider landscape and the SERPs around it.
Most commonly, what I’m looking for here is:
- Similar/duplicate content to the pages that have the problem.
- This could be intentional duplicate content (e.g. syndicating content) or unintentional (competitors' scraping or accidentally indexed sites).
Either way, they’re nearly always found by doing exact searches in Google. I.e. taking a relatively specific piece of content from your page and searching for it in quotes.
Have you found any problems yet?
If you find a number of other exact copies, then it’s possible they might be causing issues.
The best description I’ve come up with for “have you found a problem here?” is: do you think Google is aggregating together similar pages and only showing one? And if it is, is it picking the wrong page?
This doesn’t just have to be on traditional Google search. You might find a version of it on Google Jobs, Google News, etc.
To give an example, if you are a reseller, you might find content isn’t ranking because there's another, more authoritative reseller who consistently posts the same listings first.
Sometimes you’ll see this consistently and straightaway, while other times the aggregation might be changing over time. In that case, you’ll need a rank tracker for whatever Google property you’re working on to see it.
Jon Earnshaw from Pi Datametrics gave an excellent talk on the latter (around suspicious SERP flux) which is well worth watching.
Once you’ve found the problem, you’ll probably need to experiment to find out how to get around it, but the easiest factors to play with are usually:
- De-duplication of content
- Speed of discovery (you can often improve by putting up a 24-hour RSS feed of all the new content that appears)
- Lowering syndication
8. A roundup of some other likely suspects
If you’ve gotten this far, then we’re sure that:
- Google can consistently crawl our pages as intended.
- We’re sending Google consistent signals about the status of our page.
- Google is consistently rendering our pages as we expect.
- Google is picking the correct page out of any duplicates that might exist on the web.
And your problem still isn’t solved?
And it is important?
Well, shoot.
Feel free to hire us…?
As much as I’d love for this article to list every SEO problem ever, that’s not really practical, so to finish off this article let’s go through two more common gotchas and principles that didn’t really fit in elsewhere before the answers to those four problems we listed at the beginning.
Invalid/poorly constructed HTML
You and Googlebot might be seeing the same HTML, but it might be invalid or wrong. Googlebot (and any crawler, for that matter) has to provide workarounds when the HTML specification isn't followed, and those can sometimes cause strange behavior.
The easiest way to spot it is either by eye-balling the rendered DOM tools or using an HTML validator.
The W3C validator is very useful, but will throw up a lot of errors/warnings you won’t care about. The closest I can give to a one-line of summary of which ones are useful is to:
- Look for errors
- Ignore anything to do with attributes (won’t always apply, but is often true).
The classic example of this is breaking the head.
Oliver Mason wrote a good post that explains an even more subtle version of this in breaking the head quietly.
When in doubt, diff
Never underestimate the power of trying to compare two things line by line with a diff from something like Diff Checker. It won’t apply to everything, but when it does it’s powerful.
For example, if Google has suddenly stopped showing your featured markup, try to diff your page against a historical version either in your QA environment or from the Wayback Machine.
Answers to our original 4 questions
Time to answer those questions. These are all problems we’ve had clients bring to us at Distilled.
1. Why wasn’t Google showing 5-star markup on product pages?
Google was seeing both the server-rendered markup and the client-side-rendered markup; however, the server-rendered side was taking precedence.
Removing the server-rendered markup meant the 5-star markup began appearing.
2. Why wouldn’t Bing display 5-star markup on review pages, when Google would?
The problem came from the references to schema.org.
<div itemscope="" itemtype="https://schema.org/Movie"> </div> <p> <h1 itemprop="name">Avatar</h1> </p> <p> <span>Director: <span itemprop="director">James Cameron</span> (born August 16, 1954)</span> </p> <p> <span itemprop="genre">Science fiction</span> </p> <p> <a href="../movies/avatar-theatrical-trailer.html" itemprop="trailer">Trailer</a> </p> <p></div> </p>
We diffed our markup against our competitors and the only difference was we’d referenced the HTTPS version of schema.org in our itemtype, which caused Bing to not support it.
C’mon, Bing.
3. Why were pages getting indexed with a no-index tag?
The answer for this was in this post. This was a case of breaking the head.
The developers had installed some ad-tech in the head and inserted an non-standard tag, i.e. not:
- <title>
- <style>
- <base>
- <link>
- <meta>
- <script>
- <noscript>
This caused the head to end prematurely and the no-index tag was left in the body where it wasn’t read.
4. Why did any page on a website return a 302 about 20–50% of the time, but only for crawlers?
This took some time to figure out. The client had an old legacy website that has two servers, one for the blog and one for the rest of the site. This issue started occurring shortly after a migration of the blog from a subdomain (blog.client.com) to a subdirectory (client.com/blog/…).
At surface level everything was fine; if a user requested any individual page, it all looked good. A crawl of all the blog URLs to check they’d redirected was fine.
But we noticed a sharp increase of errors being flagged in Search Console, and during a routine site-wide crawl, many pages that were fine when checked manually were causing redirect loops.
We checked using Fetch and Render, but once again, the pages were fine.
Eventually, it turned out that when a non-blog page was requested very quickly after a blog page (which, realistically, only a crawler is fast enough to achieve), the request for the non-blog page would be sent to the blog server.
These would then be caught by a long-forgotten redirect rule, which 302-redirected deleted blog posts (or other duff URLs) to the root. This, in turn, was caught by a blanket HTTP to HTTPS 301 redirect rule, which would be requested from the blog server again, perpetuating the loop.
For example, requesting https://www.client.com/blog/ followed quickly enough by https://www.client.com/category/ would result in:
- 302 to http://www.client.com - This was the rule that redirected deleted blog posts to the root
- 301 to https://www.client.com - This was the blanket HTTPS redirect
- 302 to http://www.client.com - The blog server doesn’t know about the HTTPS non-blog homepage and it redirects back to the HTTP version. Rinse and repeat.
This caused the periodic 302 errors and it meant we could work with their devs to fix the problem.
What are the best brainteasers you've had?
Let’s hear them, people. What problems have you run into? Let us know in the comments.
Also credit to @RobinLord8, @TomAnthonySEO, @THCapper, @samnemzer, and @sergeystefoglo_ for help with this piece.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
from The Moz Blog http://tracking.feedpress.it/link/9375/9495403