A innocent looking implementation bug in Apache’s new HTTP/2 module (mod_http2) incorrectly announces HTTP/2 support using the Upgrade: h2 header. This simple mistake makes websites inaccessible to YandexBot as well as services built on NodeJS.
This week, I grabbed some 667 964 /robots.txt robots exclusion files from the Alexa Top 1 Million domains. Here is what I learned about some of the lesser known robots directives they contained.
Many Europeans are multilingual by necessity – how does that affect which search provider they choose? Superior natural language understanding technology could be behind Google’s enormous success in Europe.