How can you tell whether bots visiting your website actually are who they say they are? Are they bad bots with malicious intent or are they good bots crawling your site to index your content properly? It’s a given that if you want your content to appear in search results, you have to let search engines do the automated work of indexing it. Which means, of course, opening the door (including premium content behind a paywall) to different search engines’ web crawlers for indexing. 

It’s not unusual for companies to want to understand their web traffic in greater depth. Being able to collect fine-grained statistics provides valuable insight into web performance and potential improvements. 

Over time, the most popular content we’ve created relates to hands-on Varnish use and relevant dos and don’ts. Naturally, we continue to create more content about this because our raison d’être is to help Varnish users get the maximum performance and efficiency they can from their Varnish setups.

Let’s get down to business.

If you’re familiar with Varnish already, you know that VMODs extend Varnish functionality and give Varnish the kind of flexibility that helps you deliver content the way you want to. We recently published a brief overview of all currently available Varnish VMODs to give you a high-level overview of all the VMODs that currently exist and want to provide a bit more detail about what the newest VMODs can do for you.