Marketers should be wary of open-source programs promoted by purveyors with a walled garden history.
analytics
Umami is a simple, fast, privacy-focused alternative to Google Analytics. - umami-software/umami
Still, the exact application, challenges and shortcuts related to this technique are relatively unknown, and that’s what this article seeks to change.
A SWOT analysis helps teams understand how well a product, service, or organization is positioned in the market to serve its customers.
Uncover deeper insights beyond ZIP codes with geospatial analysis. Explore the limitations of ZIP codes and discover alternatives for spatial understanding.
Use methods like 5-second testing, first-click testing, and preference testing to gain insights into how users perceive your visual design.
This is a repo with links to everything you'd ever want to learn about data engineering - DataExpert-io/data-engineer-handbook
GA4 provides valuable insights into user interactions on your website. Learn how to analyze key metrics like sessions, session duration, and events to refine your digital strategy.
Goodhart's Law is useless. It tells you about a phenomenon, but it doesn't tell you how to solve it. We look at how organisations actually prevent Goodhart's Law, and illustrate this with Amazon's Weekly Business Review as an example.
Learn which variables you should and should not take into account in your model.
Hey guys, welcome back to my R-tips newsletter. Supply chain management is essential in making sure that your company’s business runs smoothly. One of the key elements is managing inventory efficiently. Today, I’m going to show you how to estimate inve...
How to build upon a previous experiment, without throwing it all away.
A/B testing is a cornerstone of data science, essential for making informed business decisions and optimizing customer revenue. Here, we delve into six widely used statistical methods in A/B testing, explaining their purposes and appropriate contexts. 1. Z-Test (Standard Score Test): When to Use: This method is ideal for large sample sizes (typically over 30) when the population variance is known. Purpose: Compares the means of two groups to determine if they are statistically different. Applications: This technique is frequently employed in conversion rate optimization and click-through rate analysis. It helps identify whether changes in website elements or marketing strategies
Visual, interactive sample size calculator ideal for planning online experiments and A/B tests.
Evaluating ad targeting product using causal inference: propensity score matching!
For non-tech industry folks, an “A/B test” is just a randomized controlled trial where you split users or other things into treatment and control groups, and then later compare key metr…
Running experiments is equal parts powerful and terrifying. Powerful because you can validate changes that will transform your product for the better…
An in-depth explanation of “Thompson Sampling”, a more efficient alternative to A/B testing for online learning
Questions on A/B testing are being increasingly asked in interviews but reliable resources to prepare for these are still far and few…
A Discussion of the go-to methods for 5 Types of A/B Metrics
How today’s tech companies make data-driven decisions in Machine Learning production
While Fisher’s exact test is a convenient tool for A/B testing, the idea and results of the test are often hard to grasp and difficult to…
A/B testing is hitting the mainstream because it is so effective. And with so many tools available it has become very easy and very inexpensive to run. Here are 23 helpful tips on how you can take your A/B tests from basic to the next level.
A/B tests provide more than statistical validation of one execution over another. They can and should impact how your team prioritizes projects.
We’re Agile, we think lean, we’re data-driven. If you live in the new economy and work in some sort of digital product you hear some of…
We spoke with Etsy’s iOS Software Engineer, Lacy Rhoades, about their culture of continuous experimentation. Learn about their a/b testing culture
A/B testing is a very popular technique of checking granular changes in a product without mistakenly taking into account changes that were…
Multivariate tests indicate how various UI elements interact with each other and are a tool for making incremental improvements to a design.
The best way to determine what works best for your site is to carry out an A/B test for your landing pages. Check out this A/B significant test calculator.
Our A/B test calculator will help you to compare two or three variants to determine which test will be statistically significant.
Elaborate usability tests are a waste of resources. The best results come from testing no more than 5 users and running as many small tests as you can afford.
A/B testing, the process of exposing randomized visitors to one or more variables, is among the most effective strategies to optimize user experiences and conversion rates. Here is a list of A/B testing tools.
Experimentation is widely used at tech startups to make decisions on whether to roll out new product features, UI design changes, marketing campaigns and more, usually with the goal of improving…
The best way to optimise your website is usually the simplest.
Optimizing web marketing strategies through statistical testing
A/B Testing — A complete guide to statistical testing - bjpcjp/AB_Testing
The intuitive way of A/B testing. The advantages of the Bayesian approach and how to do it.
Big success. Bigger failure. And lots of lessons. Learn why building a growth team may be a multi-million dollar mistake.
The biggest question in ecommerce A/B testing is not “how.”
A/B tests are controlled experiments of two attributes, to measure which one was most popular with users. You can apply A/B testing to just about anything that you can measure. Multivariate testing allows you to measure multiple variables simultaneously.
Data Science, Machine Learning, AI & Analytics
“If you want to change the game, change the frame.” The game has certainly changed with the data era, and maybe the most drastic change driven by data has occurred in economics, the foundation upon which our modern society is built and sustained. Understanding and mastering the transition from “traditional” economics to modern data-driven economics… Read More »Mastering the Big 12 Data-driven Economic Concepts
In this article, I'll take you through the task of Customer Satisfaction Analysis with Python. Customer Satisfaction Analysis with Python.
The authoritative guide on how Amazon does WBRs (from former exec Colin Bryar): how it works, how to do it, and how Amazon uses it to win.
Create your first run chart and start interpreting your data using just four rules. Your go-to QI resource.
Window functions are an advanced feature of SQL that provides powerful tools for detailed data analysis and manipulation without grouping data into single output rows, which is common in aggregate functions.
More than half of the NCAA Tournament's top teams have used HD Intelligence services, as basketball's data revolution sweeps through the college game.
At most small and medium-sized e-commerce retailers, prices are typically set and updated in an ad hoc fashion without one clear owner. The process often starts by using a gross margin target, followed by some comparison with competitors, and then some adjustments from there. Many of these retailers would quickly admit that this isn’t an optimal strategy, and that they are likely leaving money on the table — and they’re often right. The authors’ experience with price testing has shown that there is actually a significant amount of money left on the table when pricing is left un-optimized.
Knowing the URLs in search engine result pages leads to further analysis, such as referring domains, page authority, word count, and more.
Two principles on collecting data, from the field of Statistical Process Control. As with most principles in SPC, this is both simpler and more important than you might think.
Since starting PostHog in 2020, we’ve learned a bunch about what does and doesn’t work when it comes to marketing to engineers . Paid ads is a…
Using data provided by Vivid Seats and Instagram, I learned that social media clout isn't all it's cracked up to be.
An obsessively detailed guide to Customer Lifetime Value techniques and real-world applications
These tools can help you analyze PPC competitors, track search trends or design ad creative – all without spending a dime.
8 stories · A guide to building an end-to-end marketing mix optimization solution for your organization.
A spreadsheet on ad platform Xandr’s website revealed a massive collection of “audience segments” used to target consumers based on highly specific, sometimes intimate information and inferences
Applying causal machine learning to trim the campaign target audience
Looking for the best alternative to Google Analytics 4? Here are 15 web analytics platforms you may want to consider.
An in-depth look at seven tools used by enterprises for content optimization, technical SEO, and reporting and analytics.
This article will take you through everything about Cohort Analysis that you should know. What is Cohort Analysis in Data Science?
In this article, I will walk you through the task of Retail Price Optimization with Machine Learning using Python. Retail Price Optimization.
From Villa's weirdly disconnected midfield to Forest playing passes near their corner flags, here's what we can learn from analysing passing
How to adjust CATE to consider costs associated with your treatments
When you use supermarket discount cards, you are sharing much more than what is in your cart—and grocery chains like Kroger are reaping huge profits selling this data to brands and advertisers
Effective log management is a fundamental aspect of maintaining and troubleshooting today's complex...
An easy-to-read, highly condensed analysis of all the known, confirmed, rumored, and absolute myth-level Google ranking factors.
Media Mix modeling, its implementation, and practical tips
Learn how to build MMMs for different countries the right way
I recently rewatched "The Wire". The show's central theme is about counter-productive metrics and their corrupting influence on institutions. I've noticed hints of this pattern in software engineering, too
Use these tips to quickly analyze performance data and identify high-impact PPC optimizations that will move the needle.
In many board rooms, the most important go-to-market number this quarter is pipeline health. For some companies, the pipeline may be less clear than a quarter or two ago. Summer seasonality may play a role. Macroeconomics might also be lurking within the numbers. Pipeline fluctuations are normal. But any meaningful & unexpected surprise warrants introspection. Pipeline analysis often has four parts: Craft the sales sandwich to predict your GTM conversion rates & determine if close rates have changed in parallel.
Amazon will continue to be highly competitive. Want to be successful? Optimize your product listings to the fullest with these tips.
There is a huge and ever-widening gap between the devices we use to make the web and the devices most people use to consume it. It’s also no secret
If you go to three different analysts looking for a definition of "churn rate," they will all agree that it's an important metric and that the definition is self evident. Then they will go ahead and give you three different definitions. And as they share their definitions with each other they all have the same response: why is everyone else making this so com
Over the past few years, marketing on the web has become way too much fun. I remember trying to figure out what “hits” on awstats [http://awstats.sourceforge.net/] meant in high school, and I distinctly can recall how disappointed I was when I found out the true meaning. Nowadays,
Getting useful cancellation feedback from customers is tough. The problem is that once people have canceled, they’re no longer engaged and will rarely spend the time to give you feedback. One of the best things I’ve ever done to combat this with Bidsketch was to add a mandatory freeform text field that says: Please help… Continue reading Getting 200% More Actionable Feedback from Customers that Cancel →
Simple Analytics is a privacy-friendly and simple alternative to Google Analytics. No cookies. No trackers. No consent required from your visitors. Just straightforward analytics.
As of 2024, The Data Incubator is now Pragmatic Data! Explore Pragmatic Institute’s new offerings, learn about team training opportunities, and more.
Analyzing the SERPs for these micro intents will help you create the right content that a searcher will want to find.
Marc Andreessen famously said that for startups, “the only thing that matters is getting to product/market fit.” Product/market fit means providing enough value to enough people that the startup can…
I sit down and learn how to get insights from churn rates, conversion rates, and more to answer some important questions about my product.
I have a theory: No Diggity by Blackstreet is timeless. If Frank Sinatra is timeless in 2015, so too is No Diggity in 2050, fondly remembered by our children's children as the icon of the 90s. And I think that I can prove it.
Pricing is hard. Make it too low and you miss out on profit; too high and you miss out on sales. These pricing experiments will help you get it right.
this is a guest post by Kareem Mayan. customer retention was a recent topic in our predictable […]
You must test ads to make your paid search account grow and thrive. That fact is no longer debatable – it is just a best practice fact. Ad testing in
A/B testing tools often lie about whether something is "statistically significant." Here's an extremely simple, mathematically sound formula to compute it for yourself.
Koru CEO Kristen Hamilton helps hundreds of people hire and get hired every year. These are the traits she knows translate into excellent performance on the job.
Contributor Aleh Barysevich breaks down three strategies you can use to boost the effectiveness of your internal link building campaigns to fulfill specific SEO-related goals.
The antidote to vanity metrics when you have less than 1 hour/week for marketing analytics
Simple Analytics is the privacy-first Google Analytics alternative that is 100% GDPR compliant. Give us a try!
In "Email Marketing Metrics, Part 1: The Basics," my article last month, I addressed the primary measurements for email marketing: delivery rate, open
There’s widespread use of adblockers on the web but users are increasingly blocking cookies and other tracking scripts too. Browsers such as Safari, Firefox and Brave are privacy-focused.
If you are working in the field of SEO or if you are managing a content or Ecommerce website then you...
A cohort is a group of people who share a common characteristic or experience within a defined period. This is a handy tool for browsing cohort datasets.
“My biggest surprise was when we launched the Facebook app and it didn’t go viral” -Startup CEO quote “The month after we ...
Deploy and update measurement tags on your websites and mobile apps from a web interface, without major code changes or app releases.
Knowing what to test and how to interpret the results based on nuances and oddities of experiments is an important skill for people, not automations.
Hey everyone! I star all kinds of crazy GitHub repos and last week I stumbled on an awesome project...
Startup Metrics, a love story. All slides of an 6h Lean Analytics workshop. - Download as a PDF or view online for free
With the ubiquity of music access and a lack of any need for patience, the term "skip-rate" has crept into the modern music industry lexicon, and some new data behind. Continue reading
Developers don’t do SEO. They make sure sites are SEO-ready. That means developers hold the key to SEO. It’s true. If you’re a developer and you’re r
Spotify analytics for listeners is how the popular streaming service also captures the hearts of its users. Many websites allow
Content marketing has become an increasingly popular way for brands to promote themselves. It is subtle and generates more leads than traditional
Search engine optimization for ecommerce boils down to four buckets. That's according to Jeff Oxford, founder of 180 Marketing, an Oregon-based firm.
Shoppers' actions on an ecommerce site create opportunities for automated, triggered emails. Such behavior-based email automation is a sure-fire tactic to drive revenue.
Monitoring rankings remains the best way to track organic search performance. In this piece, we list five helpful tools to track your site's positions and your competitors'.
Conjoint analysis is a highly effective means of market research, capable of informing a company’s pricing strategy and product development.
Conjoint analysis is the optimal market research approach for measuring the value that consumers place on features of a product or service. Learn more!
Here are four of the top technical SEO issues that your auditing tools won't show you and how to find them.
The way we live our lives has an impact on our work. Long lists of typical chores may turn your
Competitive poaching refers to the practice of bidding on ads for a competitor’s search terms, in order to poach customers searching for that brand. It’s a common tactic in the world of digital ads — but is it effective? The author shares results from the first-ever empirical study of this practice, which found that poaching can work well for higher-end brands, but may backfire for lower-end or mass market offerings. Specifically, the study found that when an ad poached customers who searched for a high-end brand, users clicked on it more, but when an ad poached a low-end or mass market target, users were less likely to click. Of course, the author notes that clickthrough rate is just one metric, and there may be other ways in which a poaching campaign could be harmful or beneficial. But these findings can help marketers add a bit of science to the art that is digital advertising, helping them to optimize campaigns for their unique products and customers.
Keyword lists for SEO are often cluttered and seemingly endless. "Clustering" can help by grouping keywords by a common modifier.
The Landing Page report. Universal Analytics has it. GA4 does not. But you can make it! This article will show you how.
It's time to optimize for People Also Asked questions asked around and about your brand in Google's SERPs. Here's why.
The most consistent sales leader I’ve worked with hit plan 27 consecutive quarters. How can a sales leader develop similar repeatability? Much goes into it here are the reports he used to manage his team at the board level. The PQR (pipeline-to-quota) funnel is first. Pipeline is the total value of the accounts within a stage or later. Quota is the aggregate quota on the street for the quarter. Divide P by Q to get PQR.
Tracked analytics metrics should reflect change in the user experience. Vanity metrics appear impressive, but their fluctuations are not actionable.
Keyword Tool is #1 (FREE) alternative to Google Ads Keyword Planner for SEO & PPC keyword research ᐈ Generate 1,000s ✅ long-tail keywords in seconds!
A curated list of data engineering tools for software developers - igorbarinov/awesome-data-engineering
They are neat, fast, and straightforward. Even with messy and disorganized data, a good visualization is the key to show insights and features that are difficult to point out on a raw table. In this blog post I will show you how to build a simple, but useful and good-looking dashboard to present your data - in three simple steps!
Is Google Analytics still useful and how accurate are its stats? How much data is missing from Google Analytics due to adblockers and privacy-friendly browsers?
Managing a Google ads campaign requires understanding how to check, optimize, test, and change your ads. Read this post to learn more.
Not sure where to start with marketing automation? Here are 25 tools, and how to use them to streamline and improve your marketing.
Pie charts and scatter plots seem like ordinary tools, but they revolutionized the way we solve problems.
A new approach in the way the Census aggregates its data could make it more difficult to do extreme gerrymandering, says Moon Duchin.
In marketing analytics, conjoint analysis is a technique used to gain specific insights about consumers’ preferences. Often derived from consumer surveys, conjoint analysis can tell us, for instance…
Thirty years ago, Billboard changed the way it tabulated its charts, turning the industry on its head and making room for genres once considered afterthoughts to explode in the national consciousness
Should we still be talking about online and offline retail, or about trucks versus boxes versus bikes?
Net dollar churn is a more value-driven way of looking at churn.
Free books, lectures, blogs, papers, and more for a causal inference crash course
Pandas doesn’t handle well Big Data. These two libraries do! Which one is better? Faster?
There’s a reason that online ticket sellers hit you with those extra fees after you’ve picked your seats and are ready to click “buy.” Pure profit. A
Uplift models seek to predict the incremental value attained in response to a treatment. For example, if we want to know the value of showing an advertisement to someone, typical response models will only tell us that a person is likely to purchase after being given an advertisement, though they may have been likely to purchase already. Uplift models will predict how much more likely they are to purchase after being shown the ad. The most scalable uplift modeling packages to date are theoretically rigorous, but, in practice, they can be prohibitively slow. We have written a Python package, pylift, that implements a transformative method wrapped around scikit-learn to allow for (1) quick implementation of uplift, (2) rigorous uplift evaluation, and (3) an extensible python-based framework for future uplift method implementations.
A heatmap is a graphical representation of data in which data values are represented as colors. That is, it uses color in order to…
The Guide to Product Analytics taps dozens of product leaders (from companies like Google, Twitter, and LinkedIn) to break down how PMs can use product analytics to drive product-led growth.
Retail Analytics: Data Science for Retail
.png)
If you make $10 profit each time you sell a product, what cost per conversion should you aim for? Answering this question isn't easy, but it can teach us a lot about how to approach advertising.
Every website or PWA you build should automate as much prospecting and selling as possible. The only thing is that visitors enter websites with various mindsets, depending on which part of the buying stage they’re at. This means that you can’t just take every person who enters the site through the same path. You have to design a custom sales funnel (or pathway) for each kind of buyer. In this article, Suzanna Scacca will tell you what you need to keep in mind.
Learn how to interpret what’s happening in your paid search account with your traffic, conversions and sales data.
Running an A/B test is easy. Screwing up an A/B test is even easier.
Google Analytics may be the most important application to understand the behavior of your visitors. And whether you’re a beginner or an experienced user, there are many free resources to help. Here is a list of free tutorials for Google Analytics.
There has been a seismic shift in website traffic in the past several years, from desktop to mobile. Google Analytics has rolled out the beta version of cross-device reporting to inform merchants of how their shoppers are interacting via multiple devices.
Increasingly, companies are using experiments to guide them in their decision making—but many are still missing opportunities, or are failing to implement experiments well. When it comes to the rollout of new products, one particularly effective new kind of experiment involves randomizing the introduction of new products across a set of markets. Uber used this strategy before rolling out its Express Pool service, and Airbnb did the same before rollout out a new landing-page design. In both cases, the companies gathered data that allowed them to roll out their products with confidence that they would succeed—as indeed they did. Many companies, even those not in the tech sector, can benefit from this kind of experimentation, especially if they follow a few basic guidelines.
When we think about the data we hold on our services, the first thing that comes to mind is often website analytics. But there are other valuable and occasionally overlooked types of data that can be really useful to user researchers.
How I replaced Google tracking with simple log-based analytics on my personal website.
Google Analytics is a powerful, free web analytics platform. However, it has gaps that are better served by other tools. I'll address those gaps and tools in this post.
Update 2016-10-18: This tutorial has been updated to reflect the latest version of my stack (now with Drip!). I’ve also updated pricing info (it’s technically a $0 stack now) and screenshots. The original outdated article is archived here. “Just tell me what to do so I can stop
“That’s just one person” and “Our real users aren’t like that” are common objections to findings from qualitative usability testing. Address these concerns proactively to ensure your research is effective.
Last week we hosted over 130 experimenters at Optimizely HQ in San Francisco for our first live event of the year. We were lucky enough to be joined by two...
Finding and building the next big idea is the holy grail of any tech company. Unfortunately the statistics are against us: when subjected…
Check out these 3 privacy-focused alternatives to Google Analytics.
Connect with developers sharing the strategies and revenue numbers behind their companies and side projects.
When we need to measure marketing campaigns, most of us have cracked online campaign tracking – we have a cookie
Read this guide for an overview of Google Analytics and how you can use all the data to your advantage to boost your SEO and digital marketing.
Sammy Gelfand is the numbers guy behind the Golden State Warriors’ success. Some pretty good players help, too.
Learn how the world's fastest growing companies have hacked their way to success with innovative products, viral promotions and ingenious marketing campaigns. [6500 words]
We will review another fascinating approach that marries heuristic and probabilistic methods. We will link marketing channels with a probability of a customer passing through each step of a Sales Funnel
When deciding whether to track users on the server or on the client, there are many gotchas and factors to consider. Here is a short guide with pros and cons of each.
At some point, almost every company faces questions like How good are the customers that we acquire? How do they
Users are rating items on your website. How do you know what the highest-rated items are?