Difference Between Good & Great Teams, Mutually Exclusive Experiments, & New Year Resolutions, Oh My!
TLC Connector | Teach. Learn. Converse.
Happy New Year, TLC Family! As 2024 unfolds, we're embracing fresh starts and thrilling collaborations. We're excited to announce our new partnership with Kameleoon, joining us for the next six months to spotlight your all-team experimentation stories!
Dive into Kameleoon's 2023 Experimentation and Growth Survey for insights that will spark lively conversations and ideas. Your experiences matter to us, so we invite you to share your multi-team collaboration stories as we grow and learn together this year.
Check out the blog post from Kameleoon below for survey highlights – you will learn a lot - I promise. Plus, a special reminder: don't miss our first-ever TLC-hosted live panel at Superweek on Jan 31, featuring TLC favorites Jenn Kunz and Simo Ahava. Tune in for all the fun; find the live stream link at the end of this newsletter!
Today, if you want to count yourself among leading companies, you can’t just optimize acquisition channels with web experimentation leaving product adoption and retention to languish. Nor can product-led companies expect to reach IPO heights without optimizing marketing. Recent research by James McCormick with Kameleoon confirms leading companies harness marketing-led growth (MLG) and product-led growth (PLG) by experimenting with every technique in the book.
Read the research highlights then sign up to share your story with Kameleoon & the TLC and you could be featured in the next few months!
TLC Chatter
New year! New resolutions. This month’s chatter includes resolutions from TLC members:
Florent Buisson: increase (at least double) the % of product features that are tested before shipping
Dylan Lewis: (with a hat tip to Kevin Anderson’s Experimental Mind newsletter) - run more experiments across different aspects of my life (link)
Tracy Laranjo: stop dunking on the HiPPO (which ties in nicely to our previously referenced all-team experimentation series sponsored by Kameloon kicking off this month!)
Kelly Sable: “I will not just call a win a win and move on; I will remember that we can iterate on wins, too!”
Me: I will stop worrying so much about interaction effects (because Lukas Vermeer says interaction effects are incredibly rare and taught us all how to detect them)
Matt Gershoff: with the closing edutainment. “isn’t peeking kinda like walking by the wedding cake and giving it a furtive eye? It’s when you dig in before it’s time that you get in trouble. 🎂👀😃” So true, Matt. So true.
When to Run Mutually Exclusive Experiments. Brought to you by
Many teams new to experimentation get concerned about interaction effects between experiments or need help understanding why independent randomization enables independent results.
Luckily, the conversation around interaction effects has evolved significantly in the last year thanks to first-hand experience shared by leading companies like Microsoft and Vista. It's increasingly common knowledge that this is *not* a major area of concern for most teams.
Still, folks often ask us about when and how to run mutually exclusive experiments, so we put together a guide—read on to learn more.
Coming Soon: TLC Conversations & Industry Events
Jan 26 - TLC Conversation: Erin Weigel
Jan 29-Feb 2 - SUPWERWEEK: TLC Live! with Jenn Kunz, Simo Ahava, Rick Dronkers, & Kat Ribant Jan 31
catch it on Supwerweek TV if you can’t join us in person!
(15:40 CET | 14:40 GMT | 9:40 AM Eastern | 8:40 AM Central | 7:40 AM Mountain | 6:40 AM Pacific)
Feb 9 - TLC Conversation: Will Critchlow
Mar 15 - TLC Conversation: Karl Gilis
Apr 26 - TLC Conversation: Daphne Tideman